2024-05-03T22:15:07.465 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-03T22:15:07.465 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/pjd}} --verbose --archive /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687548 --name rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687548/orig.config.yaml 2024-05-03T22:15:07.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-03T22:15:07.609 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687548 branch: wip-rishabh-testing-20240501.193033 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/pjd}} email: null first_in_suite: false job_id: '7687548' kernel: flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240501.193033 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 fuse default permissions: false fuse set user groups: true rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 9a047fe7599a549042d06a3fb5b6813a203eabea subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 9a047fe7599a549042d06a3fb5b6813a203eabea kclient: client.0: mount_subvol_num: 1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240501.193033 sha1: 9a047fe7599a549042d06a3fb5b6813a203eabea owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1698 sha1: 9a047fe7599a549042d06a3fb5b6813a203eabea sleep_before_teardown: 0 subset: 434/512 suite: fs suite_branch: wip-rishabh-testing-20240501.193033 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_9a047fe7599a549042d06a3fb5b6813a203eabea/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 9a047fe7599a549042d06a3fb5b6813a203eabea syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi044.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNt/yp8mgfqb2X8ufTPd9deC6g4oUp2ZfNWGyIiBnhQI3tB3pCHS5QljKlDqX4+bramTWejszyIAvaU8pWHvADM= smithi060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN/L9y1JELttnKs4EZQ8h0BYfj1xqYuDMqIwk3gLvZUVrcB+2NfCcrru0oWOJjgR9QAsEhfUzWkgiQn8pNGGhk8= smithi160.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOjDRymCIt41++K4yItuJBiF1fegG2qt5tAUtyPrSQXyjs5wdQr+iuCRWKhuywAFAaT5+uCtehec3E6T0gyQgMM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - workunit: clients: all: - suites/pjd.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-03_13:56:19 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-03T22:15:07.610 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_9a047fe7599a549042d06a3fb5b6813a203eabea/qa; will attempt to use it 2024-05-03T22:15:07.613 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_9a047fe7599a549042d06a3fb5b6813a203eabea/qa/tasks 2024-05-03T22:15:07.613 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-03T22:15:07.615 INFO:teuthology.task.internal:Checking packages... 2024-05-03T22:15:07.639 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '9a047fe7599a549042d06a3fb5b6813a203eabea' 2024-05-03T22:15:07.639 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-03T22:15:07.639 INFO:teuthology.packaging:ref: None 2024-05-03T22:15:07.639 INFO:teuthology.packaging:tag: None 2024-05-03T22:15:07.639 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240501.193033 2024-05-03T22:15:07.639 INFO:teuthology.packaging:sha1: 9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:15:07.640 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240501.193033 2024-05-03T22:15:07.870 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3450.g9a047fe7 2024-05-03T22:15:07.872 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-03T22:15:07.879 INFO:teuthology.task.internal:no buildpackages task found 2024-05-03T22:15:07.879 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-03T22:15:07.895 INFO:teuthology.task.internal:Saving configuration 2024-05-03T22:15:07.916 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-03T22:15:07.922 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-03T22:15:07.945 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687548', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-03 22:09:49.852700', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNt/yp8mgfqb2X8ufTPd9deC6g4oUp2ZfNWGyIiBnhQI3tB3pCHS5QljKlDqX4+bramTWejszyIAvaU8pWHvADM='} 2024-05-03T22:15:07.970 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687548', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-03 22:09:49.854361', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN/L9y1JELttnKs4EZQ8h0BYfj1xqYuDMqIwk3gLvZUVrcB+2NfCcrru0oWOJjgR9QAsEhfUzWkgiQn8pNGGhk8='} 2024-05-03T22:15:07.991 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687548', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-03 22:09:49.850887', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOjDRymCIt41++K4yItuJBiF1fegG2qt5tAUtyPrSQXyjs5wdQr+iuCRWKhuywAFAaT5+uCtehec3E6T0gyQgMM='} 2024-05-03T22:15:07.992 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-03T22:15:07.998 INFO:teuthology.task.internal:roles: ubuntu@smithi044.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-03T22:15:07.998 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-03T22:15:07.999 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-03T22:15:07.999 INFO:teuthology.run_tasks:Running task console_log... 2024-05-03T22:15:08.119 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5cfeceb160>, signals=[15]) 2024-05-03T22:15:08.120 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-03T22:15:08.126 INFO:teuthology.task.internal:Opening connections... 2024-05-03T22:15:08.126 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi044.front.sepia.ceph.com 2024-05-03T22:15:08.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T22:15:08.207 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2024-05-03T22:15:08.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T22:15:08.285 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi160.front.sepia.ceph.com 2024-05-03T22:15:08.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T22:15:08.362 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-03T22:15:08.368 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-05-03T22:15:08.387 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-05-03T22:15:08.388 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-05-03T22:15:08.445 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-05-03T22:15:08.446 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-05-03T22:15:08.446 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-05-03T22:15:08.446 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-05-03T22:15:08.446 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-05-03T22:15:08.446 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-05-03T22:15:08.446 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-03T22:15:08.446 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-05-03T22:15:08.446 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-05-03T22:15:08.446 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-03T22:15:08.446 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-05-03T22:15:08.446 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-03T22:15:08.447 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-03T22:15:08.447 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-03T22:15:08.447 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-05-03T22:15:08.470 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2024-05-03T22:15:08.489 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2024-05-03T22:15:08.489 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2024-05-03T22:15:08.547 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2024-05-03T22:15:08.547 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9" 2024-05-03T22:15:08.547 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2024-05-03T22:15:08.547 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2024-05-03T22:15:08.547 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9" 2024-05-03T22:15:08.547 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9" 2024-05-03T22:15:08.548 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-03T22:15:08.548 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2024-05-03T22:15:08.548 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon" 2024-05-03T22:15:08.548 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-03T22:15:08.548 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2024-05-03T22:15:08.548 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-03T22:15:08.548 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-03T22:15:08.548 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-03T22:15:08.548 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2024-05-03T22:15:08.570 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2024-05-03T22:15:08.588 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2024-05-03T22:15:08.588 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2024-05-03T22:15:08.645 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream" 2024-05-03T22:15:08.645 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="9" 2024-05-03T22:15:08.645 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2024-05-03T22:15:08.645 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2024-05-03T22:15:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="9" 2024-05-03T22:15:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el9" 2024-05-03T22:15:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-03T22:15:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2024-05-03T22:15:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:LOGO="fedora-logo-icon" 2024-05-03T22:15:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-03T22:15:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/" 2024-05-03T22:15:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-03T22:15:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-03T22:15:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-03T22:15:08.647 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2024-05-03T22:15:08.670 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-03T22:15:08.681 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-03T22:15:08.686 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-03T22:15:08.687 DEBUG:teuthology.orchestra.run.smithi044:> test '!' -e /home/ubuntu/cephtest 2024-05-03T22:15:08.689 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2024-05-03T22:15:08.691 DEBUG:teuthology.orchestra.run.smithi160:> test '!' -e /home/ubuntu/cephtest 2024-05-03T22:15:08.708 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-03T22:15:08.718 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-03T22:15:08.718 DEBUG:teuthology.orchestra.run.smithi044:> test -z $(ls -A /var/lib/ceph) 2024-05-03T22:15:08.746 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2024-05-03T22:15:08.749 DEBUG:teuthology.orchestra.run.smithi160:> test -z $(ls -A /var/lib/ceph) 2024-05-03T22:15:08.783 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-03T22:15:08.850 INFO:teuthology.run_tasks:Running task kernel... 2024-05-03T22:15:08.866 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-05-03T22:15:08.867 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'mon.c': {'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, timeout 300 2024-05-03T22:15:08.867 DEBUG:teuthology.orchestra.run.smithi044:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-03T22:15:08.867 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-03T22:15:08.868 DEBUG:teuthology.orchestra.run.smithi160:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-03T22:15:08.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T22:15:08.885 DEBUG:teuthology.task.kernel:sha1 for mon.c is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T22:15:08.885 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-03T22:15:08.885 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2024-05-03T22:15:08.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T22:15:08.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T22:15:08.887 DEBUG:teuthology.task.kernel:sha1 for mon.a is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T22:15:08.887 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-03T22:15:08.887 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-05-03T22:15:08.888 DEBUG:teuthology.task.kernel:sha1 for mon.b is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T22:15:08.888 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-03T22:15:08.888 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-05-03T22:15:08.942 INFO:teuthology.orchestra.run.smithi160.stdout:5.14.0-437.el9.x86_64 2024-05-03T22:15:08.942 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T22:15:08.942 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-03T22:15:08.943 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T22:15:08.947 INFO:teuthology.orchestra.run.smithi060.stdout:5.14.0-437.el9.x86_64 2024-05-03T22:15:08.947 INFO:teuthology.orchestra.run.smithi044.stdout:5.14.0-437.el9.x86_64 2024-05-03T22:15:08.947 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T22:15:08.947 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-03T22:15:08.948 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T22:15:08.948 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T22:15:08.949 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-03T22:15:08.949 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T22:15:09.085 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum upgrade -y linux-firmware 2024-05-03T22:15:09.092 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum upgrade -y linux-firmware 2024-05-03T22:15:09.182 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum upgrade -y linux-firmware 2024-05-03T22:15:11.477 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-05-03T22:15:11.541 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 9.7 MB/s | 8.0 MB 00:00 2024-05-03T22:15:11.686 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 9.6 MB/s | 8.0 MB 00:00 2024-05-03T22:15:13.752 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-05-03T22:15:14.075 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-05-03T22:15:18.247 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 6.2 MB 00:00 2024-05-03T22:15:18.392 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 9.9 MB/s | 6.2 MB 00:00 2024-05-03T22:15:19.762 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 16 kB 00:00 2024-05-03T22:15:20.943 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 16 kB 00:01 2024-05-03T22:15:21.732 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-03T22:15:22.715 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-03T22:15:26.930 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-05-03T22:15:27.978 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-05-03T22:15:28.167 INFO:teuthology.orchestra.run.smithi060.stdout:Last metadata expiration check: 0:00:01 ago on Fri 03 May 2024 10:15:27 PM UTC. 2024-05-03T22:15:28.966 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-05-03T22:15:28.968 INFO:teuthology.orchestra.run.smithi044.stdout:Nothing to do. 2024-05-03T22:15:28.968 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-05-03T22:15:29.076 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-05-03T22:15:29.076 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T22:15:29.126 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:16 2024-05-03T22:15:29.216 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-03T22:15:29.217 DEBUG:teuthology.orchestra.run.smithi044:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-03T22:15:29.219 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi044.front.sepia.ceph.com to complete... 2024-05-03T22:15:30.037 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-05-03T22:15:30.038 INFO:teuthology.orchestra.run.smithi060.stdout:Nothing to do. 2024-05-03T22:15:30.038 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-05-03T22:15:30.148 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-05-03T22:15:30.148 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T22:15:30.291 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-03T22:15:30.291 DEBUG:teuthology.orchestra.run.smithi060:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-03T22:15:30.294 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi060.front.sepia.ceph.com to complete... 2024-05-03T22:15:33.085 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.2 MB 00:00 2024-05-03T22:15:34.902 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-05-03T22:15:37.404 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 8.8 MB/s | 21 MB 00:02 2024-05-03T22:15:42.470 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-05-03T22:15:44.437 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-03T22:15:44.438 INFO:teuthology.orchestra.run.smithi160.stdout:Nothing to do. 2024-05-03T22:15:44.438 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-03T22:15:44.545 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.c... 2024-05-03T22:15:44.545 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-03T22:15:44.695 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-03T22:15:44.696 DEBUG:teuthology.orchestra.run.smithi160:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-03T22:15:44.698 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi160.front.sepia.ceph.com to complete... 2024-05-03T22:16:13.203 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03 22:16:13 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-03T22:16:13.203 INFO:teuthology.orchestra.run.smithi160.stderr:FINISHED --2024-05-03 22:16:13-- 2024-05-03T22:16:13.204 INFO:teuthology.orchestra.run.smithi160.stderr:Total wall clock time: 28s 2024-05-03T22:16:13.204 INFO:teuthology.orchestra.run.smithi160.stderr:Downloaded: 1 files, 341M in 28s (12.1 MB/s) 2024-05-03T22:16:13.207 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.c... 2024-05-03T22:16:13.207 DEBUG:teuthology.orchestra.run.smithi160:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-03T22:16:14.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03 22:16:14 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-03T22:16:14.060 INFO:teuthology.orchestra.run.smithi044.stderr:FINISHED --2024-05-03 22:16:14-- 2024-05-03T22:16:14.060 INFO:teuthology.orchestra.run.smithi044.stderr:Total wall clock time: 45s 2024-05-03T22:16:14.060 INFO:teuthology.orchestra.run.smithi044.stderr:Downloaded: 1 files, 341M in 44s (7.66 MB/s) 2024-05-03T22:16:14.064 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.a... 2024-05-03T22:16:14.064 DEBUG:teuthology.orchestra.run.smithi044:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-03T22:16:15.374 INFO:teuthology.orchestra.run.smithi160.stdout:Verifying... ######################################## 2024-05-03T22:16:15.595 INFO:teuthology.orchestra.run.smithi160.stdout:Preparing... ######################################## 2024-05-03T22:16:16.283 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying... ######################################## 2024-05-03T22:16:16.402 INFO:teuthology.orchestra.run.smithi044.stdout:Preparing... ######################################## 2024-05-03T22:16:16.440 INFO:teuthology.orchestra.run.smithi160.stdout:Updating / installing... 2024-05-03T22:16:16.523 INFO:teuthology.orchestra.run.smithi044.stdout:Updating / installing... 2024-05-03T22:16:19.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03 22:16:19 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-03T22:16:19.964 INFO:teuthology.orchestra.run.smithi060.stderr:FINISHED --2024-05-03 22:16:19-- 2024-05-03T22:16:19.964 INFO:teuthology.orchestra.run.smithi060.stderr:Total wall clock time: 50s 2024-05-03T22:16:19.964 INFO:teuthology.orchestra.run.smithi060.stderr:Downloaded: 1 files, 341M in 49s (6.94 MB/s) 2024-05-03T22:16:19.967 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on mon.b... 2024-05-03T22:16:19.967 DEBUG:teuthology.orchestra.run.smithi060:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-03T22:16:22.147 INFO:teuthology.orchestra.run.smithi060.stdout:Verifying... ######################################## 2024-05-03T22:16:22.285 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing... ######################################## 2024-05-03T22:16:22.415 INFO:teuthology.orchestra.run.smithi060.stdout:Updating / installing... 2024-05-03T22:16:24.439 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-03T22:16:24.852 INFO:teuthology.orchestra.run.smithi044.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-03T22:16:30.694 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-03T22:17:01.264 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi160.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-03T22:17:01.264 DEBUG:teuthology.orchestra.run.smithi160:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-03T22:17:01.343 INFO:teuthology.orchestra.run.smithi160.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:01.343 INFO:teuthology.orchestra.run.smithi160.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:01.343 INFO:teuthology.orchestra.run.smithi160.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:01.343 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-03T22:17:01.344 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-03T22:17:01.344 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-03T22:17:01.344 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-03T22:17:01.344 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-03T22:17:01.344 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-03T22:17:01.344 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-03T22:17:01.344 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-03T22:17:01.344 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-03T22:17:01.344 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-03T22:17:01.344 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-03T22:17:01.344 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-03T22:17:01.344 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-03T22:17:01.344 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-03T22:17:01.344 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-03T22:17:01.345 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-03T22:17:01.345 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-03T22:17:01.345 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-03T22:17:01.345 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-03T22:17:01.345 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-03T22:17:01.345 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-03T22:17:01.345 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-03T22:17:01.345 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-03T22:17:01.345 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-03T22:17:01.345 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-03T22:17:01.345 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-03T22:17:01.345 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-03T22:17:01.345 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-03T22:17:01.346 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-03T22:17:01.346 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-03T22:17:01.346 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-03T22:17:01.346 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-03T22:17:01.346 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-03T22:17:01.346 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-03T22:17:01.346 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-03T22:17:01.346 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-03T22:17:01.346 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-03T22:17:01.346 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-03T22:17:01.346 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-03T22:17:01.346 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-03T22:17:01.346 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-03T22:17:01.347 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-03T22:17:01.347 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-03T22:17:01.347 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-03T22:17:01.347 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-03T22:17:01.347 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-03T22:17:01.347 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-03T22:17:01.347 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-03T22:17:01.347 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-03T22:17:01.347 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-03T22:17:01.347 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-03T22:17:01.347 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-03T22:17:01.347 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-03T22:17:01.347 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-03T22:17:01.347 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-03T22:17:01.348 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-03T22:17:01.348 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-03T22:17:01.348 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-03T22:17:01.348 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-03T22:17:01.348 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-03T22:17:01.348 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-03T22:17:01.348 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-03T22:17:01.348 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-03T22:17:01.348 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-03T22:17:01.348 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-03T22:17:01.348 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-03T22:17:01.348 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-03T22:17:01.348 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-03T22:17:01.349 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-03T22:17:01.349 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-03T22:17:01.349 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-03T22:17:01.349 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-03T22:17:01.349 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-03T22:17:01.349 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-03T22:17:01.349 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-03T22:17:01.349 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-03T22:17:01.349 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-03T22:17:01.349 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-03T22:17:01.349 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-03T22:17:01.349 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-03T22:17:01.349 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-03T22:17:01.349 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-03T22:17:01.350 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-03T22:17:01.350 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-03T22:17:01.350 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-03T22:17:01.350 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-03T22:17:01.350 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-03T22:17:01.350 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-03T22:17:01.350 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-03T22:17:01.350 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-03T22:17:01.350 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-03T22:17:01.350 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-03T22:17:01.350 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-03T22:17:01.350 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-03T22:17:01.350 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-03T22:17:01.350 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-03T22:17:01.351 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-03T22:17:01.351 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-03T22:17:01.351 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-03T22:17:01.351 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-03T22:17:01.351 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-03T22:17:01.351 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-03T22:17:01.351 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-03T22:17:01.351 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-03T22:17:01.351 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-03T22:17:01.351 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-03T22:17:01.351 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-03T22:17:01.351 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-03T22:17:01.351 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-03T22:17:01.351 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-03T22:17:01.352 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-03T22:17:01.352 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-03T22:17:01.352 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-03T22:17:01.352 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-03T22:17:01.352 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-03T22:17:01.352 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-03T22:17:01.352 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-03T22:17:01.352 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-03T22:17:01.352 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-03T22:17:01.352 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-03T22:17:01.352 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-03T22:17:01.352 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-03T22:17:01.352 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-03T22:17:01.352 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-03T22:17:01.352 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-03T22:17:01.353 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-03T22:17:01.353 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-03T22:17:01.353 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-03T22:17:01.353 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-03T22:17:01.353 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-03T22:17:01.353 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-03T22:17:01.353 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-03T22:17:01.353 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-03T22:17:01.353 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-03T22:17:01.353 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-03T22:17:01.353 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-03T22:17:01.353 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-03T22:17:01.353 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-03T22:17:01.353 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-03T22:17:01.353 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-03T22:17:01.354 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-03T22:17:01.354 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-03T22:17:01.354 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-03T22:17:01.354 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-03T22:17:01.354 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-03T22:17:01.354 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-03T22:17:01.354 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-03T22:17:01.354 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-03T22:17:01.354 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-03T22:17:01.354 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-03T22:17:01.354 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-03T22:17:01.354 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-03T22:17:01.354 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-03T22:17:01.354 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-03T22:17:01.354 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-03T22:17:01.355 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-03T22:17:01.355 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-03T22:17:01.355 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-03T22:17:01.355 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-03T22:17:01.355 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-03T22:17:01.355 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-03T22:17:01.355 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-03T22:17:01.355 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-03T22:17:01.355 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-03T22:17:01.355 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-03T22:17:01.355 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-03T22:17:01.355 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-03T22:17:01.355 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-03T22:17:01.356 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-03T22:17:01.356 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-03T22:17:01.356 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-03T22:17:01.356 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-03T22:17:01.356 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-03T22:17:01.356 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-03T22:17:01.356 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-03T22:17:01.356 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-03T22:17:01.356 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-03T22:17:01.356 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-03T22:17:01.356 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-03T22:17:01.356 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-03T22:17:01.356 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-03T22:17:01.356 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-03T22:17:01.357 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-03T22:17:01.357 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-03T22:17:01.357 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-03T22:17:01.357 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-03T22:17:01.357 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-03T22:17:01.357 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-03T22:17:01.357 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-03T22:17:01.357 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-03T22:17:01.357 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-03T22:17:01.357 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-03T22:17:01.357 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-03T22:17:01.357 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-03T22:17:01.357 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-03T22:17:01.357 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-03T22:17:01.358 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-03T22:17:01.358 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-03T22:17:01.358 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-03T22:17:01.358 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-03T22:17:01.358 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-03T22:17:01.358 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-03T22:17:01.358 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-03T22:17:01.358 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-03T22:17:01.358 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-03T22:17:01.358 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-03T22:17:01.358 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-03T22:17:01.358 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-03T22:17:01.358 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-03T22:17:01.358 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-03T22:17:01.359 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-03T22:17:01.359 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-03T22:17:01.359 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-03T22:17:01.359 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-03T22:17:01.359 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-03T22:17:01.359 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-03T22:17:01.359 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-03T22:17:01.359 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-03T22:17:01.359 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-03T22:17:01.359 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-03T22:17:01.359 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-03T22:17:01.359 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-03T22:17:01.359 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-03T22:17:01.360 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-03T22:17:01.360 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-03T22:17:01.360 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-03T22:17:01.360 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-03T22:17:01.360 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-03T22:17:01.360 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-03T22:17:01.360 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-03T22:17:01.360 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-03T22:17:01.360 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-03T22:17:01.360 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-03T22:17:01.360 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-03T22:17:01.360 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-03T22:17:01.360 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-03T22:17:01.361 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-03T22:17:01.361 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-03T22:17:01.361 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-03T22:17:01.361 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-03T22:17:01.361 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-03T22:17:01.361 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-03T22:17:01.361 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-03T22:17:01.361 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-03T22:17:01.361 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-03T22:17:01.361 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-03T22:17:01.361 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-03T22:17:01.361 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-03T22:17:01.361 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-03T22:17:01.361 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-03T22:17:01.362 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-03T22:17:01.362 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-03T22:17:01.362 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-03T22:17:01.362 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-03T22:17:01.362 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-03T22:17:01.362 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-03T22:17:01.362 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-03T22:17:01.362 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-03T22:17:01.362 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-03T22:17:01.362 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-03T22:17:01.362 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-03T22:17:01.362 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-03T22:17:01.362 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-03T22:17:01.362 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-03T22:17:01.363 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-03T22:17:01.363 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-03T22:17:01.363 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-03T22:17:01.363 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-03T22:17:01.363 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-03T22:17:01.363 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-03T22:17:01.363 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-03T22:17:01.363 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-03T22:17:01.363 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-03T22:17:01.363 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-03T22:17:01.363 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-03T22:17:01.363 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-03T22:17:01.363 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-03T22:17:01.364 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-03T22:17:01.364 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-03T22:17:01.364 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-03T22:17:01.364 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-03T22:17:01.364 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-03T22:17:01.364 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-03T22:17:01.364 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-03T22:17:01.364 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-03T22:17:01.364 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-03T22:17:01.364 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-03T22:17:01.364 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-03T22:17:01.364 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-03T22:17:01.364 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-03T22:17:01.364 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-03T22:17:01.365 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-03T22:17:01.365 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-03T22:17:01.365 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-03T22:17:01.365 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-03T22:17:01.365 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-03T22:17:01.365 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-03T22:17:01.365 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-03T22:17:01.365 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-03T22:17:01.365 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-03T22:17:01.365 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-03T22:17:01.365 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-03T22:17:01.365 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-03T22:17:01.365 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-03T22:17:01.365 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-03T22:17:01.366 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-03T22:17:01.366 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-03T22:17:01.366 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-03T22:17:01.366 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-03T22:17:01.366 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-03T22:17:01.366 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-03T22:17:01.366 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-03T22:17:01.366 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-03T22:17:01.366 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-03T22:17:01.366 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-03T22:17:01.366 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-03T22:17:01.366 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-03T22:17:01.366 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-03T22:17:01.366 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-03T22:17:01.367 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-03T22:17:01.367 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-03T22:17:01.367 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-03T22:17:01.367 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-03T22:17:01.367 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-03T22:17:01.367 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-03T22:17:01.367 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-03T22:17:01.367 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-03T22:17:01.367 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-03T22:17:01.367 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-03T22:17:01.367 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-03T22:17:01.367 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-03T22:17:01.367 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-03T22:17:01.367 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-03T22:17:01.368 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-03T22:17:01.368 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-03T22:17:01.368 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-03T22:17:01.368 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-03T22:17:01.368 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-03T22:17:01.368 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-03T22:17:01.368 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-03T22:17:01.368 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-03T22:17:01.368 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-03T22:17:01.368 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-03T22:17:01.368 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-03T22:17:01.368 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-03T22:17:01.368 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-03T22:17:01.368 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-03T22:17:01.369 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-03T22:17:01.369 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-03T22:17:01.369 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-03T22:17:01.369 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-03T22:17:01.369 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-03T22:17:01.369 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-03T22:17:01.369 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-03T22:17:01.369 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-03T22:17:01.369 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-03T22:17:01.369 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-03T22:17:01.369 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-03T22:17:01.369 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-03T22:17:01.369 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-03T22:17:01.370 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-03T22:17:01.370 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-03T22:17:01.370 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-03T22:17:01.370 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-03T22:17:01.370 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-03T22:17:01.370 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-03T22:17:01.370 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-03T22:17:01.370 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-03T22:17:01.370 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-03T22:17:01.370 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-03T22:17:01.370 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-03T22:17:01.370 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-03T22:17:01.370 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-03T22:17:01.370 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-03T22:17:01.370 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-03T22:17:01.371 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-03T22:17:01.371 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-03T22:17:01.371 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-03T22:17:01.371 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-03T22:17:01.371 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-03T22:17:01.371 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-03T22:17:01.371 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-03T22:17:01.371 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-03T22:17:01.371 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-03T22:17:01.371 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-03T22:17:01.371 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-03T22:17:01.371 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-03T22:17:01.371 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-03T22:17:01.371 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-03T22:17:01.372 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-03T22:17:01.372 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-03T22:17:01.372 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-03T22:17:01.372 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-03T22:17:01.372 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-03T22:17:01.372 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-03T22:17:01.372 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-03T22:17:01.372 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-03T22:17:01.372 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-03T22:17:01.372 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-03T22:17:01.372 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-03T22:17:01.372 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-03T22:17:01.372 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-03T22:17:01.372 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-03T22:17:01.373 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-03T22:17:01.373 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-03T22:17:01.373 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-03T22:17:01.373 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-03T22:17:01.373 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-03T22:17:01.373 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-03T22:17:01.373 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-03T22:17:01.373 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-03T22:17:01.373 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-03T22:17:01.373 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-03T22:17:01.373 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-03T22:17:01.373 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-03T22:17:01.373 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-03T22:17:01.373 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-03T22:17:01.373 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-03T22:17:01.374 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-03T22:17:01.374 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-03T22:17:01.374 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-03T22:17:01.374 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-03T22:17:01.374 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-03T22:17:01.374 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-03T22:17:01.374 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-03T22:17:01.374 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-03T22:17:01.374 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-03T22:17:01.374 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-03T22:17:01.374 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-03T22:17:01.374 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-03T22:17:01.374 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-03T22:17:01.374 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-03T22:17:01.375 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-03T22:17:01.375 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-03T22:17:01.375 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-03T22:17:01.375 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-03T22:17:01.375 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-03T22:17:01.375 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-03T22:17:01.375 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-03T22:17:01.375 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-03T22:17:01.375 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-03T22:17:01.375 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-03T22:17:01.375 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-03T22:17:01.375 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-03T22:17:01.375 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-03T22:17:01.376 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-03T22:17:01.376 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-03T22:17:01.376 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-03T22:17:01.376 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-03T22:17:01.376 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-03T22:17:01.376 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-03T22:17:01.376 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-03T22:17:01.376 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-03T22:17:01.376 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-03T22:17:01.376 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-03T22:17:01.376 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-03T22:17:01.376 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-03T22:17:01.376 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-03T22:17:01.376 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-03T22:17:01.376 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-03T22:17:01.377 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-03T22:17:01.377 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-03T22:17:01.377 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-03T22:17:01.377 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-03T22:17:01.377 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-03T22:17:01.377 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-03T22:17:01.377 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-03T22:17:01.377 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-03T22:17:01.377 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-03T22:17:01.377 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-03T22:17:01.377 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-03T22:17:01.377 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-03T22:17:01.377 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-03T22:17:01.377 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-03T22:17:01.378 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-03T22:17:01.378 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-03T22:17:01.378 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-03T22:17:01.378 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-03T22:17:01.378 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-03T22:17:01.378 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-03T22:17:01.378 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-03T22:17:01.378 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-03T22:17:01.378 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-03T22:17:01.378 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-03T22:17:01.378 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-03T22:17:01.378 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-03T22:17:01.378 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-03T22:17:01.379 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-03T22:17:01.379 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-03T22:17:01.379 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-03T22:17:01.379 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-03T22:17:01.379 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-03T22:17:01.379 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-03T22:17:01.379 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-03T22:17:01.379 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-03T22:17:01.379 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-03T22:17:01.379 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-03T22:17:01.379 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-03T22:17:01.379 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-03T22:17:01.379 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-03T22:17:01.379 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-03T22:17:01.379 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-03T22:17:01.380 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-03T22:17:01.380 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-03T22:17:01.380 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-03T22:17:01.380 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-03T22:17:01.380 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-03T22:17:01.380 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-03T22:17:01.380 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-03T22:17:01.380 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-03T22:17:01.380 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-03T22:17:01.380 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-03T22:17:01.380 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-03T22:17:01.380 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-03T22:17:01.380 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-03T22:17:01.380 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-03T22:17:01.381 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-03T22:17:01.381 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-03T22:17:01.381 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-03T22:17:01.381 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-03T22:17:01.381 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-03T22:17:01.381 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-03T22:17:01.381 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-03T22:17:01.381 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-03T22:17:01.381 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-03T22:17:01.381 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-03T22:17:01.381 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-03T22:17:01.381 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-03T22:17:01.381 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-03T22:17:01.382 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-03T22:17:01.382 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-03T22:17:01.382 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-03T22:17:01.382 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-03T22:17:01.382 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-03T22:17:01.382 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-03T22:17:01.382 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-03T22:17:01.382 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-03T22:17:01.382 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-03T22:17:01.382 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-03T22:17:01.382 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-03T22:17:01.382 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-03T22:17:01.382 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-03T22:17:01.383 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-03T22:17:01.383 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-03T22:17:01.383 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-03T22:17:01.383 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-03T22:17:01.383 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-03T22:17:01.383 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-03T22:17:01.383 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-03T22:17:01.383 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-03T22:17:01.383 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-03T22:17:01.383 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-03T22:17:01.383 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-03T22:17:01.383 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-03T22:17:01.383 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-03T22:17:01.383 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-03T22:17:01.383 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-03T22:17:01.384 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-03T22:17:01.384 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-03T22:17:01.384 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-03T22:17:01.384 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-03T22:17:01.384 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-03T22:17:01.384 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-03T22:17:01.384 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-03T22:17:01.384 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-03T22:17:01.384 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-03T22:17:01.384 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-03T22:17:01.384 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-03T22:17:01.384 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-03T22:17:01.384 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-03T22:17:01.384 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-03T22:17:01.384 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-03T22:17:01.384 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-03T22:17:01.385 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-03T22:17:01.385 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-03T22:17:01.385 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-03T22:17:01.385 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-03T22:17:01.385 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-03T22:17:01.385 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-03T22:17:01.385 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-03T22:17:01.385 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-03T22:17:01.385 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-03T22:17:01.385 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-03T22:17:01.385 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-03T22:17:01.385 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-03T22:17:01.385 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-03T22:17:01.386 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-03T22:17:01.386 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-03T22:17:01.386 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-03T22:17:01.386 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-03T22:17:01.386 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-03T22:17:01.386 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-03T22:17:01.386 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-03T22:17:01.386 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-03T22:17:01.386 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-03T22:17:01.386 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-03T22:17:01.386 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-03T22:17:01.386 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-03T22:17:01.386 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-03T22:17:01.387 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-03T22:17:01.387 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-03T22:17:01.387 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-03T22:17:01.387 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-03T22:17:01.387 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-03T22:17:01.387 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-03T22:17:01.387 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-03T22:17:01.387 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-03T22:17:01.387 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-03T22:17:01.387 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-03T22:17:01.387 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-03T22:17:01.387 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-03T22:17:01.387 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-03T22:17:01.387 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-03T22:17:01.387 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-03T22:17:01.387 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-03T22:17:01.388 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-03T22:17:01.388 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-03T22:17:01.388 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-03T22:17:01.388 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-03T22:17:01.388 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-03T22:17:01.388 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-03T22:17:01.388 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-03T22:17:01.388 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-03T22:17:01.388 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-03T22:17:01.388 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-03T22:17:01.388 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-03T22:17:01.388 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-03T22:17:01.388 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-03T22:17:01.389 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-03T22:17:01.389 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-03T22:17:01.389 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-03T22:17:01.389 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-03T22:17:01.389 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-03T22:17:01.389 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-03T22:17:01.389 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-03T22:17:01.389 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-03T22:17:01.389 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-03T22:17:01.389 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-03T22:17:01.389 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-03T22:17:01.389 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-03T22:17:01.389 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-03T22:17:01.389 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-03T22:17:01.390 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-03T22:17:01.390 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-03T22:17:01.390 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-03T22:17:01.390 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-03T22:17:01.390 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-03T22:17:01.390 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-03T22:17:01.390 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-03T22:17:01.390 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-03T22:17:01.390 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-03T22:17:01.390 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-03T22:17:01.390 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-03T22:17:01.390 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-03T22:17:01.390 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-03T22:17:01.390 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-03T22:17:01.391 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-03T22:17:01.391 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-03T22:17:01.391 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-03T22:17:01.391 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-03T22:17:01.391 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-03T22:17:01.391 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-03T22:17:01.391 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-03T22:17:01.391 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-03T22:17:01.391 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-03T22:17:01.391 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-03T22:17:01.391 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-03T22:17:01.391 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-03T22:17:01.391 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-03T22:17:01.391 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-03T22:17:01.392 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-03T22:17:01.392 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-03T22:17:01.392 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-03T22:17:01.392 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-03T22:17:01.392 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-03T22:17:01.392 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-03T22:17:01.392 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-03T22:17:01.392 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-03T22:17:01.392 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-03T22:17:01.392 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-03T22:17:01.392 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-03T22:17:01.392 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-03T22:17:01.392 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-03T22:17:01.392 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-03T22:17:01.392 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-03T22:17:01.393 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-03T22:17:01.393 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-03T22:17:01.393 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-03T22:17:01.393 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-03T22:17:01.393 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-03T22:17:01.393 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-03T22:17:01.393 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-03T22:17:01.393 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-03T22:17:01.393 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-03T22:17:01.393 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-03T22:17:01.393 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-03T22:17:01.393 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-03T22:17:01.393 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-03T22:17:01.394 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-03T22:17:01.394 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-03T22:17:01.394 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-03T22:17:01.394 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-03T22:17:01.394 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-03T22:17:01.394 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-03T22:17:01.394 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-03T22:17:01.394 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-03T22:17:01.394 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-03T22:17:01.394 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-03T22:17:01.394 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-03T22:17:01.394 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-03T22:17:01.395 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-03T22:17:01.395 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-03T22:17:01.395 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-03T22:17:01.395 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-03T22:17:01.395 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-03T22:17:01.395 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-03T22:17:01.395 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-03T22:17:01.395 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-03T22:17:01.395 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-03T22:17:01.395 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-03T22:17:01.395 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-03T22:17:01.395 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-03T22:17:01.395 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-03T22:17:01.395 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-03T22:17:01.396 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-03T22:17:01.396 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-03T22:17:01.396 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-03T22:17:01.396 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-03T22:17:01.396 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-03T22:17:01.396 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-03T22:17:01.396 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-03T22:17:01.396 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-03T22:17:01.396 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-03T22:17:01.396 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-03T22:17:01.396 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-03T22:17:01.396 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-03T22:17:01.396 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-03T22:17:01.396 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-03T22:17:01.397 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-03T22:17:01.397 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-03T22:17:01.397 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-03T22:17:01.397 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-03T22:17:01.397 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-03T22:17:01.397 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-03T22:17:01.397 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-03T22:17:01.397 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-03T22:17:01.397 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-03T22:17:01.397 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-03T22:17:01.397 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-03T22:17:01.397 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-03T22:17:01.397 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-03T22:17:01.397 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-03T22:17:01.398 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-03T22:17:01.398 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-03T22:17:01.398 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-03T22:17:01.398 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-03T22:17:01.398 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-03T22:17:01.398 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-03T22:17:01.398 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-03T22:17:01.398 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-03T22:17:01.398 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-03T22:17:01.398 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-03T22:17:01.398 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-03T22:17:01.398 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-03T22:17:01.398 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-03T22:17:01.398 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-03T22:17:01.399 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-03T22:17:01.399 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-03T22:17:01.399 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-03T22:17:01.399 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-03T22:17:01.399 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-03T22:17:01.399 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-03T22:17:01.399 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-03T22:17:01.399 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-03T22:17:01.399 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-03T22:17:01.399 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-03T22:17:01.399 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-03T22:17:01.399 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-03T22:17:01.399 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-03T22:17:01.399 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-03T22:17:01.400 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-03T22:17:01.400 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-03T22:17:01.400 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-03T22:17:01.400 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-03T22:17:01.400 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-03T22:17:01.400 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-03T22:17:01.400 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-03T22:17:01.400 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-03T22:17:01.400 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-03T22:17:01.400 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-03T22:17:01.400 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-03T22:17:01.400 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-03T22:17:01.400 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-03T22:17:01.400 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-03T22:17:01.401 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-03T22:17:01.401 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-03T22:17:01.401 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-03T22:17:01.401 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-03T22:17:01.401 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-03T22:17:01.401 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-03T22:17:01.401 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-03T22:17:01.401 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-03T22:17:01.401 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-03T22:17:01.401 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-03T22:17:01.401 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-03T22:17:01.401 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-03T22:17:01.401 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-03T22:17:01.401 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-03T22:17:01.402 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-03T22:17:01.402 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-03T22:17:01.402 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-03T22:17:01.402 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-03T22:17:01.402 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-03T22:17:01.402 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-03T22:17:01.402 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-03T22:17:01.402 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-03T22:17:01.402 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-03T22:17:01.402 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-03T22:17:01.402 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-03T22:17:01.402 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-03T22:17:01.402 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-03T22:17:01.403 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-03T22:17:01.403 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-03T22:17:01.403 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-03T22:17:01.403 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-03T22:17:01.403 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-03T22:17:01.403 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-03T22:17:01.403 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-03T22:17:01.403 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-03T22:17:01.403 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-03T22:17:01.403 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-03T22:17:01.403 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-03T22:17:01.403 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-03T22:17:01.403 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-03T22:17:01.403 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-03T22:17:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-03T22:17:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-03T22:17:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-03T22:17:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-03T22:17:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-03T22:17:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-03T22:17:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-03T22:17:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-03T22:17:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-03T22:17:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-03T22:17:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-03T22:17:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-03T22:17:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-03T22:17:01.404 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-03T22:17:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-03T22:17:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-03T22:17:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-03T22:17:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-03T22:17:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-03T22:17:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-03T22:17:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-03T22:17:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-03T22:17:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-03T22:17:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-03T22:17:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-03T22:17:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-03T22:17:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-03T22:17:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-03T22:17:01.406 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-03T22:17:01.406 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-03T22:17:01.406 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-03T22:17:01.406 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-03T22:17:01.406 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-03T22:17:01.406 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-03T22:17:01.406 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-03T22:17:01.406 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-03T22:17:01.406 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-03T22:17:01.406 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-03T22:17:01.406 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-03T22:17:01.406 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-03T22:17:01.406 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-03T22:17:01.406 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-03T22:17:01.407 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-03T22:17:01.407 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-03T22:17:01.407 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-03T22:17:01.407 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-03T22:17:01.407 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-03T22:17:01.407 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-03T22:17:01.407 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-03T22:17:01.407 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-03T22:17:01.407 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-03T22:17:01.407 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-03T22:17:01.407 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-03T22:17:01.407 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-03T22:17:01.407 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-03T22:17:01.407 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-03T22:17:01.408 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-03T22:17:01.408 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-03T22:17:01.408 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-03T22:17:01.408 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-03T22:17:01.408 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-03T22:17:01.408 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-03T22:17:01.408 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-03T22:17:01.408 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-03T22:17:01.408 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-03T22:17:01.408 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-03T22:17:01.408 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-03T22:17:01.408 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-03T22:17:01.408 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-03T22:17:01.409 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-03T22:17:01.409 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-03T22:17:01.409 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-03T22:17:01.409 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-03T22:17:01.409 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-03T22:17:01.409 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-03T22:17:01.409 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-03T22:17:01.409 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-03T22:17:01.409 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-03T22:17:01.409 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-03T22:17:01.409 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-03T22:17:01.409 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-03T22:17:01.409 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-03T22:17:01.409 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-03T22:17:01.410 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-03T22:17:01.410 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-03T22:17:01.410 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-03T22:17:01.410 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-03T22:17:01.410 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-03T22:17:01.410 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-03T22:17:01.410 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-03T22:17:01.410 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-03T22:17:01.410 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-03T22:17:01.410 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-03T22:17:01.410 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-03T22:17:01.410 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-03T22:17:01.410 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-03T22:17:01.410 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-03T22:17:01.411 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-03T22:17:01.411 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-03T22:17:01.411 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-03T22:17:01.411 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-03T22:17:01.411 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-03T22:17:01.411 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-03T22:17:01.411 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-03T22:17:01.411 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-03T22:17:01.411 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-03T22:17:01.411 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-03T22:17:01.411 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-03T22:17:01.411 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-03T22:17:01.411 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-03T22:17:01.412 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-03T22:17:01.412 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-03T22:17:01.412 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-03T22:17:01.412 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-03T22:17:01.412 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-03T22:17:01.412 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-03T22:17:01.412 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-03T22:17:01.412 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-03T22:17:01.412 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-03T22:17:01.412 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-03T22:17:01.412 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-03T22:17:01.412 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-03T22:17:01.412 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-03T22:17:01.412 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-03T22:17:01.412 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-03T22:17:01.413 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-03T22:17:01.413 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-03T22:17:01.413 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-03T22:17:01.413 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-03T22:17:01.413 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-03T22:17:01.413 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-03T22:17:01.413 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-03T22:17:01.413 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-03T22:17:01.413 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-03T22:17:01.413 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-03T22:17:01.413 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-03T22:17:01.413 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-03T22:17:01.413 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-03T22:17:01.413 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-03T22:17:01.413 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-03T22:17:01.414 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-03T22:17:01.414 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-03T22:17:01.414 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-03T22:17:01.414 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-03T22:17:01.414 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-03T22:17:01.414 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-03T22:17:01.414 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-03T22:17:01.414 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-03T22:17:01.414 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-03T22:17:01.414 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-03T22:17:01.414 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-03T22:17:01.414 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-03T22:17:01.414 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-03T22:17:01.415 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-03T22:17:01.415 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-03T22:17:01.415 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-03T22:17:01.415 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-03T22:17:01.415 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-03T22:17:01.415 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-03T22:17:01.415 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-03T22:17:01.415 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-03T22:17:01.415 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-03T22:17:01.415 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-03T22:17:01.415 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-03T22:17:01.415 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-03T22:17:01.416 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-03T22:17:01.416 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-03T22:17:01.416 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-03T22:17:01.416 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-03T22:17:01.416 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-03T22:17:01.416 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-03T22:17:01.416 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-03T22:17:01.416 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-03T22:17:01.416 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-03T22:17:01.416 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-03T22:17:01.416 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-03T22:17:01.416 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-03T22:17:01.416 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-03T22:17:01.416 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-03T22:17:01.417 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-03T22:17:01.417 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-03T22:17:01.417 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-03T22:17:01.417 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-03T22:17:01.417 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-03T22:17:01.417 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-03T22:17:01.417 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-03T22:17:01.417 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-03T22:17:01.417 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-03T22:17:01.417 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-03T22:17:01.417 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-03T22:17:01.417 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-03T22:17:01.418 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-03T22:17:01.418 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-03T22:17:01.418 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-03T22:17:01.418 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-03T22:17:01.418 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-03T22:17:01.418 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-03T22:17:01.418 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-03T22:17:01.418 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-03T22:17:01.418 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-03T22:17:01.418 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-03T22:17:01.418 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-03T22:17:01.418 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-03T22:17:01.418 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-03T22:17:01.419 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-03T22:17:01.419 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-03T22:17:01.419 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-03T22:17:01.419 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-03T22:17:01.419 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-03T22:17:01.419 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-03T22:17:01.419 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-03T22:17:01.419 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-03T22:17:01.419 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-03T22:17:01.419 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-03T22:17:01.419 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-03T22:17:01.419 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-03T22:17:01.419 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-03T22:17:01.420 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-03T22:17:01.420 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-03T22:17:01.420 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-03T22:17:01.420 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-03T22:17:01.420 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-03T22:17:01.420 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-03T22:17:01.420 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-03T22:17:01.420 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-03T22:17:01.420 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-03T22:17:01.420 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-03T22:17:01.420 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-03T22:17:01.420 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-03T22:17:01.420 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-03T22:17:01.420 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-03T22:17:01.421 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-03T22:17:01.421 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-03T22:17:01.421 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-03T22:17:01.421 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-03T22:17:01.421 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-03T22:17:01.421 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-03T22:17:01.421 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-03T22:17:01.421 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-03T22:17:01.421 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-03T22:17:01.421 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-03T22:17:01.421 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-03T22:17:01.421 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-03T22:17:01.421 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-03T22:17:01.421 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-03T22:17:01.422 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-03T22:17:01.422 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-03T22:17:01.422 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-03T22:17:01.422 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-03T22:17:01.422 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-03T22:17:01.422 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-03T22:17:01.422 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-03T22:17:01.422 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-03T22:17:01.422 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-03T22:17:01.422 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-03T22:17:01.422 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-03T22:17:01.422 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-03T22:17:01.422 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-03T22:17:01.423 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-03T22:17:01.423 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-03T22:17:01.423 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-03T22:17:01.423 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-03T22:17:01.423 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-03T22:17:01.423 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-03T22:17:01.423 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-03T22:17:01.423 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-03T22:17:01.423 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-03T22:17:01.423 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-03T22:17:01.423 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-03T22:17:01.423 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-03T22:17:01.423 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-03T22:17:01.423 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-03T22:17:01.423 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-03T22:17:01.424 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-03T22:17:01.424 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-03T22:17:01.424 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-03T22:17:01.424 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-03T22:17:01.424 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-03T22:17:01.424 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-03T22:17:01.424 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-03T22:17:01.424 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-03T22:17:01.424 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-03T22:17:01.424 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-03T22:17:01.424 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-03T22:17:01.424 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-03T22:17:01.424 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-03T22:17:01.425 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-03T22:17:01.425 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-03T22:17:01.425 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-03T22:17:01.425 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-03T22:17:01.425 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-03T22:17:01.425 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-03T22:17:01.425 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-03T22:17:01.425 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-03T22:17:01.425 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-03T22:17:01.425 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-03T22:17:01.425 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-03T22:17:01.425 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-03T22:17:01.425 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-03T22:17:01.425 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-03T22:17:01.426 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-03T22:17:01.426 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-03T22:17:01.426 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-03T22:17:01.426 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-03T22:17:01.426 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-03T22:17:01.426 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-03T22:17:01.426 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-03T22:17:01.426 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-03T22:17:01.426 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-03T22:17:01.426 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-03T22:17:01.426 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-03T22:17:01.426 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-03T22:17:01.426 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-03T22:17:01.426 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-03T22:17:01.427 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-03T22:17:01.427 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-03T22:17:01.427 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-03T22:17:01.427 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-03T22:17:01.427 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-03T22:17:01.427 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-03T22:17:01.427 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-03T22:17:01.427 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-03T22:17:01.427 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-03T22:17:01.427 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-03T22:17:01.427 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-03T22:17:01.427 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-03T22:17:01.427 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-03T22:17:01.427 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-03T22:17:01.428 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-03T22:17:01.428 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-03T22:17:01.428 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-03T22:17:01.428 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-03T22:17:01.428 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-03T22:17:01.428 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-03T22:17:01.428 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-03T22:17:01.428 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-03T22:17:01.428 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-03T22:17:01.428 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-03T22:17:01.428 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-03T22:17:01.428 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-03T22:17:01.428 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-03T22:17:01.428 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-03T22:17:01.429 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-03T22:17:01.429 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-03T22:17:01.429 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-03T22:17:01.429 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-03T22:17:01.429 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-03T22:17:01.429 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-03T22:17:01.429 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-03T22:17:01.429 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-03T22:17:01.429 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-03T22:17:01.429 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-03T22:17:01.429 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-03T22:17:01.429 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-03T22:17:01.429 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-03T22:17:01.429 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-03T22:17:01.429 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-03T22:17:01.430 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-03T22:17:01.430 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-03T22:17:01.430 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-03T22:17:01.430 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-03T22:17:01.430 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-03T22:17:01.430 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-03T22:17:01.430 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-03T22:17:01.430 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-03T22:17:01.430 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-03T22:17:01.430 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-03T22:17:01.430 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-03T22:17:01.430 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-03T22:17:01.430 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-03T22:17:01.430 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-03T22:17:01.431 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-03T22:17:01.431 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-03T22:17:01.431 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-03T22:17:01.431 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-03T22:17:01.431 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-03T22:17:01.431 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-03T22:17:01.431 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-03T22:17:01.431 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-03T22:17:01.431 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-03T22:17:01.431 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-03T22:17:01.431 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-03T22:17:01.431 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-03T22:17:01.431 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-03T22:17:01.431 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-03T22:17:01.432 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-03T22:17:01.432 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-03T22:17:01.432 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-03T22:17:01.432 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-03T22:17:01.432 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-03T22:17:01.432 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-03T22:17:01.432 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-03T22:17:01.432 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-03T22:17:01.432 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-03T22:17:01.432 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-03T22:17:01.432 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-03T22:17:01.432 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-03T22:17:01.432 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-03T22:17:01.432 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-03T22:17:01.433 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-03T22:17:01.433 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-03T22:17:01.433 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-03T22:17:01.433 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-03T22:17:01.433 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-03T22:17:01.433 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-03T22:17:01.433 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-03T22:17:01.433 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-03T22:17:01.433 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-03T22:17:01.433 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-03T22:17:01.433 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-03T22:17:01.433 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-03T22:17:01.433 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-03T22:17:01.433 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-03T22:17:01.434 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-03T22:17:01.434 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-03T22:17:01.434 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-03T22:17:01.434 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-03T22:17:01.434 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-03T22:17:01.434 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-03T22:17:01.434 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-03T22:17:01.434 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-03T22:17:01.434 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-03T22:17:01.434 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-03T22:17:01.434 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-03T22:17:01.434 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-03T22:17:01.434 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-03T22:17:01.435 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-03T22:17:01.435 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-03T22:17:01.435 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-03T22:17:01.435 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-03T22:17:01.435 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-03T22:17:01.435 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-03T22:17:01.435 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-03T22:17:01.435 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-03T22:17:01.435 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-03T22:17:01.435 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-03T22:17:01.435 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-03T22:17:01.435 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-03T22:17:01.435 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-03T22:17:01.435 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-03T22:17:01.436 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-03T22:17:01.436 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-03T22:17:01.436 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-03T22:17:01.436 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-03T22:17:01.436 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-03T22:17:01.436 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-03T22:17:01.436 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-03T22:17:01.436 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-03T22:17:01.436 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-03T22:17:01.436 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-03T22:17:01.436 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-03T22:17:01.436 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-03T22:17:01.436 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-03T22:17:01.436 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-03T22:17:01.437 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-03T22:17:01.437 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-03T22:17:01.437 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-03T22:17:01.437 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-03T22:17:01.437 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-03T22:17:01.437 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-03T22:17:01.437 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-03T22:17:01.437 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-03T22:17:01.437 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-03T22:17:01.437 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-03T22:17:01.437 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-03T22:17:01.437 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-03T22:17:01.437 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-03T22:17:01.437 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-03T22:17:01.438 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-03T22:17:01.438 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-03T22:17:01.438 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-03T22:17:01.438 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-03T22:17:01.438 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-03T22:17:01.438 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-03T22:17:01.438 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-03T22:17:01.438 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-03T22:17:01.438 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-03T22:17:01.438 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-03T22:17:01.438 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-03T22:17:01.438 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-03T22:17:01.438 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-03T22:17:01.438 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-03T22:17:01.439 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-03T22:17:01.439 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-03T22:17:01.439 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-03T22:17:01.439 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-03T22:17:01.439 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-03T22:17:01.439 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-03T22:17:01.439 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-03T22:17:01.439 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-03T22:17:01.439 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-03T22:17:01.439 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-03T22:17:01.439 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-03T22:17:01.439 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-03T22:17:01.439 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-03T22:17:01.439 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-03T22:17:01.439 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-03T22:17:01.440 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-03T22:17:01.440 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-03T22:17:01.440 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-03T22:17:01.440 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-03T22:17:01.440 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-03T22:17:01.440 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-03T22:17:01.440 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-03T22:17:01.440 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-03T22:17:01.440 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-03T22:17:01.440 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-03T22:17:01.440 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-03T22:17:01.440 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-03T22:17:01.440 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-03T22:17:01.440 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-03T22:17:01.441 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-03T22:17:01.441 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-03T22:17:01.441 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-03T22:17:01.441 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-03T22:17:01.441 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-03T22:17:01.441 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-03T22:17:01.441 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-03T22:17:01.441 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-03T22:17:01.441 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-03T22:17:01.441 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-03T22:17:01.441 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-03T22:17:01.441 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-03T22:17:01.441 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-03T22:17:01.441 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-03T22:17:01.442 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-03T22:17:01.442 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-03T22:17:01.442 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-03T22:17:01.442 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-03T22:17:01.442 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-03T22:17:01.442 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-03T22:17:01.442 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-03T22:17:01.442 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-03T22:17:01.442 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-03T22:17:01.442 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-03T22:17:01.442 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-03T22:17:01.442 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-03T22:17:01.442 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-03T22:17:01.443 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-03T22:17:01.443 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-03T22:17:01.443 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-03T22:17:01.443 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-03T22:17:01.443 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-03T22:17:01.443 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-03T22:17:01.443 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-03T22:17:01.443 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-03T22:17:01.443 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-03T22:17:01.443 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-03T22:17:01.443 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-03T22:17:01.443 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-03T22:17:01.443 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-03T22:17:01.443 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-03T22:17:01.444 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-03T22:17:01.444 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-03T22:17:01.444 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-03T22:17:01.444 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-03T22:17:01.444 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-03T22:17:01.444 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-03T22:17:01.444 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-03T22:17:01.444 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-03T22:17:01.444 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-03T22:17:01.444 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-03T22:17:01.444 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-03T22:17:01.444 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-03T22:17:01.444 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-03T22:17:01.444 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-03T22:17:01.444 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-03T22:17:01.445 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-03T22:17:01.445 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-03T22:17:01.445 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-03T22:17:01.445 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-03T22:17:01.445 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-03T22:17:01.445 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-03T22:17:01.445 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-03T22:17:01.445 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-03T22:17:01.445 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-03T22:17:01.445 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-03T22:17:01.445 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-03T22:17:01.445 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-03T22:17:01.445 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-03T22:17:01.445 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-03T22:17:01.445 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-03T22:17:01.446 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-03T22:17:01.446 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-03T22:17:01.446 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-03T22:17:01.446 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-03T22:17:01.446 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-03T22:17:01.446 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-03T22:17:01.446 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-03T22:17:01.446 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-03T22:17:01.446 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-03T22:17:01.446 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-03T22:17:01.446 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-03T22:17:01.446 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-03T22:17:01.446 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-03T22:17:01.447 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-03T22:17:01.447 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-03T22:17:01.447 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-03T22:17:01.447 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-03T22:17:01.447 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-03T22:17:01.447 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-03T22:17:01.447 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-03T22:17:01.447 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-03T22:17:01.447 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-03T22:17:01.447 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-03T22:17:01.447 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-03T22:17:01.447 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-03T22:17:01.447 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-03T22:17:01.447 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-03T22:17:01.447 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-03T22:17:01.447 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-03T22:17:01.448 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-03T22:17:01.448 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-03T22:17:01.448 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-03T22:17:01.448 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-03T22:17:01.448 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-03T22:17:01.448 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-03T22:17:01.448 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-03T22:17:01.448 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-03T22:17:01.448 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-03T22:17:01.448 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-03T22:17:01.448 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-03T22:17:01.448 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-03T22:17:01.448 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-03T22:17:01.448 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-03T22:17:01.449 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-03T22:17:01.449 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-03T22:17:01.449 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-03T22:17:01.449 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-03T22:17:01.449 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-03T22:17:01.449 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-03T22:17:01.449 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-03T22:17:01.449 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-03T22:17:01.449 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-03T22:17:01.449 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-03T22:17:01.449 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-03T22:17:01.449 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-03T22:17:01.449 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-03T22:17:01.449 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-03T22:17:01.449 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-03T22:17:01.450 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-03T22:17:01.450 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-03T22:17:01.450 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-03T22:17:01.450 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-03T22:17:01.450 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-03T22:17:01.450 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-03T22:17:01.450 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-03T22:17:01.450 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-03T22:17:01.450 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-03T22:17:01.450 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-03T22:17:01.450 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-03T22:17:01.450 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-03T22:17:01.450 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-03T22:17:01.450 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-03T22:17:01.451 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-03T22:17:01.451 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-03T22:17:01.451 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-03T22:17:01.451 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-03T22:17:01.451 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-03T22:17:01.451 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-03T22:17:01.451 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-03T22:17:01.451 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-03T22:17:01.451 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-03T22:17:01.451 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-03T22:17:01.451 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-03T22:17:01.451 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-03T22:17:01.451 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-03T22:17:01.451 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-03T22:17:01.452 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-03T22:17:01.452 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-03T22:17:01.452 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-03T22:17:01.452 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-03T22:17:01.452 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-03T22:17:01.452 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-03T22:17:01.452 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-03T22:17:01.452 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-03T22:17:01.452 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-03T22:17:01.452 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-03T22:17:01.452 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-03T22:17:01.452 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-03T22:17:01.452 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-03T22:17:01.452 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-03T22:17:01.453 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-03T22:17:01.453 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-03T22:17:01.453 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-03T22:17:01.453 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-03T22:17:01.453 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-03T22:17:01.453 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-03T22:17:01.453 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-03T22:17:01.453 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-03T22:17:01.453 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-03T22:17:01.453 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-03T22:17:01.453 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-03T22:17:01.453 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-03T22:17:01.453 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-03T22:17:01.453 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-03T22:17:01.453 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-03T22:17:01.454 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-03T22:17:01.454 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-03T22:17:01.454 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-03T22:17:01.454 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-03T22:17:01.454 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-03T22:17:01.454 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-03T22:17:01.454 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-03T22:17:01.454 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-03T22:17:01.454 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-03T22:17:01.454 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-03T22:17:01.454 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-03T22:17:01.454 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-03T22:17:01.454 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-03T22:17:01.454 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-03T22:17:01.454 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-03T22:17:01.455 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-03T22:17:01.455 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-03T22:17:01.455 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-03T22:17:01.455 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-03T22:17:01.455 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-03T22:17:01.455 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-03T22:17:01.455 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-03T22:17:01.455 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-03T22:17:01.455 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-03T22:17:01.455 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-03T22:17:01.455 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-03T22:17:01.455 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-03T22:17:01.455 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-03T22:17:01.455 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-03T22:17:01.455 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-03T22:17:01.456 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-03T22:17:01.456 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-03T22:17:01.456 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-03T22:17:01.456 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-03T22:17:01.456 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-03T22:17:01.456 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-03T22:17:01.456 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-03T22:17:01.456 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-03T22:17:01.456 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-03T22:17:01.456 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-03T22:17:01.456 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-03T22:17:01.456 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-03T22:17:01.456 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-03T22:17:01.456 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-03T22:17:01.456 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-03T22:17:01.457 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-03T22:17:01.457 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-03T22:17:01.457 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-03T22:17:01.457 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-03T22:17:01.457 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-03T22:17:01.457 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-03T22:17:01.457 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-03T22:17:01.457 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-03T22:17:01.457 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-03T22:17:01.457 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-03T22:17:01.457 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-03T22:17:01.457 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-03T22:17:01.457 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-03T22:17:01.457 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-03T22:17:01.458 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-03T22:17:01.458 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-03T22:17:01.458 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-03T22:17:01.458 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-03T22:17:01.458 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-03T22:17:01.458 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-03T22:17:01.458 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-03T22:17:01.458 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-03T22:17:01.458 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-03T22:17:01.458 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-03T22:17:01.458 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-03T22:17:01.458 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-03T22:17:01.458 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-03T22:17:01.459 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-03T22:17:01.459 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-03T22:17:01.459 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-03T22:17:01.459 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-03T22:17:01.459 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-03T22:17:01.459 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-03T22:17:01.459 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-03T22:17:01.459 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-03T22:17:01.459 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-03T22:17:01.459 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-03T22:17:01.459 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-03T22:17:01.459 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-03T22:17:01.459 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-03T22:17:01.460 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-03T22:17:01.460 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-03T22:17:01.460 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-03T22:17:01.460 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-03T22:17:01.460 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-03T22:17:01.460 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-03T22:17:01.460 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-03T22:17:01.460 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-03T22:17:01.460 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-03T22:17:01.460 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-03T22:17:01.460 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-03T22:17:01.460 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-03T22:17:01.460 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-03T22:17:01.460 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-03T22:17:01.461 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-03T22:17:01.461 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-03T22:17:01.461 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-03T22:17:01.461 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-03T22:17:01.461 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-03T22:17:01.461 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-03T22:17:01.461 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-03T22:17:01.461 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-03T22:17:01.461 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-03T22:17:01.461 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-03T22:17:01.461 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-03T22:17:01.461 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-03T22:17:01.461 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-03T22:17:01.461 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-03T22:17:01.462 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-03T22:17:01.462 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-03T22:17:01.462 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-03T22:17:01.462 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-03T22:17:01.462 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-03T22:17:01.462 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-03T22:17:01.462 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-03T22:17:01.462 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-03T22:17:01.462 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-03T22:17:01.462 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-03T22:17:01.462 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-03T22:17:01.462 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-03T22:17:01.462 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-03T22:17:01.462 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-03T22:17:01.463 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-03T22:17:01.463 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-03T22:17:01.463 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-03T22:17:01.463 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-03T22:17:01.463 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-03T22:17:01.463 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-03T22:17:01.463 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-03T22:17:01.463 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-03T22:17:01.463 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-03T22:17:01.463 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-03T22:17:01.463 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-03T22:17:01.463 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-03T22:17:01.463 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-03T22:17:01.463 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-03T22:17:01.464 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-03T22:17:01.464 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-03T22:17:01.464 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-03T22:17:01.464 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-03T22:17:01.464 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-03T22:17:01.464 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-03T22:17:01.464 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-03T22:17:01.464 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-03T22:17:01.464 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-03T22:17:01.464 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-03T22:17:01.464 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-03T22:17:01.464 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-03T22:17:01.464 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-03T22:17:01.464 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-03T22:17:01.465 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-03T22:17:01.465 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-03T22:17:01.465 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-03T22:17:01.465 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-03T22:17:01.465 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-03T22:17:01.465 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-03T22:17:01.465 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-03T22:17:01.465 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-03T22:17:01.465 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-03T22:17:01.465 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-03T22:17:01.465 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-03T22:17:01.465 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-03T22:17:01.465 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-03T22:17:01.465 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-03T22:17:01.465 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-03T22:17:01.466 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-03T22:17:01.466 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-03T22:17:01.466 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-03T22:17:01.466 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-03T22:17:01.466 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-03T22:17:01.466 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-03T22:17:01.466 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-03T22:17:01.466 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-03T22:17:01.466 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-03T22:17:01.466 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-03T22:17:01.466 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-03T22:17:01.466 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-03T22:17:01.466 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-03T22:17:01.466 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-03T22:17:01.467 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-03T22:17:01.467 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-03T22:17:01.467 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-03T22:17:01.467 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-03T22:17:01.467 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-03T22:17:01.467 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-03T22:17:01.467 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-03T22:17:01.467 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-03T22:17:01.467 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-03T22:17:01.467 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-03T22:17:01.467 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-03T22:17:01.467 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-03T22:17:01.467 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-03T22:17:01.467 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-03T22:17:01.468 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-03T22:17:01.468 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-03T22:17:01.468 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-03T22:17:01.468 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-03T22:17:01.468 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-03T22:17:01.468 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-03T22:17:01.468 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-03T22:17:01.468 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-03T22:17:01.468 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-03T22:17:01.468 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-03T22:17:01.468 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-03T22:17:01.468 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-03T22:17:01.468 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-03T22:17:01.468 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-03T22:17:01.468 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-03T22:17:01.469 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-03T22:17:01.469 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-03T22:17:01.469 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-03T22:17:01.469 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-03T22:17:01.469 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-03T22:17:01.469 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-03T22:17:01.469 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-03T22:17:01.469 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-03T22:17:01.469 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-03T22:17:01.469 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-03T22:17:01.469 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-03T22:17:01.469 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-03T22:17:01.469 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-03T22:17:01.469 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-03T22:17:01.469 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-03T22:17:01.470 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-03T22:17:01.470 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-03T22:17:01.470 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-03T22:17:01.470 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-03T22:17:01.470 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-03T22:17:01.470 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-03T22:17:01.470 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-03T22:17:01.470 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-03T22:17:01.470 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-03T22:17:01.470 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-03T22:17:01.470 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-03T22:17:01.470 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-03T22:17:01.470 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-03T22:17:01.471 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-03T22:17:01.471 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-03T22:17:01.471 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-03T22:17:01.471 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-03T22:17:01.471 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-03T22:17:01.471 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-03T22:17:01.471 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-03T22:17:01.471 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-03T22:17:01.471 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-03T22:17:01.471 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-03T22:17:01.471 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-03T22:17:01.471 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-03T22:17:01.471 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-03T22:17:01.471 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-03T22:17:01.471 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-03T22:17:01.472 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-03T22:17:01.472 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-03T22:17:01.472 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-03T22:17:01.472 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-03T22:17:01.472 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-03T22:17:01.472 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-03T22:17:01.472 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-03T22:17:01.472 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-03T22:17:01.472 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-03T22:17:01.472 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-03T22:17:01.472 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-03T22:17:01.472 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-03T22:17:01.472 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-03T22:17:01.472 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-03T22:17:01.473 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-03T22:17:01.473 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-03T22:17:01.473 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-03T22:17:01.473 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-03T22:17:01.473 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-03T22:17:01.473 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-03T22:17:01.473 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-03T22:17:01.473 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-03T22:17:01.473 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-03T22:17:01.473 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-03T22:17:01.473 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-03T22:17:01.473 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-03T22:17:01.473 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-03T22:17:01.473 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-03T22:17:01.473 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-03T22:17:01.473 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-03T22:17:01.474 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-03T22:17:01.474 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-03T22:17:01.474 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-03T22:17:01.474 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-03T22:17:01.474 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-03T22:17:01.474 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-03T22:17:01.474 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-03T22:17:01.474 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-03T22:17:01.474 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-03T22:17:01.474 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-03T22:17:01.474 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-03T22:17:01.474 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-03T22:17:01.474 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-03T22:17:01.474 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-03T22:17:01.475 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-03T22:17:01.475 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-03T22:17:01.475 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-03T22:17:01.475 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-03T22:17:01.475 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-03T22:17:01.475 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-03T22:17:01.475 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-03T22:17:01.475 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-03T22:17:01.475 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-03T22:17:01.475 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-03T22:17:01.475 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-03T22:17:01.475 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-03T22:17:01.475 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-03T22:17:01.475 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-03T22:17:01.475 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-03T22:17:01.476 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-03T22:17:01.476 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-03T22:17:01.476 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-03T22:17:01.476 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-03T22:17:01.476 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-03T22:17:01.476 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-03T22:17:01.476 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-03T22:17:01.476 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-03T22:17:01.476 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-03T22:17:01.476 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-03T22:17:01.476 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-03T22:17:01.476 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-03T22:17:01.476 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-03T22:17:01.477 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-03T22:17:01.477 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-03T22:17:01.477 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-03T22:17:01.477 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-03T22:17:01.477 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-03T22:17:01.477 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-03T22:17:01.477 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-03T22:17:01.477 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-03T22:17:01.477 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-03T22:17:01.477 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-03T22:17:01.477 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-03T22:17:01.477 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-03T22:17:01.477 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-03T22:17:01.477 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-03T22:17:01.478 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-03T22:17:01.478 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-03T22:17:01.478 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-03T22:17:01.478 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-03T22:17:01.478 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-03T22:17:01.478 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-03T22:17:01.478 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-03T22:17:01.478 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-03T22:17:01.478 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-03T22:17:01.478 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-03T22:17:01.478 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-03T22:17:01.478 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-03T22:17:01.478 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-03T22:17:01.478 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-03T22:17:01.479 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-03T22:17:01.479 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-03T22:17:01.479 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-03T22:17:01.479 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-03T22:17:01.479 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-03T22:17:01.479 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-03T22:17:01.479 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-03T22:17:01.479 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-03T22:17:01.479 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-03T22:17:01.479 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-03T22:17:01.479 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-03T22:17:01.479 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-03T22:17:01.479 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-03T22:17:01.479 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-03T22:17:01.480 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-03T22:17:01.480 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-03T22:17:01.480 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-03T22:17:01.480 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-03T22:17:01.480 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-03T22:17:01.480 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-03T22:17:01.480 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-03T22:17:01.480 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-03T22:17:01.480 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-03T22:17:01.480 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-03T22:17:01.480 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-03T22:17:01.480 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-03T22:17:01.480 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-03T22:17:01.481 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-03T22:17:01.481 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-03T22:17:01.481 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-03T22:17:01.481 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-03T22:17:01.481 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-03T22:17:01.481 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-03T22:17:01.481 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-03T22:17:01.481 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-03T22:17:01.481 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-03T22:17:01.481 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-03T22:17:01.481 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-03T22:17:01.481 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-03T22:17:01.481 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-03T22:17:01.481 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-03T22:17:01.482 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-03T22:17:01.482 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-03T22:17:01.482 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-03T22:17:01.482 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-03T22:17:01.482 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-03T22:17:01.482 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-03T22:17:01.482 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-03T22:17:01.482 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-03T22:17:01.482 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-03T22:17:01.482 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-03T22:17:01.482 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-03T22:17:01.482 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-03T22:17:01.482 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-03T22:17:01.482 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-03T22:17:01.483 INFO:teuthology.orchestra.run.smithi160.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-03T22:17:01.487 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:01.487 DEBUG:teuthology.orchestra.run.smithi160:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-03T22:17:01.509 INFO:teuthology.orchestra.run.smithi160.stdout:postinstall scriptlet (using /bin/sh): 2024-05-03T22:17:01.509 INFO:teuthology.orchestra.run.smithi160.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-03T22:17:01.509 INFO:teuthology.orchestra.run.smithi160.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-03T22:17:01.509 INFO:teuthology.orchestra.run.smithi160.stdout:fi 2024-05-03T22:17:01.510 INFO:teuthology.orchestra.run.smithi160.stdout:for file in vmlinuz System.map config; do 2024-05-03T22:17:01.510 INFO:teuthology.orchestra.run.smithi160.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-03T22:17:01.510 INFO:teuthology.orchestra.run.smithi160.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-03T22:17:01.510 INFO:teuthology.orchestra.run.smithi160.stdout: fi 2024-05-03T22:17:01.510 INFO:teuthology.orchestra.run.smithi160.stdout:done 2024-05-03T22:17:01.510 INFO:teuthology.orchestra.run.smithi160.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-03T22:17:01.510 INFO:teuthology.orchestra.run.smithi160.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-03T22:17:01.510 INFO:teuthology.orchestra.run.smithi160.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-03T22:17:01.510 INFO:teuthology.orchestra.run.smithi160.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-03T22:17:01.510 INFO:teuthology.orchestra.run.smithi160.stdout:fi 2024-05-03T22:17:01.510 INFO:teuthology.orchestra.run.smithi160.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-03T22:17:01.510 INFO:teuthology.orchestra.run.smithi160.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:01.510 INFO:teuthology.orchestra.run.smithi160.stdout:fi 2024-05-03T22:17:01.511 INFO:teuthology.orchestra.run.smithi160.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-03T22:17:01.511 INFO:teuthology.orchestra.run.smithi160.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-03T22:17:01.511 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:01.511 INFO:teuthology.orchestra.run.smithi160.stdout:fi 2024-05-03T22:17:01.512 DEBUG:teuthology.orchestra.run.smithi160:> sudo rpm -qi grub2-tools 2024-05-03T22:17:01.582 INFO:teuthology.orchestra.run.smithi160.stdout:Name : grub2-tools 2024-05-03T22:17:01.582 INFO:teuthology.orchestra.run.smithi160.stdout:Epoch : 1 2024-05-03T22:17:01.583 INFO:teuthology.orchestra.run.smithi160.stdout:Version : 2.06 2024-05-03T22:17:01.583 INFO:teuthology.orchestra.run.smithi160.stdout:Release : 68.el9 2024-05-03T22:17:01.583 INFO:teuthology.orchestra.run.smithi160.stdout:Architecture: x86_64 2024-05-03T22:17:01.583 INFO:teuthology.orchestra.run.smithi160.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-03T22:17:01.583 INFO:teuthology.orchestra.run.smithi160.stdout:Group : Unspecified 2024-05-03T22:17:01.583 INFO:teuthology.orchestra.run.smithi160.stdout:Size : 8264254 2024-05-03T22:17:01.583 INFO:teuthology.orchestra.run.smithi160.stdout:License : GPLv3+ 2024-05-03T22:17:01.583 INFO:teuthology.orchestra.run.smithi160.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-03T22:17:01.583 INFO:teuthology.orchestra.run.smithi160.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-03T22:17:01.583 INFO:teuthology.orchestra.run.smithi160.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-03T22:17:01.583 INFO:teuthology.orchestra.run.smithi160.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-03T22:17:01.583 INFO:teuthology.orchestra.run.smithi160.stdout:Packager : builder@centos.org 2024-05-03T22:17:01.583 INFO:teuthology.orchestra.run.smithi160.stdout:Vendor : CentOS 2024-05-03T22:17:01.583 INFO:teuthology.orchestra.run.smithi160.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-03T22:17:01.584 INFO:teuthology.orchestra.run.smithi160.stdout:Summary : Support tools for GRUB. 2024-05-03T22:17:01.584 INFO:teuthology.orchestra.run.smithi160.stdout:Description : 2024-05-03T22:17:01.584 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:17:01.584 INFO:teuthology.orchestra.run.smithi160.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-03T22:17:01.584 INFO:teuthology.orchestra.run.smithi160.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-03T22:17:01.584 INFO:teuthology.orchestra.run.smithi160.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-03T22:17:01.584 INFO:teuthology.orchestra.run.smithi160.stdout:hardware devices. 2024-05-03T22:17:01.584 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:17:01.584 INFO:teuthology.orchestra.run.smithi160.stdout:This subpackage provides tools for support of all platforms. 2024-05-03T22:17:01.585 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-03T22:17:01.585 INFO:teuthology.task.kernel:Updating grub on smithi160 to boot 6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:01.585 DEBUG:teuthology.orchestra.run.smithi160:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-03T22:17:02.125 INFO:teuthology.orchestra.run.smithi160.stderr:Generating grub configuration file ... 2024-05-03T22:17:03.515 INFO:teuthology.orchestra.run.smithi160.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-03T22:17:03.540 INFO:teuthology.orchestra.run.smithi160.stderr:done 2024-05-03T22:17:03.543 DEBUG:teuthology.orchestra.run.smithi160:> mktemp 2024-05-03T22:17:03.574 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.P5lMDNl3Uw 2024-05-03T22:17:03.574 DEBUG:teuthology.orchestra.run.smithi160:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.P5lMDNl3Uw 2024-05-03T22:17:03.627 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi044.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-03T22:17:03.627 DEBUG:teuthology.orchestra.run.smithi044:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-03T22:17:03.654 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.P5lMDNl3Uw 2024-05-03T22:17:03.715 INFO:teuthology.orchestra.run.smithi044.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:03.715 INFO:teuthology.orchestra.run.smithi044.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:03.716 INFO:teuthology.orchestra.run.smithi044.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:03.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-03T22:17:03.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-03T22:17:03.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-03T22:17:03.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-03T22:17:03.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-03T22:17:03.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-03T22:17:03.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-03T22:17:03.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-03T22:17:03.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-03T22:17:03.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-03T22:17:03.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-03T22:17:03.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-03T22:17:03.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-03T22:17:03.716 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-03T22:17:03.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-03T22:17:03.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-03T22:17:03.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-03T22:17:03.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-03T22:17:03.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-03T22:17:03.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-03T22:17:03.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-03T22:17:03.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-03T22:17:03.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-03T22:17:03.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-03T22:17:03.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-03T22:17:03.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-03T22:17:03.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-03T22:17:03.717 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-03T22:17:03.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-03T22:17:03.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-03T22:17:03.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-03T22:17:03.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-03T22:17:03.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-03T22:17:03.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-03T22:17:03.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-03T22:17:03.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-03T22:17:03.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-03T22:17:03.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-03T22:17:03.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-03T22:17:03.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-03T22:17:03.718 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-03T22:17:03.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-03T22:17:03.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-03T22:17:03.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-03T22:17:03.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-03T22:17:03.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-03T22:17:03.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-03T22:17:03.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-03T22:17:03.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-03T22:17:03.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-03T22:17:03.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-03T22:17:03.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-03T22:17:03.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-03T22:17:03.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-03T22:17:03.719 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-03T22:17:03.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-03T22:17:03.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-03T22:17:03.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-03T22:17:03.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-03T22:17:03.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-03T22:17:03.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-03T22:17:03.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-03T22:17:03.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-03T22:17:03.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-03T22:17:03.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-03T22:17:03.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-03T22:17:03.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-03T22:17:03.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-03T22:17:03.720 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-03T22:17:03.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-03T22:17:03.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-03T22:17:03.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-03T22:17:03.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-03T22:17:03.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-03T22:17:03.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-03T22:17:03.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-03T22:17:03.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-03T22:17:03.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-03T22:17:03.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-03T22:17:03.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-03T22:17:03.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-03T22:17:03.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-03T22:17:03.721 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-03T22:17:03.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-03T22:17:03.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-03T22:17:03.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-03T22:17:03.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-03T22:17:03.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-03T22:17:03.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-03T22:17:03.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-03T22:17:03.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-03T22:17:03.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-03T22:17:03.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-03T22:17:03.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-03T22:17:03.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-03T22:17:03.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-03T22:17:03.722 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-03T22:17:03.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-03T22:17:03.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-03T22:17:03.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-03T22:17:03.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-03T22:17:03.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-03T22:17:03.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-03T22:17:03.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-03T22:17:03.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-03T22:17:03.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-03T22:17:03.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-03T22:17:03.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-03T22:17:03.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-03T22:17:03.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-03T22:17:03.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-03T22:17:03.723 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-03T22:17:03.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-03T22:17:03.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-03T22:17:03.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-03T22:17:03.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-03T22:17:03.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-03T22:17:03.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-03T22:17:03.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-03T22:17:03.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-03T22:17:03.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-03T22:17:03.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-03T22:17:03.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-03T22:17:03.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-03T22:17:03.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-03T22:17:03.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-03T22:17:03.724 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-03T22:17:03.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-03T22:17:03.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-03T22:17:03.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-03T22:17:03.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-03T22:17:03.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-03T22:17:03.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-03T22:17:03.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-03T22:17:03.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-03T22:17:03.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-03T22:17:03.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-03T22:17:03.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-03T22:17:03.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-03T22:17:03.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-03T22:17:03.725 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-03T22:17:03.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-03T22:17:03.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-03T22:17:03.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-03T22:17:03.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-03T22:17:03.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-03T22:17:03.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-03T22:17:03.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-03T22:17:03.726 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-03T22:17:03.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-03T22:17:03.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-03T22:17:03.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-03T22:17:03.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-03T22:17:03.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-03T22:17:03.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-03T22:17:03.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-03T22:17:03.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-03T22:17:03.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-03T22:17:03.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-03T22:17:03.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-03T22:17:03.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-03T22:17:03.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-03T22:17:03.727 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-03T22:17:03.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-03T22:17:03.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-03T22:17:03.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-03T22:17:03.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-03T22:17:03.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-03T22:17:03.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-03T22:17:03.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-03T22:17:03.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-03T22:17:03.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-03T22:17:03.728 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-03T22:17:03.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-03T22:17:03.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-03T22:17:03.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-03T22:17:03.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-03T22:17:03.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-03T22:17:03.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-03T22:17:03.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-03T22:17:03.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-03T22:17:03.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-03T22:17:03.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-03T22:17:03.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-03T22:17:03.729 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-03T22:17:03.730 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-03T22:17:03.730 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-03T22:17:03.730 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-03T22:17:03.730 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-03T22:17:03.730 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-03T22:17:03.730 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-03T22:17:03.730 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-03T22:17:03.730 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-03T22:17:03.730 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-03T22:17:03.730 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-03T22:17:03.731 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-03T22:17:03.731 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-03T22:17:03.731 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-03T22:17:03.731 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-03T22:17:03.731 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-03T22:17:03.731 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-03T22:17:03.731 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-03T22:17:03.731 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-03T22:17:03.731 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-03T22:17:03.731 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-03T22:17:03.731 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-03T22:17:03.731 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-03T22:17:03.732 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-03T22:17:03.732 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-03T22:17:03.732 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-03T22:17:03.732 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-03T22:17:03.732 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-03T22:17:03.732 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-03T22:17:03.732 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-03T22:17:03.732 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-03T22:17:03.732 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-03T22:17:03.732 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-03T22:17:03.733 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-03T22:17:03.733 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-03T22:17:03.733 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-03T22:17:03.733 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-03T22:17:03.733 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-03T22:17:03.733 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-03T22:17:03.733 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-03T22:17:03.733 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-03T22:17:03.733 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-03T22:17:03.733 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-03T22:17:03.734 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-03T22:17:03.734 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-03T22:17:03.734 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-03T22:17:03.734 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-03T22:17:03.734 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-03T22:17:03.734 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-03T22:17:03.734 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-03T22:17:03.734 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-03T22:17:03.734 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-03T22:17:03.734 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-03T22:17:03.734 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-03T22:17:03.735 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-03T22:17:03.735 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-03T22:17:03.735 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-03T22:17:03.735 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-03T22:17:03.735 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-03T22:17:03.735 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-03T22:17:03.735 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-03T22:17:03.735 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-03T22:17:03.736 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-03T22:17:03.736 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-03T22:17:03.736 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-03T22:17:03.736 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-03T22:17:03.736 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-03T22:17:03.736 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-03T22:17:03.736 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-03T22:17:03.736 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-03T22:17:03.736 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-03T22:17:03.736 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-03T22:17:03.736 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-03T22:17:03.736 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-03T22:17:03.737 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-03T22:17:03.737 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-03T22:17:03.737 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-03T22:17:03.737 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-03T22:17:03.737 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-03T22:17:03.737 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-03T22:17:03.737 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-03T22:17:03.737 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-03T22:17:03.737 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-03T22:17:03.737 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-03T22:17:03.737 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-03T22:17:03.737 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-03T22:17:03.737 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-03T22:17:03.737 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-03T22:17:03.737 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-03T22:17:03.737 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-03T22:17:03.738 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-03T22:17:03.738 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-03T22:17:03.738 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-03T22:17:03.738 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-03T22:17:03.738 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-03T22:17:03.738 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-03T22:17:03.738 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-03T22:17:03.738 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-03T22:17:03.738 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-03T22:17:03.738 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-03T22:17:03.738 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-03T22:17:03.738 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-03T22:17:03.738 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-03T22:17:03.739 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-03T22:17:03.739 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-03T22:17:03.739 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-03T22:17:03.739 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-03T22:17:03.739 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-03T22:17:03.739 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-03T22:17:03.739 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-03T22:17:03.739 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-03T22:17:03.739 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-03T22:17:03.739 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-03T22:17:03.739 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-03T22:17:03.739 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-03T22:17:03.739 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-03T22:17:03.739 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-03T22:17:03.740 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-03T22:17:03.740 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-03T22:17:03.740 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-03T22:17:03.740 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-03T22:17:03.740 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-03T22:17:03.740 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-03T22:17:03.740 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-03T22:17:03.740 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-03T22:17:03.740 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-03T22:17:03.741 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-03T22:17:03.741 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-03T22:17:03.741 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-03T22:17:03.741 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-03T22:17:03.741 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-03T22:17:03.741 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-03T22:17:03.741 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-03T22:17:03.741 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-03T22:17:03.741 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-03T22:17:03.742 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-03T22:17:03.742 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-03T22:17:03.742 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-03T22:17:03.742 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-03T22:17:03.742 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-03T22:17:03.742 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-03T22:17:03.742 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-03T22:17:03.742 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-03T22:17:03.742 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-03T22:17:03.742 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-03T22:17:03.742 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-03T22:17:03.742 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-03T22:17:03.742 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-03T22:17:03.742 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-03T22:17:03.743 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-03T22:17:03.743 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-03T22:17:03.743 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-03T22:17:03.743 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-03T22:17:03.743 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-03T22:17:03.743 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-03T22:17:03.743 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-03T22:17:03.743 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-03T22:17:03.743 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-03T22:17:03.743 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-03T22:17:03.743 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-03T22:17:03.743 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-03T22:17:03.743 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-03T22:17:03.744 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-03T22:17:03.744 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-03T22:17:03.744 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-03T22:17:03.744 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-03T22:17:03.744 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-03T22:17:03.744 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-03T22:17:03.744 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-03T22:17:03.744 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-03T22:17:03.744 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-03T22:17:03.744 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-03T22:17:03.744 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-03T22:17:03.744 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-03T22:17:03.744 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-03T22:17:03.744 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-03T22:17:03.745 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-03T22:17:03.745 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-03T22:17:03.745 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-03T22:17:03.745 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-03T22:17:03.745 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-03T22:17:03.745 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-03T22:17:03.745 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-03T22:17:03.745 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-03T22:17:03.745 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-03T22:17:03.745 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-03T22:17:03.745 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-03T22:17:03.745 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-03T22:17:03.745 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-03T22:17:03.745 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-03T22:17:03.746 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-03T22:17:03.746 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-03T22:17:03.746 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-03T22:17:03.746 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-03T22:17:03.746 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-03T22:17:03.746 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-03T22:17:03.746 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-03T22:17:03.746 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-03T22:17:03.746 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-03T22:17:03.746 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-03T22:17:03.746 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-03T22:17:03.746 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-03T22:17:03.746 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-03T22:17:03.747 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-03T22:17:03.747 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-03T22:17:03.747 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-03T22:17:03.747 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-03T22:17:03.747 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-03T22:17:03.747 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-03T22:17:03.747 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-03T22:17:03.747 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-03T22:17:03.747 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-03T22:17:03.747 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-03T22:17:03.747 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-03T22:17:03.747 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-03T22:17:03.748 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-03T22:17:03.748 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-03T22:17:03.748 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-03T22:17:03.748 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-03T22:17:03.748 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-03T22:17:03.748 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-03T22:17:03.748 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-03T22:17:03.748 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-03T22:17:03.748 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-03T22:17:03.748 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-03T22:17:03.748 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-03T22:17:03.748 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-03T22:17:03.748 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-03T22:17:03.748 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-03T22:17:03.749 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-03T22:17:03.749 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-03T22:17:03.749 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-03T22:17:03.749 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-03T22:17:03.749 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-03T22:17:03.749 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-03T22:17:03.749 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-03T22:17:03.749 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-03T22:17:03.749 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-03T22:17:03.749 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-03T22:17:03.749 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-03T22:17:03.749 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-03T22:17:03.749 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-03T22:17:03.750 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-03T22:17:03.750 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-03T22:17:03.750 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-03T22:17:03.750 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-03T22:17:03.750 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-03T22:17:03.750 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-03T22:17:03.750 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-03T22:17:03.750 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-03T22:17:03.750 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-03T22:17:03.750 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-03T22:17:03.750 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-03T22:17:03.750 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-03T22:17:03.750 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-03T22:17:03.750 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-03T22:17:03.751 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-03T22:17:03.751 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-03T22:17:03.751 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-03T22:17:03.751 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-03T22:17:03.751 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-03T22:17:03.751 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-03T22:17:03.751 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-03T22:17:03.751 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-03T22:17:03.751 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-03T22:17:03.751 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-03T22:17:03.751 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-03T22:17:03.751 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-03T22:17:03.751 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-03T22:17:03.751 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-03T22:17:03.752 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-03T22:17:03.752 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-03T22:17:03.752 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-03T22:17:03.752 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-03T22:17:03.752 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-03T22:17:03.752 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-03T22:17:03.752 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-03T22:17:03.752 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-03T22:17:03.752 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-03T22:17:03.752 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-03T22:17:03.752 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-03T22:17:03.752 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-03T22:17:03.752 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-03T22:17:03.752 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-03T22:17:03.752 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-03T22:17:03.753 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-03T22:17:03.753 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-03T22:17:03.753 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-03T22:17:03.753 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-03T22:17:03.753 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-03T22:17:03.753 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-03T22:17:03.753 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-03T22:17:03.753 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-03T22:17:03.753 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-03T22:17:03.753 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-03T22:17:03.753 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-03T22:17:03.753 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-03T22:17:03.753 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-03T22:17:03.753 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-03T22:17:03.754 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-03T22:17:03.754 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-03T22:17:03.754 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-03T22:17:03.754 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-03T22:17:03.754 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-03T22:17:03.754 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-03T22:17:03.754 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-03T22:17:03.754 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-03T22:17:03.754 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-03T22:17:03.754 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-03T22:17:03.754 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-03T22:17:03.754 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-03T22:17:03.754 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-03T22:17:03.754 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-03T22:17:03.754 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-03T22:17:03.755 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-03T22:17:03.755 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-03T22:17:03.755 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-03T22:17:03.755 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-03T22:17:03.755 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-03T22:17:03.755 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-03T22:17:03.755 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-03T22:17:03.755 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-03T22:17:03.755 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-03T22:17:03.755 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-03T22:17:03.755 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-03T22:17:03.755 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-03T22:17:03.755 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-03T22:17:03.755 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-03T22:17:03.756 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-03T22:17:03.756 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-03T22:17:03.756 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-03T22:17:03.756 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-03T22:17:03.756 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-03T22:17:03.756 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-03T22:17:03.756 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-03T22:17:03.756 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-03T22:17:03.756 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-03T22:17:03.756 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-03T22:17:03.756 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-03T22:17:03.756 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-03T22:17:03.756 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-03T22:17:03.756 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-03T22:17:03.757 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-03T22:17:03.757 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-03T22:17:03.757 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-03T22:17:03.757 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-03T22:17:03.757 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-03T22:17:03.757 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-03T22:17:03.757 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-03T22:17:03.757 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-03T22:17:03.757 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-03T22:17:03.757 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-03T22:17:03.757 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-03T22:17:03.757 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-03T22:17:03.757 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-03T22:17:03.757 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-03T22:17:03.757 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-03T22:17:03.758 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-03T22:17:03.758 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-03T22:17:03.758 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-03T22:17:03.758 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-03T22:17:03.758 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-03T22:17:03.758 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-03T22:17:03.758 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-03T22:17:03.758 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-03T22:17:03.758 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-03T22:17:03.758 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-03T22:17:03.758 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-03T22:17:03.758 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-03T22:17:03.758 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-03T22:17:03.759 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-03T22:17:03.759 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-03T22:17:03.759 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-03T22:17:03.759 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-03T22:17:03.759 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-03T22:17:03.759 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-03T22:17:03.759 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-03T22:17:03.759 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-03T22:17:03.759 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-03T22:17:03.759 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-03T22:17:03.759 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-03T22:17:03.759 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-03T22:17:03.759 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-03T22:17:03.759 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-03T22:17:03.759 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-03T22:17:03.760 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-03T22:17:03.760 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-03T22:17:03.760 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-03T22:17:03.760 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-03T22:17:03.760 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-03T22:17:03.760 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-03T22:17:03.760 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-03T22:17:03.760 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-03T22:17:03.760 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-03T22:17:03.760 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-03T22:17:03.760 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-03T22:17:03.760 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-03T22:17:03.760 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-03T22:17:03.760 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-03T22:17:03.760 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-03T22:17:03.761 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-03T22:17:03.761 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-03T22:17:03.761 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-03T22:17:03.761 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-03T22:17:03.761 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-03T22:17:03.761 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-03T22:17:03.761 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-03T22:17:03.761 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-03T22:17:03.761 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-03T22:17:03.761 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-03T22:17:03.761 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-03T22:17:03.761 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-03T22:17:03.761 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-03T22:17:03.762 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-03T22:17:03.762 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-03T22:17:03.762 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-03T22:17:03.762 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-03T22:17:03.762 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-03T22:17:03.762 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-03T22:17:03.762 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-03T22:17:03.762 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-03T22:17:03.762 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-03T22:17:03.763 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-03T22:17:03.763 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-03T22:17:03.763 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-03T22:17:03.763 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-03T22:17:03.763 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-03T22:17:03.763 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-03T22:17:03.763 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-03T22:17:03.763 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-03T22:17:03.763 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-03T22:17:03.763 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-03T22:17:03.763 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-03T22:17:03.763 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-03T22:17:03.763 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-03T22:17:03.763 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-03T22:17:03.764 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-03T22:17:03.764 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-03T22:17:03.764 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-03T22:17:03.764 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-03T22:17:03.764 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-03T22:17:03.764 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-03T22:17:03.764 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-03T22:17:03.764 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-03T22:17:03.765 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-03T22:17:03.765 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-03T22:17:03.765 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-03T22:17:03.765 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-03T22:17:03.765 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-03T22:17:03.765 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-03T22:17:03.765 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-03T22:17:03.765 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-03T22:17:03.765 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-03T22:17:03.765 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-03T22:17:03.765 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-03T22:17:03.765 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-03T22:17:03.765 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-03T22:17:03.765 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-03T22:17:03.766 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-03T22:17:03.766 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-03T22:17:03.766 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-03T22:17:03.766 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-03T22:17:03.766 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-03T22:17:03.766 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-03T22:17:03.766 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-03T22:17:03.766 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-03T22:17:03.766 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-03T22:17:03.766 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-03T22:17:03.766 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-03T22:17:03.767 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-03T22:17:03.767 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-03T22:17:03.767 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-03T22:17:03.767 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-03T22:17:03.767 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-03T22:17:03.767 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-03T22:17:03.767 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-03T22:17:03.767 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-03T22:17:03.767 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-03T22:17:03.767 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-03T22:17:03.767 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-03T22:17:03.767 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-03T22:17:03.767 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-03T22:17:03.768 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-03T22:17:03.768 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-03T22:17:03.768 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-03T22:17:03.768 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-03T22:17:03.768 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-03T22:17:03.768 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-03T22:17:03.768 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-03T22:17:03.768 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-03T22:17:03.768 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-03T22:17:03.768 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-03T22:17:03.768 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-03T22:17:03.769 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-03T22:17:03.769 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-03T22:17:03.769 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-03T22:17:03.769 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-03T22:17:03.769 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-03T22:17:03.769 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-03T22:17:03.769 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-03T22:17:03.769 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-03T22:17:03.769 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-03T22:17:03.769 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-03T22:17:03.769 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-03T22:17:03.769 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-03T22:17:03.770 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-03T22:17:03.770 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-03T22:17:03.770 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-03T22:17:03.770 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-03T22:17:03.770 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-03T22:17:03.770 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-03T22:17:03.770 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-03T22:17:03.770 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-03T22:17:03.770 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-03T22:17:03.770 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-03T22:17:03.771 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-03T22:17:03.771 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-03T22:17:03.771 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-03T22:17:03.771 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-03T22:17:03.771 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-03T22:17:03.771 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-03T22:17:03.771 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-03T22:17:03.771 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-03T22:17:03.771 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-03T22:17:03.772 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-03T22:17:03.772 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-03T22:17:03.772 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-03T22:17:03.772 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-03T22:17:03.772 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-03T22:17:03.772 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-03T22:17:03.772 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-03T22:17:03.772 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-03T22:17:03.772 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-03T22:17:03.772 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-03T22:17:03.772 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-03T22:17:03.773 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-03T22:17:03.773 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-03T22:17:03.773 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-03T22:17:03.773 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-03T22:17:03.773 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-03T22:17:03.773 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-03T22:17:03.773 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-03T22:17:03.773 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-03T22:17:03.773 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-03T22:17:03.773 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-03T22:17:03.774 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-03T22:17:03.774 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-03T22:17:03.774 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-03T22:17:03.774 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-03T22:17:03.774 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-03T22:17:03.774 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-03T22:17:03.774 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-03T22:17:03.774 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-03T22:17:03.774 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-03T22:17:03.775 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-03T22:17:03.775 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-03T22:17:03.775 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-03T22:17:03.775 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-03T22:17:03.775 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-03T22:17:03.775 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-03T22:17:03.775 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-03T22:17:03.775 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-03T22:17:03.775 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-03T22:17:03.775 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-03T22:17:03.775 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-03T22:17:03.775 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-03T22:17:03.775 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-03T22:17:03.775 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-03T22:17:03.775 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-03T22:17:03.776 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-03T22:17:03.776 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-03T22:17:03.776 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-03T22:17:03.776 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-03T22:17:03.776 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-03T22:17:03.776 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-03T22:17:03.776 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-03T22:17:03.776 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-03T22:17:03.776 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-03T22:17:03.776 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-03T22:17:03.776 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-03T22:17:03.776 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-03T22:17:03.776 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-03T22:17:03.776 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-03T22:17:03.776 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-03T22:17:03.777 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-03T22:17:03.777 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-03T22:17:03.777 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-03T22:17:03.777 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-03T22:17:03.777 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-03T22:17:03.777 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-03T22:17:03.777 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-03T22:17:03.777 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-03T22:17:03.777 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-03T22:17:03.777 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-03T22:17:03.777 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-03T22:17:03.777 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-03T22:17:03.777 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-03T22:17:03.777 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-03T22:17:03.778 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-03T22:17:03.778 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-03T22:17:03.778 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-03T22:17:03.778 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-03T22:17:03.778 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-03T22:17:03.778 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-03T22:17:03.778 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-03T22:17:03.778 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-03T22:17:03.778 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-03T22:17:03.778 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-03T22:17:03.778 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-03T22:17:03.778 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-03T22:17:03.778 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-03T22:17:03.778 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-03T22:17:03.778 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-03T22:17:03.779 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-03T22:17:03.779 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-03T22:17:03.779 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-03T22:17:03.779 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-03T22:17:03.779 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-03T22:17:03.779 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-03T22:17:03.779 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-03T22:17:03.779 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-03T22:17:03.779 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-03T22:17:03.779 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-03T22:17:03.779 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-03T22:17:03.779 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-03T22:17:03.779 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-03T22:17:03.779 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-03T22:17:03.779 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-03T22:17:03.779 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-03T22:17:03.779 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-03T22:17:03.780 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-03T22:17:03.780 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-03T22:17:03.780 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-03T22:17:03.780 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-03T22:17:03.780 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-03T22:17:03.780 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-03T22:17:03.780 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-03T22:17:03.780 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-03T22:17:03.780 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-03T22:17:03.780 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-03T22:17:03.780 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-03T22:17:03.780 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-03T22:17:03.780 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-03T22:17:03.780 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-03T22:17:03.781 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-03T22:17:03.781 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-03T22:17:03.781 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-03T22:17:03.781 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-03T22:17:03.781 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-03T22:17:03.781 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-03T22:17:03.781 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-03T22:17:03.781 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-03T22:17:03.781 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-03T22:17:03.781 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-03T22:17:03.781 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-03T22:17:03.781 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-03T22:17:03.781 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-03T22:17:03.781 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-03T22:17:03.781 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-03T22:17:03.781 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-03T22:17:03.782 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-03T22:17:03.782 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-03T22:17:03.782 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-03T22:17:03.782 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-03T22:17:03.782 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-03T22:17:03.782 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-03T22:17:03.782 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-03T22:17:03.782 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-03T22:17:03.782 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-03T22:17:03.782 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-03T22:17:03.782 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-03T22:17:03.782 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-03T22:17:03.782 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-03T22:17:03.782 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-03T22:17:03.783 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-03T22:17:03.783 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-03T22:17:03.783 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-03T22:17:03.783 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-03T22:17:03.783 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-03T22:17:03.783 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-03T22:17:03.783 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-03T22:17:03.783 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-03T22:17:03.783 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-03T22:17:03.783 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-03T22:17:03.783 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-03T22:17:03.783 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-03T22:17:03.783 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-03T22:17:03.784 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-03T22:17:03.784 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-03T22:17:03.784 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-03T22:17:03.784 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-03T22:17:03.784 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-03T22:17:03.784 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-03T22:17:03.784 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-03T22:17:03.784 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-03T22:17:03.784 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-03T22:17:03.784 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-03T22:17:03.784 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-03T22:17:03.784 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-03T22:17:03.784 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-03T22:17:03.785 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-03T22:17:03.785 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-03T22:17:03.785 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-03T22:17:03.785 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-03T22:17:03.785 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-03T22:17:03.785 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-03T22:17:03.785 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-03T22:17:03.785 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-03T22:17:03.785 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-03T22:17:03.785 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-03T22:17:03.785 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-03T22:17:03.785 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-03T22:17:03.785 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-03T22:17:03.785 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-03T22:17:03.785 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-03T22:17:03.786 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-03T22:17:03.786 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-03T22:17:03.786 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-03T22:17:03.786 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-03T22:17:03.786 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-03T22:17:03.786 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-03T22:17:03.786 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-03T22:17:03.786 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-03T22:17:03.786 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-03T22:17:03.786 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-03T22:17:03.786 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-03T22:17:03.786 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-03T22:17:03.786 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-03T22:17:03.786 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-03T22:17:03.787 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-03T22:17:03.787 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-03T22:17:03.787 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-03T22:17:03.787 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-03T22:17:03.787 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-03T22:17:03.787 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-03T22:17:03.787 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-03T22:17:03.787 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-03T22:17:03.787 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-03T22:17:03.787 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-03T22:17:03.787 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-03T22:17:03.787 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-03T22:17:03.787 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-03T22:17:03.787 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-03T22:17:03.788 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-03T22:17:03.788 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-03T22:17:03.788 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-03T22:17:03.788 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-03T22:17:03.788 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-03T22:17:03.788 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-03T22:17:03.788 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-03T22:17:03.788 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-03T22:17:03.788 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-03T22:17:03.788 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-03T22:17:03.788 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-03T22:17:03.788 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-03T22:17:03.788 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-03T22:17:03.788 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-03T22:17:03.789 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-03T22:17:03.789 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-03T22:17:03.789 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-03T22:17:03.789 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-03T22:17:03.789 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-03T22:17:03.789 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-03T22:17:03.789 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-03T22:17:03.789 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-03T22:17:03.789 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-03T22:17:03.789 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-03T22:17:03.789 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-03T22:17:03.789 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-03T22:17:03.789 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-03T22:17:03.789 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-03T22:17:03.790 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-03T22:17:03.790 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-03T22:17:03.790 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-03T22:17:03.790 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-03T22:17:03.790 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-03T22:17:03.790 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-03T22:17:03.790 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-03T22:17:03.790 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-03T22:17:03.790 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-03T22:17:03.790 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-03T22:17:03.790 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-03T22:17:03.790 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-03T22:17:03.790 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-03T22:17:03.790 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-03T22:17:03.790 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-03T22:17:03.791 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-03T22:17:03.791 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-03T22:17:03.791 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-03T22:17:03.791 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-03T22:17:03.791 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-03T22:17:03.791 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-03T22:17:03.791 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-03T22:17:03.791 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-03T22:17:03.791 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-03T22:17:03.791 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-03T22:17:03.791 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-03T22:17:03.791 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-03T22:17:03.791 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-03T22:17:03.791 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-03T22:17:03.792 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-03T22:17:03.792 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-03T22:17:03.792 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-03T22:17:03.792 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-03T22:17:03.792 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-03T22:17:03.792 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-03T22:17:03.792 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-03T22:17:03.792 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-03T22:17:03.792 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-03T22:17:03.792 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-03T22:17:03.792 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-03T22:17:03.792 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-03T22:17:03.792 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-03T22:17:03.792 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-03T22:17:03.792 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-03T22:17:03.793 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-03T22:17:03.793 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-03T22:17:03.793 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-03T22:17:03.793 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-03T22:17:03.793 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-03T22:17:03.793 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-03T22:17:03.793 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-03T22:17:03.793 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-03T22:17:03.793 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-03T22:17:03.793 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-03T22:17:03.793 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-03T22:17:03.793 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-03T22:17:03.793 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-03T22:17:03.793 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-03T22:17:03.794 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-03T22:17:03.794 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-03T22:17:03.794 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-03T22:17:03.794 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-03T22:17:03.794 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-03T22:17:03.794 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-03T22:17:03.794 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-03T22:17:03.794 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-03T22:17:03.795 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-03T22:17:03.795 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-03T22:17:03.795 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-03T22:17:03.795 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-03T22:17:03.795 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-03T22:17:03.795 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-03T22:17:03.795 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-03T22:17:03.795 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-03T22:17:03.795 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-03T22:17:03.795 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-03T22:17:03.795 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-03T22:17:03.795 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-03T22:17:03.795 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-03T22:17:03.795 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-03T22:17:03.796 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-03T22:17:03.796 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-03T22:17:03.796 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-03T22:17:03.796 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-03T22:17:03.796 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-03T22:17:03.796 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-03T22:17:03.796 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-03T22:17:03.796 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-03T22:17:03.796 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-03T22:17:03.796 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-03T22:17:03.796 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-03T22:17:03.797 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-03T22:17:03.797 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-03T22:17:03.797 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-03T22:17:03.797 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-03T22:17:03.797 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-03T22:17:03.797 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-03T22:17:03.797 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-03T22:17:03.797 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-03T22:17:03.797 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-03T22:17:03.797 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-03T22:17:03.797 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-03T22:17:03.797 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-03T22:17:03.797 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-03T22:17:03.797 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-03T22:17:03.797 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-03T22:17:03.798 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-03T22:17:03.798 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-03T22:17:03.798 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-03T22:17:03.798 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-03T22:17:03.798 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-03T22:17:03.798 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-03T22:17:03.798 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-03T22:17:03.798 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-03T22:17:03.798 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-03T22:17:03.802 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-03T22:17:03.802 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-03T22:17:03.802 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-03T22:17:03.802 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-03T22:17:03.802 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-03T22:17:03.802 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-03T22:17:03.802 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-03T22:17:03.802 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-03T22:17:03.802 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-03T22:17:03.802 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-03T22:17:03.802 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-03T22:17:03.802 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-03T22:17:03.802 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-03T22:17:03.803 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-03T22:17:03.803 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-03T22:17:03.803 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-03T22:17:03.803 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-03T22:17:03.803 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-03T22:17:03.803 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-03T22:17:03.803 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-03T22:17:03.803 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-03T22:17:03.803 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-03T22:17:03.803 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-03T22:17:03.803 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-03T22:17:03.804 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-03T22:17:03.804 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-03T22:17:03.804 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-03T22:17:03.804 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-03T22:17:03.804 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-03T22:17:03.804 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-03T22:17:03.804 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-03T22:17:03.804 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-03T22:17:03.804 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-03T22:17:03.804 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-03T22:17:03.804 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-03T22:17:03.804 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-03T22:17:03.805 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-03T22:17:03.805 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-03T22:17:03.805 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-03T22:17:03.805 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-03T22:17:03.805 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-03T22:17:03.805 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-03T22:17:03.805 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-03T22:17:03.805 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-03T22:17:03.805 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-03T22:17:03.806 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-03T22:17:03.806 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-03T22:17:03.806 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-03T22:17:03.806 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-03T22:17:03.806 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-03T22:17:03.806 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-03T22:17:03.806 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-03T22:17:03.806 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-03T22:17:03.807 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-03T22:17:03.807 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-03T22:17:03.807 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-03T22:17:03.807 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-03T22:17:03.807 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-03T22:17:03.807 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-03T22:17:03.807 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-03T22:17:03.807 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-03T22:17:03.808 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-03T22:17:03.808 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-03T22:17:03.808 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-03T22:17:03.808 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-03T22:17:03.808 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-03T22:17:03.808 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-03T22:17:03.808 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-03T22:17:03.808 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-03T22:17:03.808 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-03T22:17:03.808 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-03T22:17:03.808 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-03T22:17:03.808 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-03T22:17:03.809 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-03T22:17:03.809 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-03T22:17:03.809 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-03T22:17:03.809 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-03T22:17:03.809 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-03T22:17:03.809 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-03T22:17:03.809 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-03T22:17:03.809 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-03T22:17:03.809 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-03T22:17:03.809 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-03T22:17:03.809 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-03T22:17:03.809 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-03T22:17:03.809 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-03T22:17:03.809 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-03T22:17:03.810 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-03T22:17:03.810 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-03T22:17:03.810 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-03T22:17:03.810 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-03T22:17:03.810 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-03T22:17:03.810 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-03T22:17:03.810 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-03T22:17:03.810 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-03T22:17:03.810 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-03T22:17:03.810 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-03T22:17:03.810 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-03T22:17:03.810 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-03T22:17:03.810 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-03T22:17:03.810 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-03T22:17:03.811 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-03T22:17:03.811 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-03T22:17:03.811 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-03T22:17:03.811 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-03T22:17:03.811 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-03T22:17:03.811 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-03T22:17:03.811 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-03T22:17:03.811 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-03T22:17:03.811 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-03T22:17:03.811 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-03T22:17:03.811 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-03T22:17:03.811 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-03T22:17:03.811 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-03T22:17:03.811 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-03T22:17:03.812 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-03T22:17:03.812 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-03T22:17:03.812 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-03T22:17:03.812 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-03T22:17:03.812 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-03T22:17:03.812 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-03T22:17:03.812 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-03T22:17:03.812 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-03T22:17:03.812 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-03T22:17:03.812 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-03T22:17:03.812 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-03T22:17:03.812 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-03T22:17:03.812 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-03T22:17:03.812 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-03T22:17:03.813 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-03T22:17:03.813 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-03T22:17:03.813 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-03T22:17:03.813 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-03T22:17:03.813 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-03T22:17:03.813 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-03T22:17:03.813 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-03T22:17:03.813 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-03T22:17:03.813 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-03T22:17:03.813 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-03T22:17:03.813 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-03T22:17:03.813 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-03T22:17:03.813 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-03T22:17:03.813 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-03T22:17:03.813 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-03T22:17:03.813 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-03T22:17:03.813 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-03T22:17:03.814 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-03T22:17:03.814 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-03T22:17:03.814 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-03T22:17:03.814 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-03T22:17:03.814 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-03T22:17:03.814 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-03T22:17:03.814 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-03T22:17:03.814 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-03T22:17:03.814 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-03T22:17:03.814 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-03T22:17:03.814 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-03T22:17:03.814 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-03T22:17:03.814 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-03T22:17:03.814 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-03T22:17:03.815 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-03T22:17:03.815 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-03T22:17:03.815 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-03T22:17:03.815 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-03T22:17:03.815 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-03T22:17:03.815 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-03T22:17:03.815 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-03T22:17:03.815 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-03T22:17:03.815 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-03T22:17:03.815 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-03T22:17:03.815 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-03T22:17:03.815 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-03T22:17:03.816 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-03T22:17:03.816 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-03T22:17:03.816 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-03T22:17:03.816 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-03T22:17:03.816 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-03T22:17:03.816 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-03T22:17:03.816 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-03T22:17:03.816 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-03T22:17:03.816 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-03T22:17:03.816 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-03T22:17:03.816 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-03T22:17:03.816 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-03T22:17:03.816 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-03T22:17:03.816 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-03T22:17:03.817 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-03T22:17:03.817 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-03T22:17:03.817 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-03T22:17:03.817 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-03T22:17:03.817 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-03T22:17:03.817 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-03T22:17:03.817 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-03T22:17:03.817 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-03T22:17:03.817 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-03T22:17:03.817 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-03T22:17:03.817 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-03T22:17:03.817 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-03T22:17:03.817 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-03T22:17:03.817 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-03T22:17:03.818 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-03T22:17:03.818 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-03T22:17:03.818 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-03T22:17:03.818 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-03T22:17:03.818 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-03T22:17:03.818 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-03T22:17:03.818 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-03T22:17:03.818 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-03T22:17:03.818 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-03T22:17:03.818 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-03T22:17:03.818 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-03T22:17:03.818 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-03T22:17:03.818 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-03T22:17:03.819 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-03T22:17:03.819 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-03T22:17:03.819 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-03T22:17:03.819 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-03T22:17:03.819 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-03T22:17:03.819 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-03T22:17:03.819 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-03T22:17:03.819 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-03T22:17:03.819 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-03T22:17:03.819 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-03T22:17:03.819 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-03T22:17:03.819 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-03T22:17:03.819 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-03T22:17:03.819 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-03T22:17:03.819 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-03T22:17:03.820 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-03T22:17:03.820 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-03T22:17:03.820 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-03T22:17:03.820 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-03T22:17:03.820 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-03T22:17:03.820 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-03T22:17:03.820 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-03T22:17:03.820 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-03T22:17:03.820 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-03T22:17:03.820 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-03T22:17:03.820 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-03T22:17:03.820 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-03T22:17:03.820 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-03T22:17:03.820 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-03T22:17:03.821 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-03T22:17:03.821 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-03T22:17:03.821 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-03T22:17:03.821 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-03T22:17:03.821 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-03T22:17:03.821 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-03T22:17:03.821 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-03T22:17:03.821 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-03T22:17:03.821 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-03T22:17:03.821 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-03T22:17:03.821 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-03T22:17:03.821 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-03T22:17:03.821 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-03T22:17:03.821 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-03T22:17:03.822 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-03T22:17:03.822 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-03T22:17:03.822 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-03T22:17:03.822 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-03T22:17:03.822 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-03T22:17:03.822 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-03T22:17:03.822 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-03T22:17:03.822 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-03T22:17:03.822 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-03T22:17:03.822 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-03T22:17:03.822 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-03T22:17:03.822 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-03T22:17:03.822 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-03T22:17:03.822 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-03T22:17:03.823 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-03T22:17:03.823 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-03T22:17:03.823 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-03T22:17:03.823 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-03T22:17:03.823 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-03T22:17:03.823 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-03T22:17:03.823 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-03T22:17:03.823 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-03T22:17:03.823 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-03T22:17:03.823 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-03T22:17:03.823 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-03T22:17:03.823 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-03T22:17:03.823 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-03T22:17:03.823 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-03T22:17:03.823 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-03T22:17:03.823 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-03T22:17:03.824 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-03T22:17:03.824 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-03T22:17:03.824 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-03T22:17:03.824 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-03T22:17:03.824 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-03T22:17:03.824 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-03T22:17:03.824 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-03T22:17:03.824 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-03T22:17:03.824 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-03T22:17:03.824 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-03T22:17:03.824 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-03T22:17:03.824 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-03T22:17:03.824 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-03T22:17:03.824 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-03T22:17:03.824 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-03T22:17:03.824 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-03T22:17:03.825 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-03T22:17:03.825 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-03T22:17:03.825 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-03T22:17:03.825 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-03T22:17:03.825 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-03T22:17:03.825 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-03T22:17:03.825 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-03T22:17:03.825 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-03T22:17:03.825 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-03T22:17:03.825 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-03T22:17:03.825 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-03T22:17:03.825 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-03T22:17:03.825 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-03T22:17:03.825 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-03T22:17:03.825 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-03T22:17:03.826 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-03T22:17:03.826 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-03T22:17:03.826 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-03T22:17:03.826 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-03T22:17:03.826 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-03T22:17:03.826 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-03T22:17:03.826 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-03T22:17:03.826 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-03T22:17:03.826 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-03T22:17:03.826 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-03T22:17:03.826 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-03T22:17:03.826 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-03T22:17:03.826 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-03T22:17:03.826 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-03T22:17:03.827 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-03T22:17:03.827 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-03T22:17:03.827 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-03T22:17:03.827 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-03T22:17:03.827 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-03T22:17:03.827 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-03T22:17:03.827 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-03T22:17:03.827 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-03T22:17:03.827 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-03T22:17:03.827 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-03T22:17:03.827 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-03T22:17:03.827 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-03T22:17:03.827 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-03T22:17:03.827 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-03T22:17:03.828 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-03T22:17:03.828 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-03T22:17:03.828 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-03T22:17:03.828 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-03T22:17:03.828 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-03T22:17:03.828 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-03T22:17:03.828 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-03T22:17:03.828 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-03T22:17:03.828 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-03T22:17:03.828 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-03T22:17:03.828 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-03T22:17:03.828 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-03T22:17:03.828 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-03T22:17:03.828 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-03T22:17:03.829 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-03T22:17:03.829 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-03T22:17:03.829 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-03T22:17:03.829 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-03T22:17:03.829 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-03T22:17:03.829 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-03T22:17:03.829 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-03T22:17:03.829 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-03T22:17:03.829 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-03T22:17:03.829 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-03T22:17:03.829 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-03T22:17:03.829 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-03T22:17:03.829 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-03T22:17:03.829 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-03T22:17:03.829 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-03T22:17:03.830 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-03T22:17:03.830 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-03T22:17:03.830 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-03T22:17:03.830 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-03T22:17:03.830 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-03T22:17:03.830 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-03T22:17:03.830 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-03T22:17:03.830 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-03T22:17:03.830 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-03T22:17:03.830 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-03T22:17:03.830 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-03T22:17:03.830 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-03T22:17:03.830 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-03T22:17:03.831 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-03T22:17:03.831 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-03T22:17:03.831 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-03T22:17:03.831 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-03T22:17:03.831 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-03T22:17:03.831 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-03T22:17:03.831 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-03T22:17:03.831 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-03T22:17:03.831 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-03T22:17:03.831 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-03T22:17:03.831 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-03T22:17:03.831 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-03T22:17:03.831 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-03T22:17:03.831 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-03T22:17:03.832 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-03T22:17:03.832 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-03T22:17:03.832 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-03T22:17:03.832 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-03T22:17:03.832 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-03T22:17:03.832 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-03T22:17:03.832 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-03T22:17:03.832 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-03T22:17:03.832 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-03T22:17:03.832 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-03T22:17:03.832 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-03T22:17:03.832 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-03T22:17:03.832 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-03T22:17:03.832 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-03T22:17:03.833 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-03T22:17:03.833 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-03T22:17:03.833 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-03T22:17:03.833 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-03T22:17:03.833 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-03T22:17:03.833 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-03T22:17:03.833 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-03T22:17:03.833 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-03T22:17:03.833 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-03T22:17:03.833 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-03T22:17:03.833 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-03T22:17:03.833 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-03T22:17:03.833 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-03T22:17:03.834 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-03T22:17:03.834 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-03T22:17:03.834 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-03T22:17:03.834 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-03T22:17:03.834 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-03T22:17:03.834 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-03T22:17:03.834 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-03T22:17:03.834 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-03T22:17:03.835 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-03T22:17:03.835 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-03T22:17:03.835 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-03T22:17:03.835 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-03T22:17:03.835 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-03T22:17:03.835 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-03T22:17:03.835 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-03T22:17:03.835 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-03T22:17:03.835 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-03T22:17:03.835 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-03T22:17:03.835 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-03T22:17:03.835 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-03T22:17:03.835 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-03T22:17:03.835 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-03T22:17:03.836 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-03T22:17:03.836 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-03T22:17:03.836 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-03T22:17:03.836 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-03T22:17:03.836 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-03T22:17:03.836 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-03T22:17:03.836 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-03T22:17:03.836 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-03T22:17:03.836 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-03T22:17:03.837 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-03T22:17:03.837 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-03T22:17:03.837 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-03T22:17:03.837 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-03T22:17:03.837 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-03T22:17:03.837 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-03T22:17:03.837 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-03T22:17:03.837 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-03T22:17:03.837 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-03T22:17:03.837 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-03T22:17:03.837 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-03T22:17:03.837 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-03T22:17:03.837 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-03T22:17:03.838 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-03T22:17:03.838 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-03T22:17:03.838 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-03T22:17:03.838 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-03T22:17:03.838 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-03T22:17:03.838 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-03T22:17:03.838 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-03T22:17:03.838 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-03T22:17:03.838 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-03T22:17:03.838 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-03T22:17:03.838 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-03T22:17:03.838 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-03T22:17:03.839 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-03T22:17:03.839 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-03T22:17:03.839 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-03T22:17:03.839 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-03T22:17:03.839 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-03T22:17:03.839 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-03T22:17:03.839 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-03T22:17:03.839 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-03T22:17:03.839 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-03T22:17:03.839 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-03T22:17:03.839 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-03T22:17:03.839 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-03T22:17:03.840 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-03T22:17:03.840 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-03T22:17:03.840 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-03T22:17:03.840 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-03T22:17:03.840 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-03T22:17:03.840 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-03T22:17:03.840 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-03T22:17:03.840 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-03T22:17:03.840 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-03T22:17:03.840 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-03T22:17:03.841 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-03T22:17:03.841 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-03T22:17:03.841 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-03T22:17:03.841 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-03T22:17:03.841 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-03T22:17:03.841 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-03T22:17:03.841 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-03T22:17:03.841 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-03T22:17:03.841 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-03T22:17:03.841 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-03T22:17:03.841 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-03T22:17:03.841 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-03T22:17:03.841 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-03T22:17:03.841 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-03T22:17:03.842 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-03T22:17:03.842 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-03T22:17:03.842 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-03T22:17:03.842 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-03T22:17:03.842 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-03T22:17:03.842 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-03T22:17:03.842 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-03T22:17:03.842 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-03T22:17:03.842 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-03T22:17:03.842 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-03T22:17:03.843 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-03T22:17:03.843 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-03T22:17:03.843 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-03T22:17:03.843 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-03T22:17:03.843 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-03T22:17:03.843 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-03T22:17:03.843 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-03T22:17:03.843 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-03T22:17:03.843 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-03T22:17:03.843 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-03T22:17:03.843 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-03T22:17:03.844 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-03T22:17:03.844 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-03T22:17:03.844 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-03T22:17:03.844 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-03T22:17:03.844 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-03T22:17:03.844 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-03T22:17:03.844 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-03T22:17:03.844 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-03T22:17:03.844 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-03T22:17:03.845 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-03T22:17:03.845 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-03T22:17:03.845 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-03T22:17:03.845 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-03T22:17:03.845 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-03T22:17:03.845 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-03T22:17:03.845 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-03T22:17:03.845 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-03T22:17:03.845 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-03T22:17:03.845 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-03T22:17:03.845 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-03T22:17:03.846 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-03T22:17:03.846 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-03T22:17:03.846 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-03T22:17:03.846 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-03T22:17:03.846 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-03T22:17:03.846 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-03T22:17:03.846 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-03T22:17:03.846 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-03T22:17:03.846 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-03T22:17:03.846 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-03T22:17:03.847 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-03T22:17:03.847 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-03T22:17:03.847 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-03T22:17:03.847 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-03T22:17:03.847 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-03T22:17:03.847 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-03T22:17:03.847 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-03T22:17:03.847 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-03T22:17:03.847 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-03T22:17:03.847 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-03T22:17:03.847 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-03T22:17:03.847 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-03T22:17:03.847 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-03T22:17:03.848 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-03T22:17:03.848 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-03T22:17:03.848 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-03T22:17:03.848 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-03T22:17:03.848 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-03T22:17:03.848 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-03T22:17:03.848 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-03T22:17:03.848 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-03T22:17:03.848 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-03T22:17:03.848 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-03T22:17:03.848 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-03T22:17:03.848 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-03T22:17:03.848 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-03T22:17:03.848 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-03T22:17:03.848 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-03T22:17:03.849 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-03T22:17:03.849 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-03T22:17:03.849 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-03T22:17:03.849 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-03T22:17:03.849 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-03T22:17:03.849 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-03T22:17:03.849 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-03T22:17:03.849 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-03T22:17:03.849 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-03T22:17:03.849 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-03T22:17:03.849 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-03T22:17:03.849 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-03T22:17:03.849 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-03T22:17:03.849 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-03T22:17:03.850 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-03T22:17:03.850 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-03T22:17:03.850 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-03T22:17:03.850 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-03T22:17:03.850 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-03T22:17:03.850 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-03T22:17:03.850 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-03T22:17:03.850 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-03T22:17:03.850 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-03T22:17:03.850 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-03T22:17:03.850 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-03T22:17:03.850 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-03T22:17:03.850 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-03T22:17:03.851 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-03T22:17:03.851 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-03T22:17:03.851 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-03T22:17:03.851 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-03T22:17:03.851 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-03T22:17:03.851 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-03T22:17:03.851 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-03T22:17:03.851 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-03T22:17:03.851 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-03T22:17:03.851 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-03T22:17:03.851 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-03T22:17:03.851 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-03T22:17:03.851 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-03T22:17:03.852 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-03T22:17:03.852 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-03T22:17:03.852 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-03T22:17:03.852 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-03T22:17:03.852 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-03T22:17:03.852 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-03T22:17:03.852 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-03T22:17:03.852 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-03T22:17:03.852 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-03T22:17:03.852 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-03T22:17:03.852 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-03T22:17:03.852 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-03T22:17:03.853 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-03T22:17:03.853 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-03T22:17:03.853 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-03T22:17:03.853 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-03T22:17:03.853 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-03T22:17:03.853 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-03T22:17:03.853 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-03T22:17:03.853 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-03T22:17:03.853 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-03T22:17:03.853 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-03T22:17:03.853 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-03T22:17:03.853 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-03T22:17:03.854 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-03T22:17:03.854 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-03T22:17:03.854 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-03T22:17:03.854 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-03T22:17:03.854 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-03T22:17:03.854 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-03T22:17:03.854 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-03T22:17:03.854 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-03T22:17:03.854 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-03T22:17:03.854 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-03T22:17:03.854 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-03T22:17:03.854 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-03T22:17:03.854 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-03T22:17:03.854 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-03T22:17:03.855 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-03T22:17:03.855 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-03T22:17:03.855 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-03T22:17:03.855 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-03T22:17:03.855 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-03T22:17:03.855 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-03T22:17:03.855 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-03T22:17:03.855 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-03T22:17:03.855 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-03T22:17:03.855 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-03T22:17:03.855 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-03T22:17:03.855 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-03T22:17:03.855 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-03T22:17:03.855 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-03T22:17:03.856 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-03T22:17:03.856 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-03T22:17:03.856 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-03T22:17:03.856 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-03T22:17:03.856 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-03T22:17:03.856 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-03T22:17:03.856 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-03T22:17:03.856 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-03T22:17:03.856 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-03T22:17:03.856 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-03T22:17:03.856 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-03T22:17:03.856 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-03T22:17:03.856 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-03T22:17:03.856 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-03T22:17:03.857 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-03T22:17:03.857 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-03T22:17:03.857 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-03T22:17:03.857 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-03T22:17:03.857 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-03T22:17:03.857 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-03T22:17:03.857 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-03T22:17:03.857 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-03T22:17:03.857 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-03T22:17:03.857 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-03T22:17:03.857 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-03T22:17:03.857 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-03T22:17:03.857 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-03T22:17:03.857 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-03T22:17:03.858 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-03T22:17:03.858 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-03T22:17:03.858 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-03T22:17:03.858 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-03T22:17:03.858 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-03T22:17:03.858 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-03T22:17:03.858 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-03T22:17:03.858 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-03T22:17:03.858 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-03T22:17:03.858 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-03T22:17:03.858 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-03T22:17:03.858 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-03T22:17:03.858 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-03T22:17:03.859 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-03T22:17:03.859 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-03T22:17:03.859 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-03T22:17:03.859 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-03T22:17:03.859 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-03T22:17:03.859 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-03T22:17:03.859 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-03T22:17:03.859 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-03T22:17:03.859 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-03T22:17:03.859 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-03T22:17:03.859 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-03T22:17:03.859 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-03T22:17:03.859 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-03T22:17:03.859 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-03T22:17:03.860 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-03T22:17:03.860 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-03T22:17:03.860 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-03T22:17:03.860 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-03T22:17:03.860 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-03T22:17:03.860 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-03T22:17:03.860 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-03T22:17:03.860 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-03T22:17:03.860 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-03T22:17:03.860 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-03T22:17:03.860 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-03T22:17:03.860 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-03T22:17:03.860 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-03T22:17:03.860 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-03T22:17:03.860 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-03T22:17:03.861 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-03T22:17:03.861 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-03T22:17:03.861 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-03T22:17:03.861 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-03T22:17:03.861 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-03T22:17:03.861 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-03T22:17:03.861 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-03T22:17:03.861 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-03T22:17:03.861 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-03T22:17:03.861 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-03T22:17:03.861 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-03T22:17:03.861 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-03T22:17:03.861 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-03T22:17:03.862 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-03T22:17:03.862 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-03T22:17:03.862 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-03T22:17:03.862 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-03T22:17:03.862 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-03T22:17:03.862 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-03T22:17:03.862 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-03T22:17:03.862 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-03T22:17:03.862 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-03T22:17:03.862 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-03T22:17:03.862 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-03T22:17:03.862 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-03T22:17:03.862 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-03T22:17:03.862 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-03T22:17:03.863 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-03T22:17:03.863 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-03T22:17:03.863 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-03T22:17:03.863 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-03T22:17:03.863 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-03T22:17:03.863 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-03T22:17:03.863 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-03T22:17:03.863 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-03T22:17:03.863 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-03T22:17:03.863 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-03T22:17:03.863 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-03T22:17:03.863 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-03T22:17:03.863 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-03T22:17:03.863 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-03T22:17:03.864 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-03T22:17:03.864 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-03T22:17:03.864 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-03T22:17:03.864 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-03T22:17:03.864 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-03T22:17:03.864 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-03T22:17:03.864 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-03T22:17:03.864 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-03T22:17:03.864 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-03T22:17:03.864 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-03T22:17:03.864 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-03T22:17:03.864 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-03T22:17:03.864 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-03T22:17:03.864 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-03T22:17:03.865 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-03T22:17:03.865 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-03T22:17:03.865 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-03T22:17:03.865 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-03T22:17:03.865 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-03T22:17:03.865 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-03T22:17:03.865 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-03T22:17:03.865 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-03T22:17:03.865 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-03T22:17:03.865 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-03T22:17:03.865 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-03T22:17:03.865 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-03T22:17:03.865 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-03T22:17:03.866 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-03T22:17:03.866 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-03T22:17:03.866 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-03T22:17:03.866 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-03T22:17:03.866 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-03T22:17:03.866 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-03T22:17:03.866 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-03T22:17:03.866 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-03T22:17:03.866 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-03T22:17:03.866 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-03T22:17:03.866 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-03T22:17:03.866 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-03T22:17:03.866 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-03T22:17:03.866 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-03T22:17:03.866 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-03T22:17:03.867 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-03T22:17:03.867 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-03T22:17:03.867 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-03T22:17:03.867 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-03T22:17:03.867 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-03T22:17:03.867 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-03T22:17:03.867 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-03T22:17:03.867 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-03T22:17:03.867 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-03T22:17:03.867 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-03T22:17:03.867 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-03T22:17:03.867 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-03T22:17:03.868 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-03T22:17:03.868 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-03T22:17:03.868 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-03T22:17:03.868 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-03T22:17:03.868 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-03T22:17:03.868 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-03T22:17:03.868 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-03T22:17:03.868 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-03T22:17:03.868 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-03T22:17:03.868 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-03T22:17:03.868 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-03T22:17:03.868 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-03T22:17:03.869 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-03T22:17:03.869 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-03T22:17:03.869 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-03T22:17:03.869 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-03T22:17:03.869 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-03T22:17:03.869 INFO:teuthology.orchestra.run.smithi044.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-03T22:17:03.873 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:03.873 DEBUG:teuthology.orchestra.run.smithi044:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-03T22:17:03.898 INFO:teuthology.orchestra.run.smithi044.stdout:postinstall scriptlet (using /bin/sh): 2024-05-03T22:17:03.898 INFO:teuthology.orchestra.run.smithi044.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-03T22:17:03.898 INFO:teuthology.orchestra.run.smithi044.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-03T22:17:03.898 INFO:teuthology.orchestra.run.smithi044.stdout:fi 2024-05-03T22:17:03.898 INFO:teuthology.orchestra.run.smithi044.stdout:for file in vmlinuz System.map config; do 2024-05-03T22:17:03.898 INFO:teuthology.orchestra.run.smithi044.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-03T22:17:03.898 INFO:teuthology.orchestra.run.smithi044.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-03T22:17:03.898 INFO:teuthology.orchestra.run.smithi044.stdout: fi 2024-05-03T22:17:03.898 INFO:teuthology.orchestra.run.smithi044.stdout:done 2024-05-03T22:17:03.899 INFO:teuthology.orchestra.run.smithi044.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-03T22:17:03.899 INFO:teuthology.orchestra.run.smithi044.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-03T22:17:03.899 INFO:teuthology.orchestra.run.smithi044.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-03T22:17:03.899 INFO:teuthology.orchestra.run.smithi044.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-03T22:17:03.899 INFO:teuthology.orchestra.run.smithi044.stdout:fi 2024-05-03T22:17:03.899 INFO:teuthology.orchestra.run.smithi044.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-03T22:17:03.899 INFO:teuthology.orchestra.run.smithi044.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:03.899 INFO:teuthology.orchestra.run.smithi044.stdout:fi 2024-05-03T22:17:03.899 INFO:teuthology.orchestra.run.smithi044.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-03T22:17:03.899 INFO:teuthology.orchestra.run.smithi044.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-03T22:17:03.899 INFO:teuthology.orchestra.run.smithi044.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:03.899 INFO:teuthology.orchestra.run.smithi044.stdout:fi 2024-05-03T22:17:03.900 DEBUG:teuthology.orchestra.run.smithi044:> sudo rpm -qi grub2-tools 2024-05-03T22:17:03.946 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.P5lMDNl3Uw is 6KB 2024-05-03T22:17:03.975 INFO:teuthology.orchestra.run.smithi044.stdout:Name : grub2-tools 2024-05-03T22:17:03.975 INFO:teuthology.orchestra.run.smithi044.stdout:Epoch : 1 2024-05-03T22:17:03.975 INFO:teuthology.orchestra.run.smithi044.stdout:Version : 2.06 2024-05-03T22:17:03.975 INFO:teuthology.orchestra.run.smithi044.stdout:Release : 68.el9 2024-05-03T22:17:03.975 INFO:teuthology.orchestra.run.smithi044.stdout:Architecture: x86_64 2024-05-03T22:17:03.975 INFO:teuthology.orchestra.run.smithi044.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-03T22:17:03.975 INFO:teuthology.orchestra.run.smithi044.stdout:Group : Unspecified 2024-05-03T22:17:03.975 INFO:teuthology.orchestra.run.smithi044.stdout:Size : 8264254 2024-05-03T22:17:03.975 INFO:teuthology.orchestra.run.smithi044.stdout:License : GPLv3+ 2024-05-03T22:17:03.975 INFO:teuthology.orchestra.run.smithi044.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-03T22:17:03.975 INFO:teuthology.orchestra.run.smithi044.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-03T22:17:03.976 INFO:teuthology.orchestra.run.smithi044.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-03T22:17:03.976 INFO:teuthology.orchestra.run.smithi044.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-03T22:17:03.976 INFO:teuthology.orchestra.run.smithi044.stdout:Packager : builder@centos.org 2024-05-03T22:17:03.976 INFO:teuthology.orchestra.run.smithi044.stdout:Vendor : CentOS 2024-05-03T22:17:03.976 INFO:teuthology.orchestra.run.smithi044.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-03T22:17:03.976 INFO:teuthology.orchestra.run.smithi044.stdout:Summary : Support tools for GRUB. 2024-05-03T22:17:03.976 INFO:teuthology.orchestra.run.smithi044.stdout:Description : 2024-05-03T22:17:03.976 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:17:03.976 INFO:teuthology.orchestra.run.smithi044.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-03T22:17:03.976 INFO:teuthology.orchestra.run.smithi044.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-03T22:17:03.976 INFO:teuthology.orchestra.run.smithi044.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-03T22:17:03.977 INFO:teuthology.orchestra.run.smithi044.stdout:hardware devices. 2024-05-03T22:17:03.977 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:17:03.977 INFO:teuthology.orchestra.run.smithi044.stdout:This subpackage provides tools for support of all platforms. 2024-05-03T22:17:03.977 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-03T22:17:03.978 INFO:teuthology.task.kernel:Updating grub on smithi044 to boot 6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:03.978 DEBUG:teuthology.orchestra.run.smithi044:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-03T22:17:03.995 DEBUG:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.P5lMDNl3Uw 2024-05-03T22:17:04.009 DEBUG:teuthology.orchestra.run.smithi160:> sudo /bin/ls /boot/loader/entries || true 2024-05-03T22:17:04.071 INFO:teuthology.orchestra.run.smithi160.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-03T22:17:04.071 INFO:teuthology.orchestra.run.smithi160.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-03T22:17:04.071 INFO:teuthology.orchestra.run.smithi160.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-03T22:17:04.071 INFO:teuthology.orchestra.run.smithi160.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-03T22:17:04.073 DEBUG:teuthology.orchestra.run.smithi160:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:04.230 DEBUG:teuthology.orchestra.run.smithi160:> sudo shutdown -r now 2024-05-03T22:17:04.559 INFO:teuthology.orchestra.run.smithi044.stderr:Generating grub configuration file ... 2024-05-03T22:17:05.870 INFO:teuthology.orchestra.run.smithi044.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-03T22:17:05.897 INFO:teuthology.orchestra.run.smithi044.stderr:done 2024-05-03T22:17:05.899 DEBUG:teuthology.orchestra.run.smithi044:> mktemp 2024-05-03T22:17:05.925 INFO:teuthology.orchestra.run.smithi044.stdout:/tmp/tmp.cPeASrRwbC 2024-05-03T22:17:05.926 DEBUG:teuthology.orchestra.run.smithi044:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.cPeASrRwbC 2024-05-03T22:17:05.991 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0666 /tmp/tmp.cPeASrRwbC 2024-05-03T22:17:06.131 DEBUG:teuthology.orchestra.remote:smithi044:/tmp/tmp.cPeASrRwbC is 6KB 2024-05-03T22:17:06.180 DEBUG:teuthology.orchestra.run.smithi044:> rm -fr /tmp/tmp.cPeASrRwbC 2024-05-03T22:17:06.194 DEBUG:teuthology.orchestra.run.smithi044:> sudo /bin/ls /boot/loader/entries || true 2024-05-03T22:17:06.256 INFO:teuthology.orchestra.run.smithi044.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-03T22:17:06.256 INFO:teuthology.orchestra.run.smithi044.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-03T22:17:06.256 INFO:teuthology.orchestra.run.smithi044.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-03T22:17:06.256 INFO:teuthology.orchestra.run.smithi044.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-03T22:17:06.257 DEBUG:teuthology.orchestra.run.smithi044:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:06.436 DEBUG:teuthology.orchestra.run.smithi044:> sudo shutdown -r now 2024-05-03T22:17:10.444 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi060.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-03T22:17:10.444 DEBUG:teuthology.orchestra.run.smithi060:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-03T22:17:10.530 INFO:teuthology.orchestra.run.smithi060.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:10.530 INFO:teuthology.orchestra.run.smithi060.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:10.530 INFO:teuthology.orchestra.run.smithi060.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:10.530 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-03T22:17:10.530 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-03T22:17:10.530 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-03T22:17:10.530 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-03T22:17:10.530 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-03T22:17:10.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-03T22:17:10.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-03T22:17:10.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-03T22:17:10.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-03T22:17:10.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-03T22:17:10.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-03T22:17:10.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-03T22:17:10.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-03T22:17:10.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-03T22:17:10.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-03T22:17:10.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-03T22:17:10.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-03T22:17:10.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-03T22:17:10.531 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-03T22:17:10.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-03T22:17:10.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-03T22:17:10.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-03T22:17:10.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-03T22:17:10.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-03T22:17:10.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-03T22:17:10.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-03T22:17:10.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-03T22:17:10.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-03T22:17:10.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-03T22:17:10.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-03T22:17:10.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-03T22:17:10.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-03T22:17:10.532 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-03T22:17:10.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-03T22:17:10.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-03T22:17:10.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-03T22:17:10.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-03T22:17:10.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-03T22:17:10.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-03T22:17:10.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-03T22:17:10.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-03T22:17:10.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-03T22:17:10.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-03T22:17:10.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-03T22:17:10.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-03T22:17:10.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-03T22:17:10.533 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-03T22:17:10.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-03T22:17:10.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-03T22:17:10.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-03T22:17:10.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-03T22:17:10.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-03T22:17:10.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-03T22:17:10.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-03T22:17:10.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-03T22:17:10.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-03T22:17:10.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-03T22:17:10.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-03T22:17:10.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-03T22:17:10.534 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-03T22:17:10.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-03T22:17:10.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-03T22:17:10.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-03T22:17:10.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-03T22:17:10.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-03T22:17:10.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-03T22:17:10.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-03T22:17:10.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-03T22:17:10.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-03T22:17:10.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-03T22:17:10.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-03T22:17:10.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-03T22:17:10.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-03T22:17:10.535 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-03T22:17:10.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-03T22:17:10.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-03T22:17:10.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-03T22:17:10.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-03T22:17:10.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-03T22:17:10.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-03T22:17:10.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-03T22:17:10.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-03T22:17:10.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-03T22:17:10.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-03T22:17:10.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-03T22:17:10.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-03T22:17:10.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-03T22:17:10.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-03T22:17:10.536 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-03T22:17:10.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-03T22:17:10.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-03T22:17:10.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-03T22:17:10.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-03T22:17:10.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-03T22:17:10.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-03T22:17:10.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-03T22:17:10.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-03T22:17:10.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-03T22:17:10.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-03T22:17:10.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-03T22:17:10.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-03T22:17:10.537 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-03T22:17:10.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-03T22:17:10.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-03T22:17:10.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-03T22:17:10.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-03T22:17:10.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-03T22:17:10.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-03T22:17:10.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-03T22:17:10.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-03T22:17:10.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-03T22:17:10.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-03T22:17:10.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-03T22:17:10.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-03T22:17:10.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-03T22:17:10.538 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-03T22:17:10.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-03T22:17:10.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-03T22:17:10.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-03T22:17:10.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-03T22:17:10.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-03T22:17:10.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-03T22:17:10.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-03T22:17:10.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-03T22:17:10.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-03T22:17:10.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-03T22:17:10.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-03T22:17:10.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-03T22:17:10.539 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-03T22:17:10.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-03T22:17:10.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-03T22:17:10.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-03T22:17:10.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-03T22:17:10.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-03T22:17:10.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-03T22:17:10.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-03T22:17:10.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-03T22:17:10.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-03T22:17:10.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-03T22:17:10.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-03T22:17:10.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-03T22:17:10.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-03T22:17:10.540 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-03T22:17:10.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-03T22:17:10.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-03T22:17:10.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-03T22:17:10.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-03T22:17:10.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-03T22:17:10.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-03T22:17:10.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-03T22:17:10.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-03T22:17:10.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-03T22:17:10.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-03T22:17:10.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-03T22:17:10.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-03T22:17:10.541 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-03T22:17:10.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-03T22:17:10.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-03T22:17:10.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-03T22:17:10.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-03T22:17:10.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-03T22:17:10.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-03T22:17:10.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-03T22:17:10.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-03T22:17:10.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-03T22:17:10.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-03T22:17:10.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-03T22:17:10.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-03T22:17:10.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-03T22:17:10.542 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-03T22:17:10.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-03T22:17:10.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-03T22:17:10.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-03T22:17:10.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-03T22:17:10.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-03T22:17:10.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-03T22:17:10.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-03T22:17:10.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-03T22:17:10.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-03T22:17:10.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-03T22:17:10.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-03T22:17:10.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-03T22:17:10.543 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-03T22:17:10.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-03T22:17:10.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-03T22:17:10.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-03T22:17:10.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-03T22:17:10.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-03T22:17:10.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-03T22:17:10.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-03T22:17:10.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-03T22:17:10.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-03T22:17:10.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-03T22:17:10.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-03T22:17:10.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-03T22:17:10.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-03T22:17:10.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-03T22:17:10.544 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-03T22:17:10.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-03T22:17:10.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-03T22:17:10.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-03T22:17:10.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-03T22:17:10.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-03T22:17:10.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-03T22:17:10.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-03T22:17:10.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-03T22:17:10.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-03T22:17:10.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-03T22:17:10.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-03T22:17:10.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-03T22:17:10.545 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-03T22:17:10.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-03T22:17:10.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-03T22:17:10.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-03T22:17:10.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-03T22:17:10.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-03T22:17:10.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-03T22:17:10.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-03T22:17:10.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-03T22:17:10.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-03T22:17:10.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-03T22:17:10.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-03T22:17:10.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-03T22:17:10.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-03T22:17:10.546 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-03T22:17:10.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-03T22:17:10.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-03T22:17:10.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-03T22:17:10.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-03T22:17:10.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-03T22:17:10.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-03T22:17:10.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-03T22:17:10.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-03T22:17:10.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-03T22:17:10.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-03T22:17:10.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-03T22:17:10.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-03T22:17:10.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-03T22:17:10.547 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-03T22:17:10.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-03T22:17:10.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-03T22:17:10.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-03T22:17:10.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-03T22:17:10.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-03T22:17:10.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-03T22:17:10.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-03T22:17:10.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-03T22:17:10.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-03T22:17:10.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-03T22:17:10.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-03T22:17:10.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-03T22:17:10.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-03T22:17:10.548 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-03T22:17:10.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-03T22:17:10.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-03T22:17:10.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-03T22:17:10.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-03T22:17:10.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-03T22:17:10.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-03T22:17:10.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-03T22:17:10.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-03T22:17:10.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-03T22:17:10.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-03T22:17:10.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-03T22:17:10.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-03T22:17:10.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-03T22:17:10.549 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-03T22:17:10.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-03T22:17:10.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-03T22:17:10.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-03T22:17:10.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-03T22:17:10.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-03T22:17:10.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-03T22:17:10.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-03T22:17:10.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-03T22:17:10.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-03T22:17:10.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-03T22:17:10.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-03T22:17:10.550 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-03T22:17:10.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-03T22:17:10.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-03T22:17:10.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-03T22:17:10.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-03T22:17:10.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-03T22:17:10.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-03T22:17:10.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-03T22:17:10.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-03T22:17:10.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-03T22:17:10.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-03T22:17:10.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-03T22:17:10.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-03T22:17:10.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-03T22:17:10.551 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-03T22:17:10.552 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-03T22:17:10.552 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-03T22:17:10.552 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-03T22:17:10.552 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-03T22:17:10.552 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-03T22:17:10.552 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-03T22:17:10.552 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-03T22:17:10.552 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-03T22:17:10.552 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-03T22:17:10.552 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-03T22:17:10.552 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-03T22:17:10.552 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-03T22:17:10.552 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-03T22:17:10.553 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-03T22:17:10.553 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-03T22:17:10.553 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-03T22:17:10.553 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-03T22:17:10.553 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-03T22:17:10.553 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-03T22:17:10.553 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-03T22:17:10.553 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-03T22:17:10.553 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-03T22:17:10.553 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-03T22:17:10.553 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-03T22:17:10.553 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-03T22:17:10.553 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-03T22:17:10.553 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-03T22:17:10.554 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-03T22:17:10.554 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-03T22:17:10.554 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-03T22:17:10.554 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-03T22:17:10.554 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-03T22:17:10.554 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-03T22:17:10.554 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-03T22:17:10.554 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-03T22:17:10.554 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-03T22:17:10.554 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-03T22:17:10.554 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-03T22:17:10.554 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-03T22:17:10.554 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-03T22:17:10.554 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-03T22:17:10.555 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-03T22:17:10.555 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-03T22:17:10.555 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-03T22:17:10.555 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-03T22:17:10.555 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-03T22:17:10.555 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-03T22:17:10.555 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-03T22:17:10.555 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-03T22:17:10.555 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-03T22:17:10.555 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-03T22:17:10.555 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-03T22:17:10.555 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-03T22:17:10.555 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-03T22:17:10.555 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-03T22:17:10.556 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-03T22:17:10.556 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-03T22:17:10.556 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-03T22:17:10.556 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-03T22:17:10.556 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-03T22:17:10.556 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-03T22:17:10.556 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-03T22:17:10.556 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-03T22:17:10.556 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-03T22:17:10.556 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-03T22:17:10.556 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-03T22:17:10.556 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-03T22:17:10.556 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-03T22:17:10.557 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-03T22:17:10.557 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-03T22:17:10.557 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-03T22:17:10.557 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-03T22:17:10.557 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-03T22:17:10.557 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-03T22:17:10.557 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-03T22:17:10.557 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-03T22:17:10.557 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-03T22:17:10.557 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-03T22:17:10.557 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-03T22:17:10.557 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-03T22:17:10.557 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-03T22:17:10.557 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-03T22:17:10.557 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-03T22:17:10.558 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-03T22:17:10.558 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-03T22:17:10.558 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-03T22:17:10.558 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-03T22:17:10.558 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-03T22:17:10.558 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-03T22:17:10.558 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-03T22:17:10.558 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-03T22:17:10.558 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-03T22:17:10.558 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-03T22:17:10.558 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-03T22:17:10.558 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-03T22:17:10.558 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-03T22:17:10.559 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-03T22:17:10.559 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-03T22:17:10.559 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-03T22:17:10.559 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-03T22:17:10.559 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-03T22:17:10.559 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-03T22:17:10.559 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-03T22:17:10.559 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-03T22:17:10.559 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-03T22:17:10.559 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-03T22:17:10.559 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-03T22:17:10.559 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-03T22:17:10.559 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-03T22:17:10.559 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-03T22:17:10.560 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-03T22:17:10.560 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-03T22:17:10.560 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-03T22:17:10.560 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-03T22:17:10.560 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-03T22:17:10.560 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-03T22:17:10.560 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-03T22:17:10.560 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-03T22:17:10.560 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-03T22:17:10.560 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-03T22:17:10.560 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-03T22:17:10.560 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-03T22:17:10.560 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-03T22:17:10.560 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-03T22:17:10.561 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-03T22:17:10.561 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-03T22:17:10.561 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-03T22:17:10.561 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-03T22:17:10.561 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-03T22:17:10.561 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-03T22:17:10.561 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-03T22:17:10.561 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-03T22:17:10.561 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-03T22:17:10.561 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-03T22:17:10.561 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-03T22:17:10.561 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-03T22:17:10.561 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-03T22:17:10.561 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-03T22:17:10.561 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-03T22:17:10.562 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-03T22:17:10.562 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-03T22:17:10.562 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-03T22:17:10.562 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-03T22:17:10.562 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-03T22:17:10.562 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-03T22:17:10.562 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-03T22:17:10.562 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-03T22:17:10.562 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-03T22:17:10.562 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-03T22:17:10.562 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-03T22:17:10.562 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-03T22:17:10.562 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-03T22:17:10.563 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-03T22:17:10.563 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-03T22:17:10.563 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-03T22:17:10.563 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-03T22:17:10.563 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-03T22:17:10.563 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-03T22:17:10.563 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-03T22:17:10.563 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-03T22:17:10.563 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-03T22:17:10.563 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-03T22:17:10.563 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-03T22:17:10.563 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-03T22:17:10.563 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-03T22:17:10.563 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-03T22:17:10.563 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-03T22:17:10.564 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-03T22:17:10.564 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-03T22:17:10.564 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-03T22:17:10.564 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-03T22:17:10.564 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-03T22:17:10.564 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-03T22:17:10.564 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-03T22:17:10.564 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-03T22:17:10.564 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-03T22:17:10.564 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-03T22:17:10.564 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-03T22:17:10.564 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-03T22:17:10.564 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-03T22:17:10.564 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-03T22:17:10.565 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-03T22:17:10.565 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-03T22:17:10.565 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-03T22:17:10.565 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-03T22:17:10.565 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-03T22:17:10.565 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-03T22:17:10.565 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-03T22:17:10.565 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-03T22:17:10.565 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-03T22:17:10.565 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-03T22:17:10.565 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-03T22:17:10.565 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-03T22:17:10.565 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-03T22:17:10.565 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-03T22:17:10.566 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-03T22:17:10.566 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-03T22:17:10.566 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-03T22:17:10.566 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-03T22:17:10.566 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-03T22:17:10.566 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-03T22:17:10.566 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-03T22:17:10.566 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-03T22:17:10.566 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-03T22:17:10.566 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-03T22:17:10.566 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-03T22:17:10.566 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-03T22:17:10.566 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-03T22:17:10.567 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-03T22:17:10.567 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-03T22:17:10.567 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-03T22:17:10.567 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-03T22:17:10.567 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-03T22:17:10.567 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-03T22:17:10.567 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-03T22:17:10.567 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-03T22:17:10.567 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-03T22:17:10.567 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-03T22:17:10.567 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-03T22:17:10.567 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-03T22:17:10.567 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-03T22:17:10.568 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-03T22:17:10.568 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-03T22:17:10.568 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-03T22:17:10.568 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-03T22:17:10.568 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-03T22:17:10.568 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-03T22:17:10.568 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-03T22:17:10.568 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-03T22:17:10.568 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-03T22:17:10.568 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-03T22:17:10.568 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-03T22:17:10.568 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-03T22:17:10.568 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-03T22:17:10.568 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-03T22:17:10.569 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-03T22:17:10.569 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-03T22:17:10.569 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-03T22:17:10.569 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-03T22:17:10.569 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-03T22:17:10.569 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-03T22:17:10.569 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-03T22:17:10.569 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-03T22:17:10.569 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-03T22:17:10.569 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-03T22:17:10.569 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-03T22:17:10.569 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-03T22:17:10.569 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-03T22:17:10.569 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-03T22:17:10.569 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-03T22:17:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-03T22:17:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-03T22:17:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-03T22:17:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-03T22:17:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-03T22:17:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-03T22:17:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-03T22:17:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-03T22:17:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-03T22:17:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-03T22:17:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-03T22:17:10.570 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-03T22:17:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-03T22:17:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-03T22:17:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-03T22:17:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-03T22:17:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-03T22:17:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-03T22:17:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-03T22:17:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-03T22:17:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-03T22:17:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-03T22:17:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-03T22:17:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-03T22:17:10.571 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-03T22:17:10.572 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-03T22:17:10.572 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-03T22:17:10.572 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-03T22:17:10.572 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-03T22:17:10.572 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-03T22:17:10.572 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-03T22:17:10.572 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-03T22:17:10.572 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-03T22:17:10.572 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-03T22:17:10.572 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-03T22:17:10.572 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-03T22:17:10.572 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-03T22:17:10.572 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-03T22:17:10.573 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-03T22:17:10.573 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-03T22:17:10.573 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-03T22:17:10.573 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-03T22:17:10.573 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-03T22:17:10.573 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-03T22:17:10.573 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-03T22:17:10.573 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-03T22:17:10.573 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-03T22:17:10.573 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-03T22:17:10.573 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-03T22:17:10.573 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-03T22:17:10.573 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-03T22:17:10.573 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-03T22:17:10.574 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-03T22:17:10.574 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-03T22:17:10.574 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-03T22:17:10.574 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-03T22:17:10.574 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-03T22:17:10.574 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-03T22:17:10.574 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-03T22:17:10.574 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-03T22:17:10.574 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-03T22:17:10.574 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-03T22:17:10.574 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-03T22:17:10.574 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-03T22:17:10.574 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-03T22:17:10.575 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-03T22:17:10.575 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-03T22:17:10.575 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-03T22:17:10.575 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-03T22:17:10.575 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-03T22:17:10.575 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-03T22:17:10.575 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-03T22:17:10.575 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-03T22:17:10.575 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-03T22:17:10.575 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-03T22:17:10.575 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-03T22:17:10.575 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-03T22:17:10.575 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-03T22:17:10.575 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-03T22:17:10.576 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-03T22:17:10.576 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-03T22:17:10.576 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-03T22:17:10.576 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-03T22:17:10.576 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-03T22:17:10.576 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-03T22:17:10.576 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-03T22:17:10.576 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-03T22:17:10.576 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-03T22:17:10.576 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-03T22:17:10.576 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-03T22:17:10.576 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-03T22:17:10.576 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-03T22:17:10.577 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-03T22:17:10.577 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-03T22:17:10.577 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-03T22:17:10.577 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-03T22:17:10.577 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-03T22:17:10.577 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-03T22:17:10.577 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-03T22:17:10.577 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-03T22:17:10.577 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-03T22:17:10.577 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-03T22:17:10.577 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-03T22:17:10.577 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-03T22:17:10.577 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-03T22:17:10.577 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-03T22:17:10.577 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-03T22:17:10.578 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-03T22:17:10.578 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-03T22:17:10.578 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-03T22:17:10.578 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-03T22:17:10.578 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-03T22:17:10.578 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-03T22:17:10.578 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-03T22:17:10.578 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-03T22:17:10.578 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-03T22:17:10.578 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-03T22:17:10.578 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-03T22:17:10.578 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-03T22:17:10.578 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-03T22:17:10.578 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-03T22:17:10.579 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-03T22:17:10.579 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-03T22:17:10.579 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-03T22:17:10.579 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-03T22:17:10.579 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-03T22:17:10.579 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-03T22:17:10.579 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-03T22:17:10.579 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-03T22:17:10.579 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-03T22:17:10.579 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-03T22:17:10.579 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-03T22:17:10.579 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-03T22:17:10.580 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-03T22:17:10.580 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-03T22:17:10.580 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-03T22:17:10.580 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-03T22:17:10.580 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-03T22:17:10.580 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-03T22:17:10.580 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-03T22:17:10.580 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-03T22:17:10.580 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-03T22:17:10.580 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-03T22:17:10.580 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-03T22:17:10.580 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-03T22:17:10.580 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-03T22:17:10.581 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-03T22:17:10.581 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-03T22:17:10.581 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-03T22:17:10.581 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-03T22:17:10.581 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-03T22:17:10.581 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-03T22:17:10.581 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-03T22:17:10.581 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-03T22:17:10.581 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-03T22:17:10.581 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-03T22:17:10.581 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-03T22:17:10.581 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-03T22:17:10.582 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-03T22:17:10.582 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-03T22:17:10.582 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-03T22:17:10.582 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-03T22:17:10.582 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-03T22:17:10.582 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-03T22:17:10.582 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-03T22:17:10.582 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-03T22:17:10.582 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-03T22:17:10.582 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-03T22:17:10.582 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-03T22:17:10.582 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-03T22:17:10.582 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-03T22:17:10.583 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-03T22:17:10.583 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-03T22:17:10.583 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-03T22:17:10.583 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-03T22:17:10.583 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-03T22:17:10.583 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-03T22:17:10.583 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-03T22:17:10.583 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-03T22:17:10.583 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-03T22:17:10.583 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-03T22:17:10.583 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-03T22:17:10.583 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-03T22:17:10.583 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-03T22:17:10.584 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-03T22:17:10.584 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-03T22:17:10.584 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-03T22:17:10.584 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-03T22:17:10.584 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-03T22:17:10.584 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-03T22:17:10.584 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-03T22:17:10.584 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-03T22:17:10.584 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-03T22:17:10.584 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-03T22:17:10.584 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-03T22:17:10.584 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-03T22:17:10.584 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-03T22:17:10.585 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-03T22:17:10.585 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-03T22:17:10.585 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-03T22:17:10.585 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-03T22:17:10.585 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-03T22:17:10.585 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-03T22:17:10.585 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-03T22:17:10.585 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-03T22:17:10.585 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-03T22:17:10.585 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-03T22:17:10.585 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-03T22:17:10.585 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-03T22:17:10.585 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-03T22:17:10.585 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-03T22:17:10.586 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-03T22:17:10.586 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-03T22:17:10.586 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-03T22:17:10.586 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-03T22:17:10.586 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-03T22:17:10.586 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-03T22:17:10.586 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-03T22:17:10.586 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-03T22:17:10.586 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-03T22:17:10.586 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-03T22:17:10.586 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-03T22:17:10.586 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-03T22:17:10.586 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-03T22:17:10.587 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-03T22:17:10.587 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-03T22:17:10.587 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-03T22:17:10.587 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-03T22:17:10.587 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-03T22:17:10.587 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-03T22:17:10.587 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-03T22:17:10.587 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-03T22:17:10.587 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-03T22:17:10.587 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-03T22:17:10.587 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-03T22:17:10.587 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-03T22:17:10.587 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-03T22:17:10.588 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-03T22:17:10.588 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-03T22:17:10.588 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-03T22:17:10.588 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-03T22:17:10.588 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-03T22:17:10.588 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-03T22:17:10.588 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-03T22:17:10.588 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-03T22:17:10.588 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-03T22:17:10.588 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-03T22:17:10.588 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-03T22:17:10.588 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-03T22:17:10.588 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-03T22:17:10.588 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-03T22:17:10.589 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-03T22:17:10.589 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-03T22:17:10.589 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-03T22:17:10.589 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-03T22:17:10.589 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-03T22:17:10.589 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-03T22:17:10.589 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-03T22:17:10.589 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-03T22:17:10.589 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-03T22:17:10.589 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-03T22:17:10.589 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-03T22:17:10.589 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-03T22:17:10.589 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-03T22:17:10.590 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-03T22:17:10.590 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-03T22:17:10.590 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-03T22:17:10.590 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-03T22:17:10.590 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-03T22:17:10.590 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-03T22:17:10.590 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-03T22:17:10.590 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-03T22:17:10.590 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-03T22:17:10.590 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-03T22:17:10.590 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-03T22:17:10.590 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-03T22:17:10.591 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-03T22:17:10.591 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-03T22:17:10.591 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-03T22:17:10.591 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-03T22:17:10.591 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-03T22:17:10.591 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-03T22:17:10.591 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-03T22:17:10.591 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-03T22:17:10.591 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-03T22:17:10.591 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-03T22:17:10.591 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-03T22:17:10.591 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-03T22:17:10.591 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-03T22:17:10.592 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-03T22:17:10.592 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-03T22:17:10.592 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-03T22:17:10.592 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-03T22:17:10.592 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-03T22:17:10.592 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-03T22:17:10.592 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-03T22:17:10.592 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-03T22:17:10.592 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-03T22:17:10.592 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-03T22:17:10.592 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-03T22:17:10.592 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-03T22:17:10.592 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-03T22:17:10.592 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-03T22:17:10.593 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-03T22:17:10.593 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-03T22:17:10.593 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-03T22:17:10.593 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-03T22:17:10.593 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-03T22:17:10.593 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-03T22:17:10.593 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-03T22:17:10.593 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-03T22:17:10.593 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-03T22:17:10.593 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-03T22:17:10.593 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-03T22:17:10.593 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-03T22:17:10.593 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-03T22:17:10.594 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-03T22:17:10.594 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-03T22:17:10.594 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-03T22:17:10.594 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-03T22:17:10.594 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-03T22:17:10.594 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-03T22:17:10.594 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-03T22:17:10.594 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-03T22:17:10.594 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-03T22:17:10.594 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-03T22:17:10.594 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-03T22:17:10.594 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-03T22:17:10.594 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-03T22:17:10.594 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-03T22:17:10.595 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-03T22:17:10.595 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-03T22:17:10.595 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-03T22:17:10.595 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-03T22:17:10.595 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-03T22:17:10.595 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-03T22:17:10.595 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-03T22:17:10.595 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-03T22:17:10.595 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-03T22:17:10.595 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-03T22:17:10.595 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-03T22:17:10.595 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-03T22:17:10.595 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-03T22:17:10.595 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-03T22:17:10.596 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-03T22:17:10.596 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-03T22:17:10.596 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-03T22:17:10.596 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-03T22:17:10.596 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-03T22:17:10.596 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-03T22:17:10.596 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-03T22:17:10.596 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-03T22:17:10.596 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-03T22:17:10.596 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-03T22:17:10.596 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-03T22:17:10.596 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-03T22:17:10.596 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-03T22:17:10.596 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-03T22:17:10.596 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-03T22:17:10.597 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-03T22:17:10.597 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-03T22:17:10.597 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-03T22:17:10.597 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-03T22:17:10.597 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-03T22:17:10.597 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-03T22:17:10.597 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-03T22:17:10.597 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-03T22:17:10.597 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-03T22:17:10.597 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-03T22:17:10.597 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-03T22:17:10.597 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-03T22:17:10.598 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-03T22:17:10.598 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-03T22:17:10.598 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-03T22:17:10.598 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-03T22:17:10.598 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-03T22:17:10.598 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-03T22:17:10.598 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-03T22:17:10.598 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-03T22:17:10.598 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-03T22:17:10.598 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-03T22:17:10.598 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-03T22:17:10.598 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-03T22:17:10.598 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-03T22:17:10.598 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-03T22:17:10.599 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-03T22:17:10.599 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-03T22:17:10.599 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-03T22:17:10.599 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-03T22:17:10.599 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-03T22:17:10.599 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-03T22:17:10.599 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-03T22:17:10.599 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-03T22:17:10.599 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-03T22:17:10.599 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-03T22:17:10.599 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-03T22:17:10.599 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-03T22:17:10.599 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-03T22:17:10.599 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-03T22:17:10.600 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-03T22:17:10.600 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-03T22:17:10.600 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-03T22:17:10.600 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-03T22:17:10.600 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-03T22:17:10.600 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-03T22:17:10.600 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-03T22:17:10.600 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-03T22:17:10.600 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-03T22:17:10.600 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-03T22:17:10.600 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-03T22:17:10.600 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-03T22:17:10.600 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-03T22:17:10.600 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-03T22:17:10.601 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-03T22:17:10.601 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-03T22:17:10.601 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-03T22:17:10.601 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-03T22:17:10.601 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-03T22:17:10.601 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-03T22:17:10.601 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-03T22:17:10.601 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-03T22:17:10.601 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-03T22:17:10.601 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-03T22:17:10.601 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-03T22:17:10.601 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-03T22:17:10.601 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-03T22:17:10.602 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-03T22:17:10.602 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-03T22:17:10.602 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-03T22:17:10.602 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-03T22:17:10.602 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-03T22:17:10.602 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-03T22:17:10.602 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-03T22:17:10.602 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-03T22:17:10.602 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-03T22:17:10.602 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-03T22:17:10.602 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-03T22:17:10.602 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-03T22:17:10.602 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-03T22:17:10.603 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-03T22:17:10.603 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-03T22:17:10.603 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-03T22:17:10.603 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-03T22:17:10.603 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-03T22:17:10.603 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-03T22:17:10.603 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-03T22:17:10.603 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-03T22:17:10.603 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-03T22:17:10.603 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-03T22:17:10.603 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-03T22:17:10.603 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-03T22:17:10.603 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-03T22:17:10.603 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-03T22:17:10.604 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-03T22:17:10.604 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-03T22:17:10.604 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-03T22:17:10.604 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-03T22:17:10.604 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-03T22:17:10.604 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-03T22:17:10.604 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-03T22:17:10.604 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-03T22:17:10.604 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-03T22:17:10.604 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-03T22:17:10.604 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-03T22:17:10.604 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-03T22:17:10.604 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-03T22:17:10.604 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-03T22:17:10.605 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-03T22:17:10.605 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-03T22:17:10.605 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-03T22:17:10.605 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-03T22:17:10.605 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-03T22:17:10.605 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-03T22:17:10.605 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-03T22:17:10.605 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-03T22:17:10.605 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-03T22:17:10.605 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-03T22:17:10.605 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-03T22:17:10.605 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-03T22:17:10.605 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-03T22:17:10.605 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-03T22:17:10.606 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-03T22:17:10.606 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-03T22:17:10.606 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-03T22:17:10.606 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-03T22:17:10.606 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-03T22:17:10.606 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-03T22:17:10.606 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-03T22:17:10.606 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-03T22:17:10.606 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-03T22:17:10.606 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-03T22:17:10.606 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-03T22:17:10.606 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-03T22:17:10.606 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-03T22:17:10.607 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-03T22:17:10.607 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-03T22:17:10.607 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-03T22:17:10.607 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-03T22:17:10.607 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-03T22:17:10.607 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-03T22:17:10.607 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-03T22:17:10.607 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-03T22:17:10.607 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-03T22:17:10.607 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-03T22:17:10.607 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-03T22:17:10.607 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-03T22:17:10.607 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-03T22:17:10.607 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-03T22:17:10.608 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-03T22:17:10.608 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-03T22:17:10.608 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-03T22:17:10.608 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-03T22:17:10.608 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-03T22:17:10.608 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-03T22:17:10.608 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-03T22:17:10.608 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-03T22:17:10.608 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-03T22:17:10.608 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-03T22:17:10.608 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-03T22:17:10.608 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-03T22:17:10.608 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-03T22:17:10.608 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-03T22:17:10.609 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-03T22:17:10.609 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-03T22:17:10.609 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-03T22:17:10.609 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-03T22:17:10.609 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-03T22:17:10.609 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-03T22:17:10.609 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-03T22:17:10.609 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-03T22:17:10.609 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-03T22:17:10.609 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-03T22:17:10.609 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-03T22:17:10.609 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-03T22:17:10.609 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-03T22:17:10.609 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-03T22:17:10.610 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-03T22:17:10.610 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-03T22:17:10.610 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-03T22:17:10.610 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-03T22:17:10.610 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-03T22:17:10.610 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-03T22:17:10.610 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-03T22:17:10.610 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-03T22:17:10.610 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-03T22:17:10.610 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-03T22:17:10.610 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-03T22:17:10.610 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-03T22:17:10.610 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-03T22:17:10.611 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-03T22:17:10.611 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-03T22:17:10.611 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-03T22:17:10.611 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-03T22:17:10.611 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-03T22:17:10.611 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-03T22:17:10.611 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-03T22:17:10.611 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-03T22:17:10.611 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-03T22:17:10.611 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-03T22:17:10.611 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-03T22:17:10.611 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-03T22:17:10.611 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-03T22:17:10.611 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-03T22:17:10.611 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-03T22:17:10.612 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-03T22:17:10.612 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-03T22:17:10.612 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-03T22:17:10.612 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-03T22:17:10.612 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-03T22:17:10.612 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-03T22:17:10.612 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-03T22:17:10.612 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-03T22:17:10.612 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-03T22:17:10.612 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-03T22:17:10.612 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-03T22:17:10.612 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-03T22:17:10.612 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-03T22:17:10.613 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-03T22:17:10.613 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-03T22:17:10.613 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-03T22:17:10.613 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-03T22:17:10.613 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-03T22:17:10.613 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-03T22:17:10.613 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-03T22:17:10.613 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-03T22:17:10.613 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-03T22:17:10.613 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-03T22:17:10.613 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-03T22:17:10.613 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-03T22:17:10.613 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-03T22:17:10.613 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-03T22:17:10.614 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-03T22:17:10.614 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-03T22:17:10.614 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-03T22:17:10.614 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-03T22:17:10.614 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-03T22:17:10.614 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-03T22:17:10.614 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-03T22:17:10.614 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-03T22:17:10.614 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-03T22:17:10.614 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-03T22:17:10.614 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-03T22:17:10.614 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-03T22:17:10.615 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-03T22:17:10.615 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-03T22:17:10.615 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-03T22:17:10.615 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-03T22:17:10.615 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-03T22:17:10.615 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-03T22:17:10.615 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-03T22:17:10.615 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-03T22:17:10.615 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-03T22:17:10.615 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-03T22:17:10.615 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-03T22:17:10.615 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-03T22:17:10.615 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-03T22:17:10.615 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-03T22:17:10.615 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-03T22:17:10.616 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-03T22:17:10.616 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-03T22:17:10.616 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-03T22:17:10.616 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-03T22:17:10.616 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-03T22:17:10.616 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-03T22:17:10.616 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-03T22:17:10.616 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-03T22:17:10.616 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-03T22:17:10.616 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-03T22:17:10.616 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-03T22:17:10.616 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-03T22:17:10.616 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-03T22:17:10.617 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-03T22:17:10.617 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-03T22:17:10.617 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-03T22:17:10.617 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-03T22:17:10.617 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-03T22:17:10.617 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-03T22:17:10.617 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-03T22:17:10.617 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-03T22:17:10.617 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-03T22:17:10.617 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-03T22:17:10.617 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-03T22:17:10.617 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-03T22:17:10.617 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-03T22:17:10.618 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-03T22:17:10.618 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-03T22:17:10.618 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-03T22:17:10.618 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-03T22:17:10.618 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-03T22:17:10.618 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-03T22:17:10.618 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-03T22:17:10.618 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-03T22:17:10.618 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-03T22:17:10.618 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-03T22:17:10.618 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-03T22:17:10.618 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-03T22:17:10.618 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-03T22:17:10.618 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-03T22:17:10.619 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-03T22:17:10.619 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-03T22:17:10.619 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-03T22:17:10.619 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-03T22:17:10.619 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-03T22:17:10.619 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-03T22:17:10.619 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-03T22:17:10.619 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-03T22:17:10.619 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-03T22:17:10.619 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-03T22:17:10.619 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-03T22:17:10.619 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-03T22:17:10.619 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-03T22:17:10.619 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-03T22:17:10.620 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-03T22:17:10.620 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-03T22:17:10.620 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-03T22:17:10.620 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-03T22:17:10.620 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-03T22:17:10.620 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-03T22:17:10.620 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-03T22:17:10.620 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-03T22:17:10.620 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-03T22:17:10.620 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-03T22:17:10.620 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-03T22:17:10.620 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-03T22:17:10.620 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-03T22:17:10.620 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-03T22:17:10.621 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-03T22:17:10.621 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-03T22:17:10.621 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-03T22:17:10.621 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-03T22:17:10.621 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-03T22:17:10.621 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-03T22:17:10.621 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-03T22:17:10.621 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-03T22:17:10.621 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-03T22:17:10.621 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-03T22:17:10.621 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-03T22:17:10.621 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-03T22:17:10.621 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-03T22:17:10.622 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-03T22:17:10.622 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-03T22:17:10.622 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-03T22:17:10.622 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-03T22:17:10.622 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-03T22:17:10.622 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-03T22:17:10.622 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-03T22:17:10.622 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-03T22:17:10.622 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-03T22:17:10.622 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-03T22:17:10.622 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-03T22:17:10.622 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-03T22:17:10.622 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-03T22:17:10.622 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-03T22:17:10.623 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-03T22:17:10.623 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-03T22:17:10.623 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-03T22:17:10.623 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-03T22:17:10.623 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-03T22:17:10.623 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-03T22:17:10.623 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-03T22:17:10.623 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-03T22:17:10.623 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-03T22:17:10.623 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-03T22:17:10.623 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-03T22:17:10.623 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-03T22:17:10.623 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-03T22:17:10.623 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-03T22:17:10.624 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-03T22:17:10.624 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-03T22:17:10.624 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-03T22:17:10.624 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-03T22:17:10.624 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-03T22:17:10.624 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-03T22:17:10.624 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-03T22:17:10.624 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-03T22:17:10.624 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-03T22:17:10.624 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-03T22:17:10.624 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-03T22:17:10.624 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-03T22:17:10.624 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-03T22:17:10.624 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-03T22:17:10.625 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-03T22:17:10.625 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-03T22:17:10.625 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-03T22:17:10.625 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-03T22:17:10.625 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-03T22:17:10.625 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-03T22:17:10.625 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-03T22:17:10.625 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-03T22:17:10.625 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-03T22:17:10.625 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-03T22:17:10.625 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-03T22:17:10.625 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-03T22:17:10.625 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-03T22:17:10.625 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-03T22:17:10.626 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-03T22:17:10.626 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-03T22:17:10.626 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-03T22:17:10.626 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-03T22:17:10.626 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-03T22:17:10.626 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-03T22:17:10.626 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-03T22:17:10.626 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-03T22:17:10.626 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-03T22:17:10.626 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-03T22:17:10.626 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-03T22:17:10.626 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-03T22:17:10.626 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-03T22:17:10.626 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-03T22:17:10.627 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-03T22:17:10.627 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-03T22:17:10.627 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-03T22:17:10.627 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-03T22:17:10.627 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-03T22:17:10.627 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-03T22:17:10.627 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-03T22:17:10.627 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-03T22:17:10.627 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-03T22:17:10.627 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-03T22:17:10.627 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-03T22:17:10.627 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-03T22:17:10.627 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-03T22:17:10.627 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-03T22:17:10.628 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-03T22:17:10.628 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-03T22:17:10.628 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-03T22:17:10.628 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-03T22:17:10.628 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-03T22:17:10.628 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-03T22:17:10.628 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-03T22:17:10.628 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-03T22:17:10.628 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-03T22:17:10.628 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-03T22:17:10.628 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-03T22:17:10.628 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-03T22:17:10.628 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-03T22:17:10.628 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-03T22:17:10.629 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-03T22:17:10.629 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-03T22:17:10.629 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-03T22:17:10.629 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-03T22:17:10.629 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-03T22:17:10.629 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-03T22:17:10.629 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-03T22:17:10.629 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-03T22:17:10.629 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-03T22:17:10.629 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-03T22:17:10.629 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-03T22:17:10.629 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-03T22:17:10.629 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-03T22:17:10.629 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-03T22:17:10.630 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-03T22:17:10.630 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-03T22:17:10.630 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-03T22:17:10.630 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-03T22:17:10.630 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-03T22:17:10.630 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-03T22:17:10.630 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-03T22:17:10.630 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-03T22:17:10.630 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-03T22:17:10.630 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-03T22:17:10.630 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-03T22:17:10.630 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-03T22:17:10.630 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-03T22:17:10.631 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-03T22:17:10.631 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-03T22:17:10.631 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-03T22:17:10.631 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-03T22:17:10.631 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-03T22:17:10.631 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-03T22:17:10.631 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-03T22:17:10.631 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-03T22:17:10.631 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-03T22:17:10.631 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-03T22:17:10.631 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-03T22:17:10.631 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-03T22:17:10.631 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-03T22:17:10.631 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-03T22:17:10.632 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-03T22:17:10.632 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-03T22:17:10.632 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-03T22:17:10.632 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-03T22:17:10.632 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-03T22:17:10.632 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-03T22:17:10.632 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-03T22:17:10.632 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-03T22:17:10.632 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-03T22:17:10.632 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-03T22:17:10.632 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-03T22:17:10.632 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-03T22:17:10.632 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-03T22:17:10.633 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-03T22:17:10.633 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-03T22:17:10.633 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-03T22:17:10.633 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-03T22:17:10.633 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-03T22:17:10.633 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-03T22:17:10.633 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-03T22:17:10.633 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-03T22:17:10.633 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-03T22:17:10.633 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-03T22:17:10.633 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-03T22:17:10.633 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-03T22:17:10.633 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-03T22:17:10.633 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-03T22:17:10.633 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-03T22:17:10.634 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-03T22:17:10.634 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-03T22:17:10.634 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-03T22:17:10.634 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-03T22:17:10.634 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-03T22:17:10.634 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-03T22:17:10.634 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-03T22:17:10.634 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-03T22:17:10.634 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-03T22:17:10.634 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-03T22:17:10.634 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-03T22:17:10.634 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-03T22:17:10.634 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-03T22:17:10.634 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-03T22:17:10.635 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-03T22:17:10.635 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-03T22:17:10.635 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-03T22:17:10.635 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-03T22:17:10.635 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-03T22:17:10.635 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-03T22:17:10.635 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-03T22:17:10.635 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-03T22:17:10.635 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-03T22:17:10.635 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-03T22:17:10.635 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-03T22:17:10.635 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-03T22:17:10.635 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-03T22:17:10.636 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-03T22:17:10.636 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-03T22:17:10.636 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-03T22:17:10.636 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-03T22:17:10.636 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-03T22:17:10.636 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-03T22:17:10.636 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-03T22:17:10.636 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-03T22:17:10.636 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-03T22:17:10.636 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-03T22:17:10.636 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-03T22:17:10.636 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-03T22:17:10.636 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-03T22:17:10.636 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-03T22:17:10.637 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-03T22:17:10.637 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-03T22:17:10.637 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-03T22:17:10.637 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-03T22:17:10.637 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-03T22:17:10.637 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-03T22:17:10.637 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-03T22:17:10.637 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-03T22:17:10.637 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-03T22:17:10.637 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-03T22:17:10.637 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-03T22:17:10.637 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-03T22:17:10.637 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-03T22:17:10.637 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-03T22:17:10.638 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-03T22:17:10.638 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-03T22:17:10.638 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-03T22:17:10.638 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-03T22:17:10.638 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-03T22:17:10.638 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-03T22:17:10.638 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-03T22:17:10.638 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-03T22:17:10.638 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-03T22:17:10.638 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-03T22:17:10.638 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-03T22:17:10.638 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-03T22:17:10.638 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-03T22:17:10.638 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-03T22:17:10.638 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-03T22:17:10.639 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-03T22:17:10.639 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-03T22:17:10.639 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-03T22:17:10.639 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-03T22:17:10.639 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-03T22:17:10.639 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-03T22:17:10.639 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-03T22:17:10.639 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-03T22:17:10.639 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-03T22:17:10.639 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-03T22:17:10.639 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-03T22:17:10.639 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-03T22:17:10.639 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-03T22:17:10.639 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-03T22:17:10.640 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-03T22:17:10.640 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-03T22:17:10.640 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-03T22:17:10.640 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-03T22:17:10.640 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-03T22:17:10.640 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-03T22:17:10.640 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-03T22:17:10.640 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-03T22:17:10.640 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-03T22:17:10.640 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-03T22:17:10.640 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-03T22:17:10.640 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-03T22:17:10.640 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-03T22:17:10.640 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-03T22:17:10.641 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-03T22:17:10.641 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-03T22:17:10.641 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-03T22:17:10.641 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-03T22:17:10.641 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-03T22:17:10.641 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-03T22:17:10.641 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-03T22:17:10.641 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-03T22:17:10.641 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-03T22:17:10.641 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-03T22:17:10.641 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-03T22:17:10.641 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-03T22:17:10.641 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-03T22:17:10.641 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-03T22:17:10.642 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-03T22:17:10.642 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-03T22:17:10.642 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-03T22:17:10.642 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-03T22:17:10.642 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-03T22:17:10.642 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-03T22:17:10.642 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-03T22:17:10.642 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-03T22:17:10.642 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-03T22:17:10.642 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-03T22:17:10.642 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-03T22:17:10.642 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-03T22:17:10.642 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-03T22:17:10.642 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-03T22:17:10.643 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-03T22:17:10.643 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-03T22:17:10.643 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-03T22:17:10.643 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-03T22:17:10.643 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-03T22:17:10.643 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-03T22:17:10.643 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-03T22:17:10.643 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-03T22:17:10.643 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-03T22:17:10.643 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-03T22:17:10.643 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-03T22:17:10.643 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-03T22:17:10.643 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-03T22:17:10.643 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-03T22:17:10.644 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-03T22:17:10.644 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-03T22:17:10.644 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-03T22:17:10.644 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-03T22:17:10.644 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-03T22:17:10.644 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-03T22:17:10.644 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-03T22:17:10.644 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-03T22:17:10.644 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-03T22:17:10.644 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-03T22:17:10.644 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-03T22:17:10.644 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-03T22:17:10.644 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-03T22:17:10.644 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-03T22:17:10.645 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-03T22:17:10.645 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-03T22:17:10.645 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-03T22:17:10.645 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-03T22:17:10.645 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-03T22:17:10.645 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-03T22:17:10.645 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-03T22:17:10.645 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-03T22:17:10.645 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-03T22:17:10.645 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-03T22:17:10.645 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-03T22:17:10.645 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-03T22:17:10.645 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-03T22:17:10.646 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-03T22:17:10.646 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-03T22:17:10.646 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-03T22:17:10.646 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-03T22:17:10.646 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-03T22:17:10.646 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-03T22:17:10.646 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-03T22:17:10.646 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-03T22:17:10.646 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-03T22:17:10.646 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-03T22:17:10.646 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-03T22:17:10.646 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-03T22:17:10.646 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-03T22:17:10.646 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-03T22:17:10.647 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-03T22:17:10.647 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-03T22:17:10.647 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-03T22:17:10.647 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-03T22:17:10.647 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-03T22:17:10.647 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-03T22:17:10.647 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-03T22:17:10.647 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-03T22:17:10.647 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-03T22:17:10.647 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-03T22:17:10.647 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-03T22:17:10.647 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-03T22:17:10.647 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-03T22:17:10.647 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-03T22:17:10.648 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-03T22:17:10.648 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-03T22:17:10.648 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-03T22:17:10.648 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-03T22:17:10.648 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-03T22:17:10.648 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-03T22:17:10.648 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-03T22:17:10.648 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-03T22:17:10.648 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-03T22:17:10.648 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-03T22:17:10.648 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-03T22:17:10.648 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-03T22:17:10.648 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-03T22:17:10.648 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-03T22:17:10.649 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-03T22:17:10.649 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-03T22:17:10.649 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-03T22:17:10.649 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-03T22:17:10.649 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-03T22:17:10.649 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-03T22:17:10.649 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-03T22:17:10.649 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-03T22:17:10.649 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-03T22:17:10.649 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-03T22:17:10.649 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-03T22:17:10.649 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-03T22:17:10.649 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-03T22:17:10.650 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-03T22:17:10.650 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-03T22:17:10.650 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-03T22:17:10.650 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-03T22:17:10.650 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-03T22:17:10.650 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-03T22:17:10.650 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-03T22:17:10.650 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-03T22:17:10.650 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-03T22:17:10.650 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-03T22:17:10.650 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-03T22:17:10.650 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-03T22:17:10.650 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-03T22:17:10.651 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-03T22:17:10.651 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-03T22:17:10.651 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-03T22:17:10.651 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-03T22:17:10.651 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-03T22:17:10.651 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-03T22:17:10.651 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-03T22:17:10.651 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-03T22:17:10.651 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-03T22:17:10.651 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-03T22:17:10.651 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-03T22:17:10.651 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-03T22:17:10.651 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-03T22:17:10.651 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-03T22:17:10.652 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-03T22:17:10.652 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-03T22:17:10.652 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-03T22:17:10.652 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-03T22:17:10.652 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-03T22:17:10.652 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-03T22:17:10.652 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-03T22:17:10.652 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-03T22:17:10.652 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-03T22:17:10.652 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-03T22:17:10.652 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-03T22:17:10.652 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-03T22:17:10.652 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-03T22:17:10.652 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-03T22:17:10.653 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-03T22:17:10.653 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-03T22:17:10.653 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-03T22:17:10.653 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-03T22:17:10.653 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-03T22:17:10.653 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-03T22:17:10.653 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-03T22:17:10.653 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-03T22:17:10.653 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-03T22:17:10.653 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-03T22:17:10.653 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-03T22:17:10.653 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-03T22:17:10.653 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-03T22:17:10.653 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-03T22:17:10.654 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-03T22:17:10.654 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-03T22:17:10.654 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-03T22:17:10.654 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-03T22:17:10.654 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-03T22:17:10.654 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-03T22:17:10.654 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-03T22:17:10.654 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-03T22:17:10.654 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-03T22:17:10.654 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-03T22:17:10.654 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-03T22:17:10.654 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-03T22:17:10.654 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-03T22:17:10.654 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-03T22:17:10.655 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-03T22:17:10.655 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-03T22:17:10.655 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-03T22:17:10.655 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-03T22:17:10.655 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-03T22:17:10.655 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-03T22:17:10.655 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-03T22:17:10.655 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-03T22:17:10.655 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-03T22:17:10.655 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-03T22:17:10.655 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-03T22:17:10.655 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-03T22:17:10.655 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-03T22:17:10.655 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-03T22:17:10.656 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-03T22:17:10.656 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-03T22:17:10.656 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-03T22:17:10.656 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-03T22:17:10.656 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-03T22:17:10.656 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-03T22:17:10.656 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-03T22:17:10.656 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-03T22:17:10.656 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-03T22:17:10.656 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-03T22:17:10.656 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-03T22:17:10.656 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-03T22:17:10.656 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-03T22:17:10.657 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-03T22:17:10.657 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-03T22:17:10.657 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-03T22:17:10.657 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-03T22:17:10.657 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-03T22:17:10.657 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-03T22:17:10.657 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-03T22:17:10.657 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-03T22:17:10.657 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-03T22:17:10.657 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-03T22:17:10.657 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-03T22:17:10.657 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-03T22:17:10.657 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-03T22:17:10.657 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-03T22:17:10.658 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-03T22:17:10.658 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-03T22:17:10.658 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-03T22:17:10.658 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-03T22:17:10.658 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-03T22:17:10.658 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-03T22:17:10.658 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-03T22:17:10.658 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-03T22:17:10.658 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-03T22:17:10.658 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-03T22:17:10.658 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-03T22:17:10.658 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-03T22:17:10.658 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-03T22:17:10.658 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-03T22:17:10.659 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-03T22:17:10.659 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-03T22:17:10.659 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-03T22:17:10.659 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-03T22:17:10.659 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-03T22:17:10.659 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-03T22:17:10.659 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-03T22:17:10.659 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-03T22:17:10.659 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-03T22:17:10.659 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-03T22:17:10.659 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-03T22:17:10.659 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-03T22:17:10.659 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-03T22:17:10.660 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-03T22:17:10.660 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-03T22:17:10.660 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-03T22:17:10.660 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-03T22:17:10.660 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-03T22:17:10.660 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-03T22:17:10.660 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-03T22:17:10.660 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-03T22:17:10.660 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-03T22:17:10.660 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-03T22:17:10.660 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-03T22:17:10.660 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-03T22:17:10.660 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-03T22:17:10.660 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-03T22:17:10.661 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-03T22:17:10.661 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-03T22:17:10.661 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-03T22:17:10.661 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-03T22:17:10.661 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-03T22:17:10.661 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-03T22:17:10.661 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-03T22:17:10.661 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-03T22:17:10.661 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-03T22:17:10.661 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-03T22:17:10.661 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-03T22:17:10.661 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-03T22:17:10.661 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-03T22:17:10.661 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-03T22:17:10.662 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-03T22:17:10.662 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-03T22:17:10.662 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-03T22:17:10.662 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-03T22:17:10.662 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-03T22:17:10.662 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-03T22:17:10.662 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-03T22:17:10.662 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-03T22:17:10.662 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-03T22:17:10.662 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-03T22:17:10.662 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-03T22:17:10.662 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-03T22:17:10.662 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-03T22:17:10.662 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-03T22:17:10.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-03T22:17:10.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-03T22:17:10.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-03T22:17:10.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-03T22:17:10.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-03T22:17:10.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-03T22:17:10.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-03T22:17:10.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-03T22:17:10.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-03T22:17:10.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-03T22:17:10.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-03T22:17:10.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-03T22:17:10.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-03T22:17:10.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-03T22:17:10.663 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-03T22:17:10.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-03T22:17:10.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-03T22:17:10.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-03T22:17:10.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-03T22:17:10.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-03T22:17:10.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-03T22:17:10.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-03T22:17:10.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-03T22:17:10.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-03T22:17:10.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-03T22:17:10.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-03T22:17:10.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-03T22:17:10.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-03T22:17:10.664 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-03T22:17:10.665 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-03T22:17:10.665 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-03T22:17:10.665 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-03T22:17:10.665 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-03T22:17:10.665 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-03T22:17:10.665 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-03T22:17:10.665 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-03T22:17:10.665 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-03T22:17:10.665 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-03T22:17:10.665 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-03T22:17:10.665 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-03T22:17:10.665 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-03T22:17:10.665 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-03T22:17:10.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-03T22:17:10.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-03T22:17:10.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-03T22:17:10.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-03T22:17:10.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-03T22:17:10.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-03T22:17:10.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-03T22:17:10.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-03T22:17:10.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-03T22:17:10.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-03T22:17:10.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-03T22:17:10.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-03T22:17:10.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-03T22:17:10.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-03T22:17:10.666 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-03T22:17:10.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-03T22:17:10.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-03T22:17:10.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-03T22:17:10.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-03T22:17:10.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-03T22:17:10.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-03T22:17:10.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-03T22:17:10.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-03T22:17:10.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-03T22:17:10.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-03T22:17:10.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-03T22:17:10.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-03T22:17:10.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-03T22:17:10.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-03T22:17:10.667 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-03T22:17:10.668 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-03T22:17:10.668 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-03T22:17:10.668 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-03T22:17:10.668 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-03T22:17:10.668 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-03T22:17:10.668 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-03T22:17:10.668 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-03T22:17:10.668 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-03T22:17:10.668 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-03T22:17:10.668 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-03T22:17:10.668 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-03T22:17:10.668 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-03T22:17:10.668 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-03T22:17:10.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-03T22:17:10.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-03T22:17:10.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-03T22:17:10.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-03T22:17:10.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-03T22:17:10.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-03T22:17:10.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-03T22:17:10.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-03T22:17:10.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-03T22:17:10.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-03T22:17:10.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-03T22:17:10.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-03T22:17:10.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-03T22:17:10.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-03T22:17:10.669 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-03T22:17:10.670 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-03T22:17:10.670 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-03T22:17:10.670 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-03T22:17:10.670 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-03T22:17:10.670 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-03T22:17:10.670 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-03T22:17:10.670 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-03T22:17:10.670 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-03T22:17:10.670 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-03T22:17:10.670 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-03T22:17:10.670 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-03T22:17:10.670 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-03T22:17:10.670 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-03T22:17:10.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-03T22:17:10.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-03T22:17:10.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-03T22:17:10.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-03T22:17:10.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-03T22:17:10.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-03T22:17:10.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-03T22:17:10.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-03T22:17:10.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-03T22:17:10.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-03T22:17:10.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-03T22:17:10.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-03T22:17:10.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-03T22:17:10.671 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-03T22:17:10.672 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-03T22:17:10.672 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-03T22:17:10.672 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-03T22:17:10.672 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-03T22:17:10.672 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-03T22:17:10.672 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-03T22:17:10.672 INFO:teuthology.orchestra.run.smithi060.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-03T22:17:10.676 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:10.676 DEBUG:teuthology.orchestra.run.smithi060:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-03T22:17:10.700 INFO:teuthology.orchestra.run.smithi060.stdout:postinstall scriptlet (using /bin/sh): 2024-05-03T22:17:10.700 INFO:teuthology.orchestra.run.smithi060.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-03T22:17:10.700 INFO:teuthology.orchestra.run.smithi060.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-03T22:17:10.700 INFO:teuthology.orchestra.run.smithi060.stdout:fi 2024-05-03T22:17:10.700 INFO:teuthology.orchestra.run.smithi060.stdout:for file in vmlinuz System.map config; do 2024-05-03T22:17:10.700 INFO:teuthology.orchestra.run.smithi060.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-03T22:17:10.701 INFO:teuthology.orchestra.run.smithi060.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-03T22:17:10.701 INFO:teuthology.orchestra.run.smithi060.stdout: fi 2024-05-03T22:17:10.701 INFO:teuthology.orchestra.run.smithi060.stdout:done 2024-05-03T22:17:10.701 INFO:teuthology.orchestra.run.smithi060.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-03T22:17:10.701 INFO:teuthology.orchestra.run.smithi060.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-03T22:17:10.701 INFO:teuthology.orchestra.run.smithi060.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-03T22:17:10.701 INFO:teuthology.orchestra.run.smithi060.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-03T22:17:10.701 INFO:teuthology.orchestra.run.smithi060.stdout:fi 2024-05-03T22:17:10.701 INFO:teuthology.orchestra.run.smithi060.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-03T22:17:10.701 INFO:teuthology.orchestra.run.smithi060.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:10.701 INFO:teuthology.orchestra.run.smithi060.stdout:fi 2024-05-03T22:17:10.701 INFO:teuthology.orchestra.run.smithi060.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-03T22:17:10.701 INFO:teuthology.orchestra.run.smithi060.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-03T22:17:10.701 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:10.702 INFO:teuthology.orchestra.run.smithi060.stdout:fi 2024-05-03T22:17:10.702 DEBUG:teuthology.orchestra.run.smithi060:> sudo rpm -qi grub2-tools 2024-05-03T22:17:10.776 INFO:teuthology.orchestra.run.smithi060.stdout:Name : grub2-tools 2024-05-03T22:17:10.776 INFO:teuthology.orchestra.run.smithi060.stdout:Epoch : 1 2024-05-03T22:17:10.776 INFO:teuthology.orchestra.run.smithi060.stdout:Version : 2.06 2024-05-03T22:17:10.776 INFO:teuthology.orchestra.run.smithi060.stdout:Release : 68.el9 2024-05-03T22:17:10.776 INFO:teuthology.orchestra.run.smithi060.stdout:Architecture: x86_64 2024-05-03T22:17:10.776 INFO:teuthology.orchestra.run.smithi060.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-03T22:17:10.776 INFO:teuthology.orchestra.run.smithi060.stdout:Group : Unspecified 2024-05-03T22:17:10.776 INFO:teuthology.orchestra.run.smithi060.stdout:Size : 8264254 2024-05-03T22:17:10.776 INFO:teuthology.orchestra.run.smithi060.stdout:License : GPLv3+ 2024-05-03T22:17:10.777 INFO:teuthology.orchestra.run.smithi060.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-03T22:17:10.777 INFO:teuthology.orchestra.run.smithi060.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-03T22:17:10.777 INFO:teuthology.orchestra.run.smithi060.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-03T22:17:10.777 INFO:teuthology.orchestra.run.smithi060.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-03T22:17:10.777 INFO:teuthology.orchestra.run.smithi060.stdout:Packager : builder@centos.org 2024-05-03T22:17:10.777 INFO:teuthology.orchestra.run.smithi060.stdout:Vendor : CentOS 2024-05-03T22:17:10.777 INFO:teuthology.orchestra.run.smithi060.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-03T22:17:10.777 INFO:teuthology.orchestra.run.smithi060.stdout:Summary : Support tools for GRUB. 2024-05-03T22:17:10.777 INFO:teuthology.orchestra.run.smithi060.stdout:Description : 2024-05-03T22:17:10.777 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-03T22:17:10.777 INFO:teuthology.orchestra.run.smithi060.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-03T22:17:10.777 INFO:teuthology.orchestra.run.smithi060.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-03T22:17:10.777 INFO:teuthology.orchestra.run.smithi060.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-03T22:17:10.777 INFO:teuthology.orchestra.run.smithi060.stdout:hardware devices. 2024-05-03T22:17:10.777 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-03T22:17:10.778 INFO:teuthology.orchestra.run.smithi060.stdout:This subpackage provides tools for support of all platforms. 2024-05-03T22:17:10.778 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-03T22:17:10.779 INFO:teuthology.task.kernel:Updating grub on smithi060 to boot 6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:10.779 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-03T22:17:11.367 INFO:teuthology.orchestra.run.smithi060.stderr:Generating grub configuration file ... 2024-05-03T22:17:12.854 INFO:teuthology.orchestra.run.smithi060.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-03T22:17:12.875 INFO:teuthology.orchestra.run.smithi060.stderr:done 2024-05-03T22:17:12.877 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2024-05-03T22:17:12.907 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.2nU2FH4ZQz 2024-05-03T22:17:12.907 DEBUG:teuthology.orchestra.run.smithi060:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.2nU2FH4ZQz 2024-05-03T22:17:12.973 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.2nU2FH4ZQz 2024-05-03T22:17:13.116 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.2nU2FH4ZQz is 6KB 2024-05-03T22:17:13.165 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.2nU2FH4ZQz 2024-05-03T22:17:13.179 DEBUG:teuthology.orchestra.run.smithi060:> sudo /bin/ls /boot/loader/entries || true 2024-05-03T22:17:13.241 INFO:teuthology.orchestra.run.smithi060.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-03T22:17:13.242 INFO:teuthology.orchestra.run.smithi060.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-03T22:17:13.242 INFO:teuthology.orchestra.run.smithi060.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-03T22:17:13.242 INFO:teuthology.orchestra.run.smithi060.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-03T22:17:13.243 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-03T22:17:13.403 DEBUG:teuthology.orchestra.run.smithi060:> sudo shutdown -r now 2024-05-03T22:17:34.250 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-05-03T22:17:34.251 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-05-03T22:17:34.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T22:17:36.441 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-03T22:17:36.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-05-03T22:17:36.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T22:17:43.409 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-03T22:17:43.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-05-03T22:17:43.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T22:18:08.799 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-05-03T22:18:17.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-05-03T22:18:17.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T22:18:36.450 DEBUG:teuthology.orchestra.remote:timed out 2024-05-03T22:18:43.418 DEBUG:teuthology.orchestra.remote:timed out 2024-05-03T22:18:45.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-05-03T22:18:45.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T22:18:52.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-05-03T22:18:52.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T22:18:52.695 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-05-03T22:18:52.908 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-05-03T22:18:53.283 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-05-03T22:18:53.283 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-g806ec36b2112"... 2024-05-03T22:18:53.283 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-05-03T22:18:53.319 INFO:teuthology.orchestra.run.smithi060.stdout:6.9.0-rc3-g806ec36b2112 2024-05-03T22:18:53.320 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-03T22:18:53.320 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-03T22:18:53.320 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-03T22:18:53.491 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-05-03T22:18:53.491 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-g806ec36b2112"... 2024-05-03T22:18:53.492 DEBUG:teuthology.orchestra.run.smithi044:> uname -r 2024-05-03T22:18:53.532 INFO:teuthology.orchestra.run.smithi044.stdout:6.9.0-rc3-g806ec36b2112 2024-05-03T22:18:53.532 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-03T22:18:53.532 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-03T22:18:53.532 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-03T22:18:54.320 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-03T22:18:54.321 DEBUG:teuthology.orchestra.run.smithi060:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-03T22:18:54.448 INFO:teuthology.orchestra.run.smithi060.stdout:ttyS1 2024-05-03T22:18:54.503 DEBUG:teuthology.parallel:result is None 2024-05-03T22:18:54.533 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-03T22:18:54.533 DEBUG:teuthology.orchestra.run.smithi044:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-03T22:18:54.710 INFO:teuthology.orchestra.run.smithi044.stdout:ttyS1 2024-05-03T22:18:54.767 DEBUG:teuthology.parallel:result is None 2024-05-03T22:19:17.811 DEBUG:teuthology.orchestra.remote:timed out 2024-05-03T22:19:29.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-05-03T22:19:29.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T22:19:30.254 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-05-03T22:19:30.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-05-03T22:19:30.911 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.9.0-rc3-g806ec36b2112"... 2024-05-03T22:19:30.911 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2024-05-03T22:19:30.960 INFO:teuthology.orchestra.run.smithi160.stdout:6.9.0-rc3-g806ec36b2112 2024-05-03T22:19:30.960 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-03T22:19:30.961 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-03T22:19:30.961 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-03T22:19:31.961 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-05-03T22:19:31.962 DEBUG:teuthology.orchestra.run.smithi160:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-03T22:19:32.107 INFO:teuthology.orchestra.run.smithi160.stdout:ttyS1 2024-05-03T22:19:32.158 DEBUG:teuthology.parallel:result is None 2024-05-03T22:19:32.159 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-03T22:19:32.168 INFO:teuthology.task.internal:Creating test directory... 2024-05-03T22:19:32.168 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-03T22:19:32.177 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-03T22:19:32.186 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-03T22:19:32.243 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-03T22:19:32.249 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-03T22:19:32.268 INFO:teuthology.task.internal:Creating archive directory... 2024-05-03T22:19:32.268 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-03T22:19:32.275 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-03T22:19:32.282 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-03T22:19:32.355 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-03T22:19:32.362 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-03T22:19:32.362 DEBUG:teuthology.orchestra.run.smithi044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-03T22:19:32.369 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-03T22:19:32.376 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-03T22:19:32.468 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-03T22:19:32.468 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-03T22:19:32.468 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-03T22:19:32.498 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-03T22:19:32.503 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-03T22:19:32.503 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-03T22:19:32.508 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-03T22:19:32.515 INFO:teuthology.task.internal:Configuring sudo... 2024-05-03T22:19:32.515 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-03T22:19:32.522 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-03T22:19:32.529 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-03T22:19:32.617 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-03T22:19:32.626 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-03T22:19:32.627 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-03T22:19:32.634 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-03T22:19:32.640 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-03T22:19:32.693 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-03T22:19:32.784 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-03T22:19:32.890 DEBUG:teuthology.orchestra.run.smithi044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-03T22:19:32.981 DEBUG:teuthology.orchestra.run.smithi044:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-03T22:19:33.077 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T22:19:33.077 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-03T22:19:33.160 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-03T22:19:33.245 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-03T22:19:33.337 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-03T22:19:33.419 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-03T22:19:33.507 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-03T22:19:33.507 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-03T22:19:33.595 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-03T22:19:33.681 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-03T22:19:33.826 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-03T22:19:33.918 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-03T22:19:34.002 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-03T22:19:34.002 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-03T22:19:34.075 DEBUG:teuthology.orchestra.run.smithi044:> sudo service rsyslog restart 2024-05-03T22:19:34.083 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2024-05-03T22:19:34.091 DEBUG:teuthology.orchestra.run.smithi160:> sudo service rsyslog restart 2024-05-03T22:19:34.211 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-03T22:19:34.211 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-03T22:19:34.224 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-03T22:19:34.603 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-03T22:19:34.611 INFO:teuthology.task.internal:Starting timer... 2024-05-03T22:19:34.611 INFO:teuthology.run_tasks:Running task pcp... 2024-05-03T22:19:34.624 INFO:teuthology.run_tasks:Running task selinux... 2024-05-03T22:19:34.636 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-03T22:19:34.637 DEBUG:teuthology.orchestra.run.smithi044:> sudo service auditd rotate 2024-05-03T22:19:34.773 INFO:teuthology.orchestra.run.smithi044.stdout:Rotating logs: 2024-05-03T22:19:34.779 DEBUG:teuthology.orchestra.run.smithi060:> sudo service auditd rotate 2024-05-03T22:19:34.901 INFO:teuthology.orchestra.run.smithi060.stdout:Rotating logs: 2024-05-03T22:19:34.906 DEBUG:teuthology.orchestra.run.smithi160:> sudo service auditd rotate 2024-05-03T22:19:35.035 INFO:teuthology.orchestra.run.smithi160.stdout:Rotating logs: 2024-05-03T22:19:35.041 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-03T22:19:35.042 DEBUG:teuthology.orchestra.run.smithi044:> /usr/sbin/getenforce 2024-05-03T22:19:35.092 INFO:teuthology.orchestra.run.smithi044.stdout:Permissive 2024-05-03T22:19:35.092 DEBUG:teuthology.orchestra.run.smithi060:> /usr/sbin/getenforce 2024-05-03T22:19:35.163 INFO:teuthology.orchestra.run.smithi060.stdout:Permissive 2024-05-03T22:19:35.163 DEBUG:teuthology.orchestra.run.smithi160:> /usr/sbin/getenforce 2024-05-03T22:19:35.224 INFO:teuthology.orchestra.run.smithi160.stdout:Permissive 2024-05-03T22:19:35.224 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi044.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi060.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi160.front.sepia.ceph.com': 'permissive'} 2024-05-03T22:19:35.224 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-03T22:19:35.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T22:19:35.300 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-03T22:19:35.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T22:19:35.375 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-03T22:19:35.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T22:19:35.453 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-03T22:19:35.454 DEBUG:teuthology.orchestra.run.smithi044:> sudo /usr/sbin/setenforce permissive 2024-05-03T22:19:35.533 DEBUG:teuthology.orchestra.run.smithi060:> sudo /usr/sbin/setenforce permissive 2024-05-03T22:19:35.612 DEBUG:teuthology.orchestra.run.smithi160:> sudo /usr/sbin/setenforce permissive 2024-05-03T22:19:35.683 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-03T22:19:35.693 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-03T22:19:35.699 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-03T22:19:35.883 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-03T22:19:35.898 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-03T22:19:35.899 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi044.front.sepia.ceph.com,smithi060.front.sepia.ceph.com,smithi160.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-03T22:25:28.284 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi044.front.sepia.ceph.com'), Remote(name='ubuntu@smithi060.front.sepia.ceph.com'), Remote(name='ubuntu@smithi160.front.sepia.ceph.com')] 2024-05-03T22:25:28.285 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-05-03T22:25:28.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T22:25:28.397 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-05-03T22:25:28.542 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-05-03T22:25:28.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-05-03T22:25:28.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T22:25:28.654 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-05-03T22:25:28.820 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-05-03T22:25:28.820 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-05-03T22:25:28.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-03T22:25:28.921 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-05-03T22:25:29.081 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-05-03T22:25:29.081 INFO:teuthology.run_tasks:Running task clock... 2024-05-03T22:25:29.094 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-03T22:25:29.095 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-03T22:25:29.095 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-03T22:25:29.103 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-03T22:25:29.103 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-03T22:25:29.111 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-03T22:25:29.111 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-03T22:25:29.194 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-03T22:25:29.198 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-03T22:25:29.202 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-03T22:25:29.236 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-03T22:25:29.246 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-03T22:25:29.247 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-03T22:25:29.310 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: ntpd: command not found 2024-05-03T22:25:29.322 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: ntpd: command not found 2024-05-03T22:25:29.326 INFO:teuthology.orchestra.run.smithi044.stderr:sudo: ntpd: command not found 2024-05-03T22:25:29.344 INFO:teuthology.orchestra.run.smithi160.stdout:506 Cannot talk to daemon 2024-05-03T22:25:29.354 INFO:teuthology.orchestra.run.smithi060.stdout:506 Cannot talk to daemon 2024-05-03T22:25:29.358 INFO:teuthology.orchestra.run.smithi044.stdout:506 Cannot talk to daemon 2024-05-03T22:25:29.384 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-03T22:25:29.396 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-03T22:25:29.397 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-03T22:25:29.429 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-03T22:25:29.439 INFO:teuthology.orchestra.run.smithi044.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-03T22:25:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-03T22:25:29.566 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-05-03T22:25:29.574 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-03T22:25:29.574 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-05-03T22:25:29.574 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T22:25:29.574 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T22:25:29.574 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T22:25:29.574 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T22:25:29.584 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-05-03T22:25:29.586 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-05-03T22:25:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-03T22:25:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-05-03T22:25:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T22:25:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T22:25:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T22:25:29.595 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T22:25:29.596 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-03T22:25:29.596 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-05-03T22:25:29.596 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T22:25:29.596 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T22:25:29.596 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T22:25:29.596 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T22:25:29.598 INFO:teuthology.run_tasks:Running task install... 2024-05-03T22:25:29.606 DEBUG:teuthology.task.install:project ceph 2024-05-03T22:25:29.606 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea'}} 2024-05-03T22:25:29.606 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea'} 2024-05-03T22:25:29.606 INFO:teuthology.task.install:Using flavor: default 2024-05-03T22:25:29.612 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-03T22:25:29.613 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-03T22:25:29.613 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea', 'tag': None, 'wait_for_package': False} 2024-05-03T22:25:29.613 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:25:29.616 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea', 'tag': None, 'wait_for_package': False} 2024-05-03T22:25:29.616 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:25:29.617 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea', 'tag': None, 'wait_for_package': False} 2024-05-03T22:25:29.617 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:25:29.765 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/ 2024-05-03T22:25:29.765 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3450.g9a047fe7 2024-05-03T22:25:29.834 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/ 2024-05-03T22:25:29.834 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3450.g9a047fe7 2024-05-03T22:25:29.838 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/ 2024-05-03T22:25:29.838 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3450.g9a047fe7 2024-05-03T22:25:29.936 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-03T22:25:29.937 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T22:25:29.937 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-03T22:25:29.942 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-03T22:25:29.942 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-03T22:25:29.942 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-03T22:25:30.008 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-03T22:25:30.008 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-03T22:25:30.008 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-03T22:25:30.031 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-03T22:25:30.032 DEBUG:teuthology.orchestra.run.smithi044:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9a047fe7599a549042d06a3fb5b6813a203eabea/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-03T22:25:30.039 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-03T22:25:30.039 DEBUG:teuthology.orchestra.run.smithi060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9a047fe7599a549042d06a3fb5b6813a203eabea/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-03T22:25:30.093 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-03T22:25:30.093 DEBUG:teuthology.orchestra.run.smithi160:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9a047fe7599a549042d06a3fb5b6813a203eabea/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-03T22:25:30.166 DEBUG:teuthology.orchestra.run.smithi044:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-03T22:25:30.167 DEBUG:teuthology.orchestra.run.smithi060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-03T22:25:30.220 DEBUG:teuthology.orchestra.run.smithi160:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-03T22:25:30.284 DEBUG:teuthology.orchestra.run.smithi044:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-03T22:25:30.285 DEBUG:teuthology.orchestra.run.smithi060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-03T22:25:30.338 DEBUG:teuthology.orchestra.run.smithi160:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-03T22:25:30.372 INFO:teuthology.orchestra.run.smithi044.stdout:check_obsoletes = 1 2024-05-03T22:25:30.372 INFO:teuthology.orchestra.run.smithi060.stdout:check_obsoletes = 1 2024-05-03T22:25:30.375 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum clean all 2024-05-03T22:25:30.377 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum clean all 2024-05-03T22:25:30.418 INFO:teuthology.orchestra.run.smithi160.stdout:check_obsoletes = 1 2024-05-03T22:25:30.422 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum clean all 2024-05-03T22:25:30.712 INFO:teuthology.orchestra.run.smithi060.stdout:50 files removed 2024-05-03T22:25:30.717 INFO:teuthology.orchestra.run.smithi044.stdout:50 files removed 2024-05-03T22:25:30.752 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-03T22:25:30.752 INFO:teuthology.orchestra.run.smithi160.stdout:50 files removed 2024-05-03T22:25:30.756 DEBUG:teuthology.orchestra.run.smithi044:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-03T22:25:30.791 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-03T22:25:31.623 INFO:teuthology.orchestra.run.smithi060.stdout:ceph packages for x86_64 201 kB/s | 84 kB 00:00 2024-05-03T22:25:31.666 INFO:teuthology.orchestra.run.smithi044.stdout:ceph packages for x86_64 180 kB/s | 84 kB 00:00 2024-05-03T22:25:31.706 INFO:teuthology.orchestra.run.smithi160.stdout:ceph packages for x86_64 174 kB/s | 84 kB 00:00 2024-05-03T22:25:32.073 INFO:teuthology.orchestra.run.smithi060.stdout:ceph noarch packages 34 kB/s | 12 kB 00:00 2024-05-03T22:25:32.267 INFO:teuthology.orchestra.run.smithi044.stdout:ceph noarch packages 24 kB/s | 12 kB 00:00 2024-05-03T22:25:32.574 INFO:teuthology.orchestra.run.smithi060.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2024-05-03T22:25:32.826 INFO:teuthology.orchestra.run.smithi044.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2024-05-03T22:25:33.422 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-05-03T22:25:33.456 INFO:teuthology.orchestra.run.smithi160.stdout:ceph noarch packages 7.1 kB/s | 12 kB 00:01 2024-05-03T22:25:33.941 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - BaseOS 7.8 MB/s | 8.0 MB 00:01 2024-05-03T22:25:33.965 INFO:teuthology.orchestra.run.smithi160.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2024-05-03T22:25:35.185 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - BaseOS 7.1 MB/s | 8.0 MB 00:01 2024-05-03T22:25:35.432 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-05-03T22:25:37.440 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-05-03T22:25:42.433 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 2.1 MB/s | 6.2 MB 00:02 2024-05-03T22:25:42.790 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.2 MB 00:01 2024-05-03T22:25:44.267 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-05-03T22:25:44.358 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 16 kB 00:00 2024-05-03T22:25:45.793 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-05-03T22:25:46.452 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-05-03T22:25:51.726 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-05-03T22:25:52.217 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:17 2024-05-03T22:25:52.652 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-05-03T22:25:54.143 INFO:teuthology.orchestra.run.smithi160.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-03T22:25:54.145 INFO:teuthology.orchestra.run.smithi160.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-03T22:25:54.165 INFO:teuthology.orchestra.run.smithi160.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-03T22:25:54.167 INFO:teuthology.orchestra.run.smithi160.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-03T22:25:54.168 INFO:teuthology.orchestra.run.smithi160.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-03T22:25:54.169 INFO:teuthology.orchestra.run.smithi160.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-03T22:25:54.172 INFO:teuthology.orchestra.run.smithi160.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-03T22:25:54.175 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-03T22:25:54.176 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-03T22:25:54.250 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-05-03T22:25:54.273 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-05-03T22:25:54.273 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-05-03T22:25:54.273 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-05-03T22:25:54.273 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-05-03T22:25:54.273 INFO:teuthology.orchestra.run.smithi160.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-03T22:25:54.273 INFO:teuthology.orchestra.run.smithi160.stdout: ceph x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 6.6 k 2024-05-03T22:25:54.273 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 5.4 M 2024-05-03T22:25:54.274 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 891 k 2024-05-03T22:25:54.274 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 145 k 2024-05-03T22:25:54.274 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 1.5 M 2024-05-03T22:25:54.274 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 142 k 2024-05-03T22:25:54.274 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 3.5 M 2024-05-03T22:25:54.274 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 7.4 M 2024-05-03T22:25:54.274 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 49 k 2024-05-03T22:25:54.274 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 11 M 2024-05-03T22:25:54.274 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 49 M 2024-05-03T22:25:54.274 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 273 k 2024-05-03T22:25:54.274 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 763 k 2024-05-03T22:25:54.275 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 225 k 2024-05-03T22:25:54.275 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-shell x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 27 k 2024-05-03T22:25:54.275 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 18 k 2024-05-03T22:25:54.275 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-03T22:25:54.275 INFO:teuthology.orchestra.run.smithi160.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-03T22:25:54.275 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-03T22:25:54.275 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 32 k 2024-05-03T22:25:54.275 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 747 k 2024-05-03T22:25:54.275 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 127 k 2024-05-03T22:25:54.275 INFO:teuthology.orchestra.run.smithi160.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-03T22:25:54.275 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-03T22:25:54.275 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-03T22:25:54.275 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-03T22:25:54.276 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-03T22:25:54.276 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-03T22:25:54.276 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 161 k 2024-05-03T22:25:54.276 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 320 k 2024-05-03T22:25:54.276 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 298 k 2024-05-03T22:25:54.276 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 100 k 2024-05-03T22:25:54.276 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 85 k 2024-05-03T22:25:54.276 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.1 M 2024-05-03T22:25:54.276 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 170 k 2024-05-03T22:25:54.276 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-03T22:25:54.276 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrading: 2024-05-03T22:25:54.276 INFO:teuthology.orchestra.run.smithi160.stdout: librados2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.4 M 2024-05-03T22:25:54.277 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.1 M 2024-05-03T22:25:54.277 INFO:teuthology.orchestra.run.smithi160.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-03T22:25:54.277 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-03T22:25:54.277 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-05-03T22:25:54.277 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-03T22:25:54.277 INFO:teuthology.orchestra.run.smithi160.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-03T22:25:54.277 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-03T22:25:54.277 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 21 M 2024-05-03T22:25:54.277 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 34 k 2024-05-03T22:25:54.277 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 2.4 M 2024-05-03T22:25:54.277 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 274 k 2024-05-03T22:25:54.277 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 4.7 M 2024-05-03T22:25:54.278 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 17 M 2024-05-03T22:25:54.278 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 16 k 2024-05-03T22:25:54.278 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 25 k 2024-05-03T22:25:54.278 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-03T22:25:54.278 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-03T22:25:54.278 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-03T22:25:54.278 INFO:teuthology.orchestra.run.smithi160.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-03T22:25:54.278 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-03T22:25:54.278 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-03T22:25:54.278 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-03T22:25:54.279 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-03T22:25:54.279 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 163 k 2024-05-03T22:25:54.279 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-03T22:25:54.279 INFO:teuthology.orchestra.run.smithi160.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-03T22:25:54.279 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-03T22:25:54.279 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-03T22:25:54.279 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-03T22:25:54.279 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 500 k 2024-05-03T22:25:54.279 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-03T22:25:54.279 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 5.4 M 2024-05-03T22:25:54.279 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-03T22:25:54.280 INFO:teuthology.orchestra.run.smithi160.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-03T22:25:54.280 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-03T22:25:54.280 INFO:teuthology.orchestra.run.smithi160.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-03T22:25:54.280 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-03T22:25:54.280 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-03T22:25:54.280 INFO:teuthology.orchestra.run.smithi160.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-03T22:25:54.280 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-03T22:25:54.280 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-03T22:25:54.280 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-03T22:25:54.281 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-03T22:25:54.281 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-03T22:25:54.281 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-03T22:25:54.281 INFO:teuthology.orchestra.run.smithi160.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-03T22:25:54.281 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-03T22:25:54.281 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-03T22:25:54.281 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-03T22:25:54.281 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 45 k 2024-05-03T22:25:54.281 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 135 k 2024-05-03T22:25:54.281 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-03T22:25:54.281 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-03T22:25:54.282 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-03T22:25:54.282 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-03T22:25:54.282 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-03T22:25:54.282 INFO:teuthology.orchestra.run.smithi160.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-03T22:25:54.282 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-03T22:25:54.282 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-03T22:25:54.282 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-03T22:25:54.282 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-03T22:25:54.282 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-03T22:25:54.282 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-03T22:25:54.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-03T22:25:54.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-03T22:25:54.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-03T22:25:54.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-03T22:25:54.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-03T22:25:54.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-03T22:25:54.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-03T22:25:54.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-03T22:25:54.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-03T22:25:54.283 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-03T22:25:54.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-03T22:25:54.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-03T22:25:54.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-03T22:25:54.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-03T22:25:54.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-03T22:25:54.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-03T22:25:54.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-03T22:25:54.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-03T22:25:54.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-03T22:25:54.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-03T22:25:54.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-03T22:25:54.284 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-03T22:25:54.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-03T22:25:54.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-03T22:25:54.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-03T22:25:54.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-03T22:25:54.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-03T22:25:54.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-03T22:25:54.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-03T22:25:54.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-03T22:25:54.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-03T22:25:54.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-03T22:25:54.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-03T22:25:54.285 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-03T22:25:54.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-03T22:25:54.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-03T22:25:54.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-03T22:25:54.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-03T22:25:54.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-03T22:25:54.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-03T22:25:54.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-03T22:25:54.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-03T22:25:54.286 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-03T22:25:54.286 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-03T22:25:54.286 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-03T22:25:54.287 INFO:teuthology.orchestra.run.smithi160.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-03T22:25:54.287 INFO:teuthology.orchestra.run.smithi160.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-03T22:25:54.287 INFO:teuthology.orchestra.run.smithi160.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-03T22:25:54.287 INFO:teuthology.orchestra.run.smithi160.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-03T22:25:54.287 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-03T22:25:54.287 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-03T22:25:54.287 INFO:teuthology.orchestra.run.smithi160.stdout:Installing weak dependencies: 2024-05-03T22:25:54.287 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-03T22:25:54.287 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:25:54.287 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-05-03T22:25:54.287 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-05-03T22:25:54.287 INFO:teuthology.orchestra.run.smithi160.stdout:Install 148 Packages 2024-05-03T22:25:54.287 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrade 4 Packages 2024-05-03T22:25:54.288 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:25:54.288 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 222 M 2024-05-03T22:25:54.288 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-05-03T22:25:55.086 INFO:teuthology.orchestra.run.smithi160.stdout:(1/152): ceph-19.0.0-3450.g9a047fe7.el9.x86_64. 20 kB/s | 6.6 kB 00:00 2024-05-03T22:25:55.138 INFO:teuthology.orchestra.run.smithi060.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-03T22:25:55.140 INFO:teuthology.orchestra.run.smithi060.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-03T22:25:55.161 INFO:teuthology.orchestra.run.smithi060.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-03T22:25:55.163 INFO:teuthology.orchestra.run.smithi060.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-03T22:25:55.164 INFO:teuthology.orchestra.run.smithi060.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-03T22:25:55.166 INFO:teuthology.orchestra.run.smithi060.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-03T22:25:55.168 INFO:teuthology.orchestra.run.smithi060.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-03T22:25:55.171 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-03T22:25:55.173 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-03T22:25:55.251 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-05-03T22:25:55.281 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-05-03T22:25:55.281 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-05-03T22:25:55.281 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-05-03T22:25:55.281 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-05-03T22:25:55.281 INFO:teuthology.orchestra.run.smithi060.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-03T22:25:55.281 INFO:teuthology.orchestra.run.smithi060.stdout: ceph x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 6.6 k 2024-05-03T22:25:55.281 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 5.4 M 2024-05-03T22:25:55.281 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 891 k 2024-05-03T22:25:55.281 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 145 k 2024-05-03T22:25:55.281 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 1.5 M 2024-05-03T22:25:55.281 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 142 k 2024-05-03T22:25:55.281 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 3.5 M 2024-05-03T22:25:55.281 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 7.4 M 2024-05-03T22:25:55.282 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 49 k 2024-05-03T22:25:55.282 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 11 M 2024-05-03T22:25:55.282 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 49 M 2024-05-03T22:25:55.282 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 273 k 2024-05-03T22:25:55.282 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 763 k 2024-05-03T22:25:55.282 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 225 k 2024-05-03T22:25:55.282 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-shell x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 27 k 2024-05-03T22:25:55.282 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 18 k 2024-05-03T22:25:55.282 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-03T22:25:55.282 INFO:teuthology.orchestra.run.smithi060.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-03T22:25:55.282 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-03T22:25:55.282 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 32 k 2024-05-03T22:25:55.282 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 747 k 2024-05-03T22:25:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 127 k 2024-05-03T22:25:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-03T22:25:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-03T22:25:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-03T22:25:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-03T22:25:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-03T22:25:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-03T22:25:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 161 k 2024-05-03T22:25:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 320 k 2024-05-03T22:25:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 298 k 2024-05-03T22:25:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 100 k 2024-05-03T22:25:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 85 k 2024-05-03T22:25:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.1 M 2024-05-03T22:25:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 170 k 2024-05-03T22:25:55.283 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-03T22:25:55.283 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2024-05-03T22:25:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.4 M 2024-05-03T22:25:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.1 M 2024-05-03T22:25:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-03T22:25:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-03T22:25:55.284 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-05-03T22:25:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-03T22:25:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-03T22:25:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-03T22:25:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 21 M 2024-05-03T22:25:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 34 k 2024-05-03T22:25:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 2.4 M 2024-05-03T22:25:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 274 k 2024-05-03T22:25:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 4.7 M 2024-05-03T22:25:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 17 M 2024-05-03T22:25:55.284 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 16 k 2024-05-03T22:25:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 25 k 2024-05-03T22:25:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-03T22:25:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-03T22:25:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-03T22:25:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-03T22:25:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-03T22:25:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-03T22:25:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-03T22:25:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-03T22:25:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 163 k 2024-05-03T22:25:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-03T22:25:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-03T22:25:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-03T22:25:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-03T22:25:55.285 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-03T22:25:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 500 k 2024-05-03T22:25:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-03T22:25:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 5.4 M 2024-05-03T22:25:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-03T22:25:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-03T22:25:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-03T22:25:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-03T22:25:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-03T22:25:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-03T22:25:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-03T22:25:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-03T22:25:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-03T22:25:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-03T22:25:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-03T22:25:55.286 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-03T22:25:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-03T22:25:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-03T22:25:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-03T22:25:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-03T22:25:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-03T22:25:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 45 k 2024-05-03T22:25:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 135 k 2024-05-03T22:25:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-03T22:25:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-03T22:25:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-03T22:25:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-03T22:25:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-03T22:25:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-03T22:25:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-03T22:25:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-03T22:25:55.287 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-03T22:25:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-03T22:25:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-03T22:25:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-03T22:25:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-03T22:25:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-03T22:25:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-03T22:25:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-03T22:25:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-03T22:25:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-03T22:25:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-03T22:25:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-03T22:25:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-03T22:25:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-03T22:25:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-03T22:25:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-03T22:25:55.288 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-03T22:25:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-03T22:25:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-03T22:25:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-03T22:25:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-03T22:25:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-03T22:25:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-03T22:25:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-03T22:25:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-03T22:25:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-03T22:25:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-03T22:25:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-03T22:25:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-03T22:25:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-03T22:25:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-03T22:25:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-03T22:25:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-03T22:25:55.289 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-03T22:25:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-03T22:25:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-03T22:25:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-03T22:25:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-03T22:25:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-03T22:25:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-03T22:25:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-03T22:25:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-03T22:25:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-03T22:25:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-03T22:25:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-03T22:25:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-03T22:25:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-03T22:25:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-03T22:25:55.290 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-03T22:25:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-03T22:25:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-03T22:25:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-03T22:25:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-03T22:25:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-03T22:25:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-03T22:25:55.291 INFO:teuthology.orchestra.run.smithi060.stdout:Installing weak dependencies: 2024-05-03T22:25:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-03T22:25:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-03T22:25:55.291 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-05-03T22:25:55.291 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-05-03T22:25:55.291 INFO:teuthology.orchestra.run.smithi060.stdout:Install 148 Packages 2024-05-03T22:25:55.291 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 4 Packages 2024-05-03T22:25:55.291 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-03T22:25:55.292 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 222 M 2024-05-03T22:25:55.292 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-05-03T22:25:55.486 INFO:teuthology.orchestra.run.smithi160.stdout:(2/152): ceph-base-19.0.0-3450.g9a047fe7.el9.x8 7.3 MB/s | 5.4 MB 00:00 2024-05-03T22:25:55.569 INFO:teuthology.orchestra.run.smithi160.stdout:(3/152): ceph-immutable-object-cache-19.0.0-345 1.7 MB/s | 145 kB 00:00 2024-05-03T22:25:55.853 INFO:teuthology.orchestra.run.smithi160.stdout:(4/152): ceph-mds-19.0.0-3450.g9a047fe7.el9.x86 8.4 MB/s | 2.4 MB 00:00 2024-05-03T22:25:55.962 INFO:teuthology.orchestra.run.smithi160.stdout:(5/152): ceph-fuse-19.0.0-3450.g9a047fe7.el9.x8 1.0 MB/s | 891 kB 00:00 2024-05-03T22:25:56.037 INFO:teuthology.orchestra.run.smithi160.stdout:(6/152): ceph-mgr-19.0.0-3450.g9a047fe7.el9.x86 8.3 MB/s | 1.5 MB 00:00 2024-05-03T22:25:56.188 INFO:teuthology.orchestra.run.smithi060.stdout:(1/152): ceph-19.0.0-3450.g9a047fe7.el9.x86_64. 17 kB/s | 6.6 kB 00:00 2024-05-03T22:25:56.638 INFO:teuthology.orchestra.run.smithi160.stdout:(7/152): ceph-common-19.0.0-3450.g9a047fe7.el9. 11 MB/s | 21 MB 00:01 2024-05-03T22:25:56.796 INFO:teuthology.orchestra.run.smithi060.stdout:(2/152): ceph-fuse-19.0.0-3450.g9a047fe7.el9.x8 1.4 MB/s | 891 kB 00:00 2024-05-03T22:25:56.963 INFO:teuthology.orchestra.run.smithi060.stdout:(3/152): ceph-immutable-object-cache-19.0.0-345 871 kB/s | 145 kB 00:00 2024-05-03T22:25:57.141 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - CRB 6.7 MB/s | 6.2 MB 00:00 2024-05-03T22:25:57.404 INFO:teuthology.orchestra.run.smithi160.stdout:(8/152): ceph-osd-19.0.0-3450.g9a047fe7.el9.x86 12 MB/s | 17 MB 00:01 2024-05-03T22:25:57.479 INFO:teuthology.orchestra.run.smithi160.stdout:(9/152): ceph-selinux-19.0.0-3450.g9a047fe7.el9 341 kB/s | 25 kB 00:00 2024-05-03T22:25:57.663 INFO:teuthology.orchestra.run.smithi060.stdout:(4/152): ceph-base-19.0.0-3450.g9a047fe7.el9.x8 2.9 MB/s | 5.4 MB 00:01 2024-05-03T22:25:58.022 INFO:teuthology.orchestra.run.smithi060.stdout:(5/152): ceph-mgr-19.0.0-3450.g9a047fe7.el9.x86 4.2 MB/s | 1.5 MB 00:00 2024-05-03T22:25:58.046 INFO:teuthology.orchestra.run.smithi160.stdout:(10/152): ceph-radosgw-19.0.0-3450.g9a047fe7.el 7.5 MB/s | 11 MB 00:01 2024-05-03T22:25:58.155 INFO:teuthology.orchestra.run.smithi160.stdout:(11/152): cephfs-mirror-19.0.0-3450.g9a047fe7.e 2.1 MB/s | 225 kB 00:00 2024-05-03T22:25:58.262 INFO:teuthology.orchestra.run.smithi160.stdout:(12/152): cephfs-shell-19.0.0-3450.g9a047fe7.el 254 kB/s | 27 kB 00:00 2024-05-03T22:25:58.289 INFO:teuthology.orchestra.run.smithi060.stdout:(6/152): ceph-mds-19.0.0-3450.g9a047fe7.el9.x86 1.8 MB/s | 2.4 MB 00:01 2024-05-03T22:25:58.364 INFO:teuthology.orchestra.run.smithi160.stdout:(13/152): ceph-mon-19.0.0-3450.g9a047fe7.el9.x8 2.0 MB/s | 4.7 MB 00:02 2024-05-03T22:25:58.389 INFO:teuthology.orchestra.run.smithi160.stdout:(14/152): libcephfs-devel-19.0.0-3450.g9a047fe7 252 kB/s | 32 kB 00:00 2024-05-03T22:25:58.489 INFO:teuthology.orchestra.run.smithi160.stdout:(15/152): libcephsqlite-19.0.0-3450.g9a047fe7.e 1.6 MB/s | 163 kB 00:00 2024-05-03T22:25:58.581 INFO:teuthology.orchestra.run.smithi160.stdout:(16/152): librados-devel-19.0.0-3450.g9a047fe7. 1.4 MB/s | 127 kB 00:00 2024-05-03T22:25:58.647 INFO:teuthology.orchestra.run.smithi060.stdout:(7/152): ceph-mon-19.0.0-3450.g9a047fe7.el9.x86 7.5 MB/s | 4.7 MB 00:00 2024-05-03T22:25:58.665 INFO:teuthology.orchestra.run.smithi160.stdout:(17/152): libradosstriper1-19.0.0-3450.g9a047fe 5.9 MB/s | 500 kB 00:00 2024-05-03T22:25:58.774 INFO:teuthology.orchestra.run.smithi160.stdout:(18/152): libcephfs2-19.0.0-3450.g9a047fe7.el9. 1.8 MB/s | 747 kB 00:00 2024-05-03T22:25:58.899 INFO:teuthology.orchestra.run.smithi160.stdout:(19/152): python3-ceph-argparse-19.0.0-3450.g9a 363 kB/s | 45 kB 00:00 2024-05-03T22:25:59.016 INFO:teuthology.orchestra.run.smithi160.stdout:(20/152): python3-ceph-common-19.0.0-3450.g9a04 1.1 MB/s | 135 kB 00:00 2024-05-03T22:25:59.141 INFO:teuthology.orchestra.run.smithi160.stdout:(21/152): python3-cephfs-19.0.0-3450.g9a047fe7. 1.3 MB/s | 161 kB 00:00 2024-05-03T22:25:59.358 INFO:teuthology.orchestra.run.smithi160.stdout:(22/152): python3-rados-19.0.0-3450.g9a047fe7.e 1.5 MB/s | 320 kB 00:00 2024-05-03T22:25:59.467 INFO:teuthology.orchestra.run.smithi160.stdout:(23/152): librgw2-19.0.0-3450.g9a047fe7.el9.x86 6.7 MB/s | 5.4 MB 00:00 2024-05-03T22:25:59.542 INFO:teuthology.orchestra.run.smithi160.stdout:(24/152): python3-rgw-19.0.0-3450.g9a047fe7.el9 1.3 MB/s | 100 kB 00:00 2024-05-03T22:25:59.626 INFO:teuthology.orchestra.run.smithi160.stdout:(25/152): rbd-fuse-19.0.0-3450.g9a047fe7.el9.x8 1.0 MB/s | 85 kB 00:00 2024-05-03T22:25:59.926 INFO:teuthology.orchestra.run.smithi160.stdout:(26/152): python3-rbd-19.0.0-3450.g9a047fe7.el9 527 kB/s | 298 kB 00:00 2024-05-03T22:26:00.043 INFO:teuthology.orchestra.run.smithi160.stdout:(27/152): rbd-mirror-19.0.0-3450.g9a047fe7.el9. 7.4 MB/s | 3.1 MB 00:00 2024-05-03T22:26:00.050 INFO:teuthology.orchestra.run.smithi044.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 16 kB 00:01 2024-05-03T22:26:00.056 INFO:teuthology.orchestra.run.smithi060.stdout:(8/152): ceph-radosgw-19.0.0-3450.g9a047fe7.el9 7.5 MB/s | 11 MB 00:01 2024-05-03T22:26:00.076 INFO:teuthology.orchestra.run.smithi160.stdout:(28/152): rbd-nbd-19.0.0-3450.g9a047fe7.el9.x86 1.1 MB/s | 170 kB 00:00 2024-05-03T22:26:00.098 INFO:teuthology.orchestra.run.smithi060.stdout:(9/152): ceph-selinux-19.0.0-3450.g9a047fe7.el9 621 kB/s | 25 kB 00:00 2024-05-03T22:26:00.102 INFO:teuthology.orchestra.run.smithi160.stdout:(29/152): ceph-grafana-dashboards-19.0.0-3450.g 594 kB/s | 34 kB 00:00 2024-05-03T22:26:00.177 INFO:teuthology.orchestra.run.smithi160.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3450.g9a047fe 1.4 MB/s | 142 kB 00:00 2024-05-03T22:26:00.602 INFO:teuthology.orchestra.run.smithi160.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3450.g9a047 7.1 MB/s | 3.5 MB 00:00 2024-05-03T22:26:00.694 INFO:teuthology.orchestra.run.smithi160.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3450.g9a 3.0 MB/s | 274 kB 00:00 2024-05-03T22:26:00.769 INFO:teuthology.orchestra.run.smithi160.stdout:(33/152): ceph-mgr-rook-19.0.0-3450.g9a047fe7.e 667 kB/s | 49 kB 00:00 2024-05-03T22:26:00.845 INFO:teuthology.orchestra.run.smithi160.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3450.g9 222 kB/s | 16 kB 00:00 2024-05-03T22:26:00.937 INFO:teuthology.orchestra.run.smithi160.stdout:(35/152): ceph-volume-19.0.0-3450.g9a047fe7.el9 2.9 MB/s | 273 kB 00:00 2024-05-03T22:26:01.104 INFO:teuthology.orchestra.run.smithi160.stdout:(36/152): cephadm-19.0.0-3450.g9a047fe7.el9.noa 4.5 MB/s | 763 kB 00:00 2024-05-03T22:26:01.127 INFO:teuthology.orchestra.run.smithi044.stdout:Extra Packages for Enterprise Linux 24 MB/s | 21 MB 00:00 2024-05-03T22:26:01.179 INFO:teuthology.orchestra.run.smithi160.stdout:(37/152): cephfs-top-19.0.0-3450.g9a047fe7.el9. 246 kB/s | 18 kB 00:00 2024-05-03T22:26:01.296 INFO:teuthology.orchestra.run.smithi160.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 695 kB/s | 80 kB 00:00 2024-05-03T22:26:01.405 INFO:teuthology.orchestra.run.smithi160.stdout:(39/152): libgfortran-11.4.1-3.el9.x86_64.rpm 7.3 MB/s | 803 kB 00:00 2024-05-03T22:26:01.455 INFO:teuthology.orchestra.run.smithi160.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 195 kB 00:00 2024-05-03T22:26:01.505 INFO:teuthology.orchestra.run.smithi160.stdout:(41/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.1 MB/s | 253 kB 00:00 2024-05-03T22:26:01.589 INFO:teuthology.orchestra.run.smithi160.stdout:(42/152): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-05-03T22:26:01.631 INFO:teuthology.orchestra.run.smithi160.stdout:(43/152): python3-ply-3.11-14.el9.noarch.rpm 2.6 MB/s | 106 kB 00:00 2024-05-03T22:26:01.673 INFO:teuthology.orchestra.run.smithi160.stdout:(44/152): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-05-03T22:26:01.715 INFO:teuthology.orchestra.run.smithi160.stdout:(45/152): python3-requests-2.25.1-8.el9.noarch. 3.0 MB/s | 125 kB 00:00 2024-05-03T22:26:01.765 INFO:teuthology.orchestra.run.smithi160.stdout:(46/152): python3-urllib3-1.26.5-5.el9.noarch.r 4.3 MB/s | 215 kB 00:00 2024-05-03T22:26:02.374 INFO:teuthology.orchestra.run.smithi160.stdout:(47/152): ceph-test-19.0.0-3450.g9a047fe7.el9.x 10 MB/s | 49 MB 00:04 2024-05-03T22:26:02.583 INFO:teuthology.orchestra.run.smithi160.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 844 kB/s | 689 kB 00:00 2024-05-03T22:26:02.650 INFO:teuthology.orchestra.run.smithi160.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 107 kB 00:00 2024-05-03T22:26:02.708 INFO:teuthology.orchestra.run.smithi160.stdout:(50/152): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-05-03T22:26:02.750 INFO:teuthology.orchestra.run.smithi160.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 216 kB/s | 21 kB 00:00 2024-05-03T22:26:02.800 INFO:teuthology.orchestra.run.smithi160.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 3.4 MB/s | 313 kB 00:00 2024-05-03T22:26:02.842 INFO:teuthology.orchestra.run.smithi160.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 360 kB/s | 33 kB 00:00 2024-05-03T22:26:02.909 INFO:teuthology.orchestra.run.smithi160.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 281 kB/s | 18 kB 00:00 2024-05-03T22:26:02.976 INFO:teuthology.orchestra.run.smithi160.stdout:(55/152): libaio-devel-0.3.111-13.el9.x86_64.rp 168 kB/s | 11 kB 00:00 2024-05-03T22:26:03.015 INFO:teuthology.orchestra.run.smithi060.stdout:(10/152): ceph-common-19.0.0-3450.g9a047fe7.el9 2.9 MB/s | 21 MB 00:07 2024-05-03T22:26:03.068 INFO:teuthology.orchestra.run.smithi160.stdout:(56/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-05-03T22:26:03.098 INFO:teuthology.orchestra.run.smithi060.stdout:(11/152): cephfs-mirror-19.0.0-3450.g9a047fe7.e 2.7 MB/s | 225 kB 00:00 2024-05-03T22:26:03.118 INFO:teuthology.orchestra.run.smithi160.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-05-03T22:26:03.143 INFO:teuthology.orchestra.run.smithi160.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 609 kB/s | 45 kB 00:00 2024-05-03T22:26:03.157 INFO:teuthology.orchestra.run.smithi060.stdout:(12/152): cephfs-shell-19.0.0-3450.g9a047fe7.el 469 kB/s | 27 kB 00:00 2024-05-03T22:26:03.216 INFO:teuthology.orchestra.run.smithi060.stdout:(13/152): libcephfs-devel-19.0.0-3450.g9a047fe7 552 kB/s | 32 kB 00:00 2024-05-03T22:26:03.219 INFO:teuthology.orchestra.run.smithi160.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-05-03T22:26:03.269 INFO:teuthology.orchestra.run.smithi160.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 4.6 MB/s | 582 kB 00:00 2024-05-03T22:26:03.311 INFO:teuthology.orchestra.run.smithi160.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 279 kB/s | 25 kB 00:00 2024-05-03T22:26:03.336 INFO:teuthology.orchestra.run.smithi160.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 716 kB/s | 47 kB 00:00 2024-05-03T22:26:03.374 INFO:teuthology.orchestra.run.smithi060.stdout:(14/152): libcephfs2-19.0.0-3450.g9a047fe7.el9. 4.6 MB/s | 747 kB 00:00 2024-05-03T22:26:03.404 INFO:teuthology.orchestra.run.smithi160.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-05-03T22:26:03.433 INFO:teuthology.orchestra.run.smithi060.stdout:(15/152): libcephsqlite-19.0.0-3450.g9a047fe7.e 2.8 MB/s | 163 kB 00:00 2024-05-03T22:26:03.437 INFO:teuthology.orchestra.run.smithi160.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 1.9 MB/s | 188 kB 00:00 2024-05-03T22:26:03.500 INFO:teuthology.orchestra.run.smithi060.stdout:(16/152): librados-devel-19.0.0-3450.g9a047fe7. 1.9 MB/s | 127 kB 00:00 2024-05-03T22:26:03.571 INFO:teuthology.orchestra.run.smithi160.stdout:(65/152): ceph-mgr-diskprediction-local-19.0.0- 2.2 MB/s | 7.4 MB 00:03 2024-05-03T22:26:03.596 INFO:teuthology.orchestra.run.smithi160.stdout:(66/152): openblas-0.3.21-2.el9.x86_64.rpm 183 kB/s | 35 kB 00:00 2024-05-03T22:26:03.625 INFO:teuthology.orchestra.run.smithi060.stdout:(17/152): libradosstriper1-19.0.0-3450.g9a047fe 3.9 MB/s | 500 kB 00:00 2024-05-03T22:26:03.822 INFO:teuthology.orchestra.run.smithi160.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 12 MB/s | 4.7 MB 00:00 2024-05-03T22:26:03.905 INFO:teuthology.orchestra.run.smithi160.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-05-03T22:26:03.972 INFO:teuthology.orchestra.run.smithi160.stdout:(69/152): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-05-03T22:26:04.039 INFO:teuthology.orchestra.run.smithi160.stdout:(70/152): postgresql-contrib-13.14-1.el9.x86_64 4.1 MB/s | 911 kB 00:00 2024-05-03T22:26:04.114 INFO:teuthology.orchestra.run.smithi160.stdout:(71/152): postgresql-13.14-1.el9.x86_64.rpm 3.1 MB/s | 1.6 MB 00:00 2024-05-03T22:26:04.189 INFO:teuthology.orchestra.run.smithi160.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 6.8 MB/s | 1.0 MB 00:00 2024-05-03T22:26:04.215 INFO:teuthology.orchestra.run.smithi160.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 876 kB/s | 87 kB 00:00 2024-05-03T22:26:04.298 INFO:teuthology.orchestra.run.smithi160.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-05-03T22:26:04.374 INFO:teuthology.orchestra.run.smithi160.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 3.2 MB/s | 248 kB 00:00 2024-05-03T22:26:04.491 INFO:teuthology.orchestra.run.smithi160.stdout:(76/152): postgresql-server-13.14-1.el9.x86_64. 11 MB/s | 5.8 MB 00:00 2024-05-03T22:26:04.516 INFO:teuthology.orchestra.run.smithi160.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 181 kB/s | 26 kB 00:00 2024-05-03T22:26:04.549 INFO:teuthology.orchestra.run.smithi160.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 331 kB/s | 19 kB 00:00 2024-05-03T22:26:04.591 INFO:teuthology.orchestra.run.smithi160.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 2.3 MB/s | 172 kB 00:00 2024-05-03T22:26:04.633 INFO:teuthology.orchestra.run.smithi160.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 419 kB/s | 35 kB 00:00 2024-05-03T22:26:04.642 INFO:teuthology.orchestra.run.smithi060.stdout:(18/152): ceph-test-19.0.0-3450.g9a047fe7.el9.x 11 MB/s | 49 MB 00:04 2024-05-03T22:26:04.692 INFO:teuthology.orchestra.run.smithi060.stdout:(19/152): python3-ceph-argparse-19.0.0-3450.g9a 925 kB/s | 45 kB 00:00 2024-05-03T22:26:04.759 INFO:teuthology.orchestra.run.smithi160.stdout:(81/152): python3-babel-2.9.1-2.el9.noarch.rpm 10 MB/s | 6.0 MB 00:00 2024-05-03T22:26:04.800 INFO:teuthology.orchestra.run.smithi160.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-05-03T22:26:04.859 INFO:teuthology.orchestra.run.smithi160.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-05-03T22:26:04.893 INFO:teuthology.orchestra.run.smithi160.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 848 kB/s | 77 kB 00:00 2024-05-03T22:26:04.926 INFO:teuthology.orchestra.run.smithi060.stdout:(20/152): ceph-osd-19.0.0-3450.g9a047fe7.el9.x8 2.5 MB/s | 17 MB 00:06 2024-05-03T22:26:04.943 INFO:teuthology.orchestra.run.smithi160.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 511 kB/s | 42 kB 00:00 2024-05-03T22:26:04.960 INFO:teuthology.orchestra.run.smithi060.stdout:(21/152): python3-ceph-common-19.0.0-3450.g9a04 509 kB/s | 135 kB 00:00 2024-05-03T22:26:04.993 INFO:teuthology.orchestra.run.smithi160.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 2.7 MB/s | 269 kB 00:00 2024-05-03T22:26:05.044 INFO:teuthology.orchestra.run.smithi160.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-05-03T22:26:05.085 INFO:teuthology.orchestra.run.smithi060.stdout:(22/152): librgw2-19.0.0-3450.g9a047fe7.el9.x86 3.7 MB/s | 5.4 MB 00:01 2024-05-03T22:26:05.086 INFO:teuthology.orchestra.run.smithi160.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-05-03T22:26:05.119 INFO:teuthology.orchestra.run.smithi060.stdout:(23/152): python3-cephfs-19.0.0-3450.g9a047fe7. 845 kB/s | 161 kB 00:00 2024-05-03T22:26:05.136 INFO:teuthology.orchestra.run.smithi160.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 560 kB/s | 51 kB 00:00 2024-05-03T22:26:05.152 INFO:teuthology.orchestra.run.smithi060.stdout:(24/152): python3-rados-19.0.0-3450.g9a047fe7.e 1.6 MB/s | 320 kB 00:00 2024-05-03T22:26:05.161 INFO:teuthology.orchestra.run.smithi160.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 722 kB/s | 54 kB 00:00 2024-05-03T22:26:05.186 INFO:teuthology.orchestra.run.smithi060.stdout:(25/152): python3-rbd-19.0.0-3450.g9a047fe7.el9 2.9 MB/s | 298 kB 00:00 2024-05-03T22:26:05.211 INFO:teuthology.orchestra.run.smithi060.stdout:(26/152): python3-rgw-19.0.0-3450.g9a047fe7.el9 1.1 MB/s | 100 kB 00:00 2024-05-03T22:26:05.236 INFO:teuthology.orchestra.run.smithi060.stdout:(27/152): rbd-fuse-19.0.0-3450.g9a047fe7.el9.x8 1.0 MB/s | 85 kB 00:00 2024-05-03T22:26:05.270 INFO:teuthology.orchestra.run.smithi060.stdout:(28/152): rbd-nbd-19.0.0-3450.g9a047fe7.el9.x86 2.9 MB/s | 170 kB 00:00 2024-05-03T22:26:05.278 INFO:teuthology.orchestra.run.smithi160.stdout:(91/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 7.4 MB/s | 5.1 MB 00:00 2024-05-03T22:26:05.295 INFO:teuthology.orchestra.run.smithi060.stdout:(29/152): ceph-grafana-dashboards-19.0.0-3450.g 592 kB/s | 34 kB 00:00 2024-05-03T22:26:05.329 INFO:teuthology.orchestra.run.smithi060.stdout:(30/152): ceph-mgr-cephadm-19.0.0-3450.g9a047fe 2.4 MB/s | 142 kB 00:00 2024-05-03T22:26:05.337 INFO:teuthology.orchestra.run.smithi160.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 238 kB/s | 42 kB 00:00 2024-05-03T22:26:05.362 INFO:teuthology.orchestra.run.smithi160.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 533 kB/s | 44 kB 00:00 2024-05-03T22:26:05.421 INFO:teuthology.orchestra.run.smithi160.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-05-03T22:26:05.446 INFO:teuthology.orchestra.run.smithi160.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 434 kB/s | 36 kB 00:00 2024-05-03T22:26:05.496 INFO:teuthology.orchestra.run.smithi160.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 637 kB/s | 47 kB 00:00 2024-05-03T22:26:05.538 INFO:teuthology.orchestra.run.smithi160.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 3.3 MB/s | 305 kB 00:00 2024-05-03T22:26:05.588 INFO:teuthology.orchestra.run.smithi160.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 635 kB/s | 58 kB 00:00 2024-05-03T22:26:05.612 INFO:teuthology.orchestra.run.smithi060.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3450.g9a047 11 MB/s | 3.5 MB 00:00 2024-05-03T22:26:05.614 INFO:teuthology.orchestra.run.smithi160.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.2 MB/s | 94 kB 00:00 2024-05-03T22:26:05.664 INFO:teuthology.orchestra.run.smithi160.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 856 kB/s | 64 kB 00:00 2024-05-03T22:26:05.679 INFO:teuthology.orchestra.run.smithi060.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3450.g9a 4.1 MB/s | 274 kB 00:00 2024-05-03T22:26:05.689 INFO:teuthology.orchestra.run.smithi160.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 603 kB/s | 45 kB 00:00 2024-05-03T22:26:05.730 INFO:teuthology.orchestra.run.smithi060.stdout:(33/152): ceph-mgr-rook-19.0.0-3450.g9a047fe7.e 1.0 MB/s | 49 kB 00:00 2024-05-03T22:26:05.756 INFO:teuthology.orchestra.run.smithi160.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 245 kB/s | 22 kB 00:00 2024-05-03T22:26:05.780 INFO:teuthology.orchestra.run.smithi060.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3450.g9 335 kB/s | 16 kB 00:00 2024-05-03T22:26:05.839 INFO:teuthology.orchestra.run.smithi060.stdout:(35/152): ceph-volume-19.0.0-3450.g9a047fe7.el9 4.6 MB/s | 273 kB 00:00 2024-05-03T22:26:05.907 INFO:teuthology.orchestra.run.smithi160.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 3.9 MB/s | 863 kB 00:00 2024-05-03T22:26:05.939 INFO:teuthology.orchestra.run.smithi060.stdout:(36/152): cephadm-19.0.0-3450.g9a047fe7.el9.noa 7.5 MB/s | 763 kB 00:00 2024-05-03T22:26:05.989 INFO:teuthology.orchestra.run.smithi060.stdout:(37/152): cephfs-top-19.0.0-3450.g9a047fe7.el9. 371 kB/s | 18 kB 00:00 2024-05-03T22:26:06.098 INFO:teuthology.orchestra.run.smithi060.stdout:(38/152): rbd-mirror-19.0.0-3450.g9a047fe7.el9. 3.5 MB/s | 3.1 MB 00:00 2024-05-03T22:26:06.115 INFO:teuthology.orchestra.run.smithi160.stdout:(104/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-05-03T22:26:06.140 INFO:teuthology.orchestra.run.smithi060.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 537 kB/s | 80 kB 00:00 2024-05-03T22:26:06.382 INFO:teuthology.orchestra.run.smithi160.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 73 kB/s | 19 kB 00:00 2024-05-03T22:26:06.383 INFO:teuthology.orchestra.run.smithi060.stdout:(40/152): libquadmath-11.4.1-3.el9.x86_64.rpm 810 kB/s | 195 kB 00:00 2024-05-03T22:26:06.491 INFO:teuthology.orchestra.run.smithi160.stdout:(106/152): abseil-cpp-20211102.0-3.el9.x86_64.r 747 kB/s | 548 kB 00:00 2024-05-03T22:26:06.516 INFO:teuthology.orchestra.run.smithi060.stdout:(41/152): ceph-mgr-diskprediction-local-19.0.0- 6.2 MB/s | 7.4 MB 00:01 2024-05-03T22:26:06.550 INFO:teuthology.orchestra.run.smithi060.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-05-03T22:26:06.592 INFO:teuthology.orchestra.run.smithi060.stdout:(43/152): libgfortran-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 803 kB 00:00 2024-05-03T22:26:06.616 INFO:teuthology.orchestra.run.smithi160.stdout:(107/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 209 kB/s | 26 kB 00:00 2024-05-03T22:26:06.617 INFO:teuthology.orchestra.run.smithi060.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-05-03T22:26:06.649 INFO:teuthology.orchestra.run.smithi160.stdout:(108/152): gperftools-libs-2.9.1-2.el9.x86_64.r 416 kB/s | 309 kB 00:00 2024-05-03T22:26:06.651 INFO:teuthology.orchestra.run.smithi060.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-05-03T22:26:06.676 INFO:teuthology.orchestra.run.smithi060.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-05-03T22:26:06.726 INFO:teuthology.orchestra.run.smithi060.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-05-03T22:26:06.733 INFO:teuthology.orchestra.run.smithi160.stdout:(109/152): liboath-2.6.7-2.el9.x86_64.rpm 418 kB/s | 49 kB 00:00 2024-05-03T22:26:06.767 INFO:teuthology.orchestra.run.smithi160.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 579 kB/s | 67 kB 00:00 2024-05-03T22:26:06.852 INFO:teuthology.orchestra.run.smithi060.stdout:(48/152): python3-cryptography-36.0.1-4.el9.x86 3.7 MB/s | 1.2 MB 00:00 2024-05-03T22:26:06.859 INFO:teuthology.orchestra.run.smithi160.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-05-03T22:26:06.992 INFO:teuthology.orchestra.run.smithi160.stdout:(112/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.6 MB/s | 839 kB 00:00 2024-05-03T22:26:07.018 INFO:teuthology.orchestra.run.smithi060.stdout:(49/152): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 689 kB 00:00 2024-05-03T22:26:07.044 INFO:teuthology.orchestra.run.smithi060.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 559 kB/s | 107 kB 00:00 2024-05-03T22:26:07.068 INFO:teuthology.orchestra.run.smithi160.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 2.6 MB/s | 548 kB 00:00 2024-05-03T22:26:07.086 INFO:teuthology.orchestra.run.smithi060.stdout:(51/152): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 943 kB 00:00 2024-05-03T22:26:07.111 INFO:teuthology.orchestra.run.smithi060.stdout:(52/152): elfutils-libelf-devel-0.190-2.el9.x86 234 kB/s | 21 kB 00:00 2024-05-03T22:26:07.145 INFO:teuthology.orchestra.run.smithi060.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 567 kB/s | 33 kB 00:00 2024-05-03T22:26:07.160 INFO:teuthology.orchestra.run.smithi160.stdout:(114/152): libarrow-9.0.0-11.el9.x86_64.rpm 5.7 MB/s | 4.4 MB 00:00 2024-05-03T22:26:07.176 INFO:teuthology.orchestra.run.smithi160.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 237 kB/s | 43 kB 00:00 2024-05-03T22:26:07.178 INFO:teuthology.orchestra.run.smithi060.stdout:(54/152): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-05-03T22:26:07.193 INFO:teuthology.orchestra.run.smithi160.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 258 kB/s | 32 kB 00:00 2024-05-03T22:26:07.220 INFO:teuthology.orchestra.run.smithi060.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 247 kB/s | 18 kB 00:00 2024-05-03T22:26:07.246 INFO:teuthology.orchestra.run.smithi060.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-05-03T22:26:07.269 INFO:teuthology.orchestra.run.smithi160.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 139 kB/s | 15 kB 00:00 2024-05-03T22:26:07.279 INFO:teuthology.orchestra.run.smithi060.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-05-03T22:26:07.305 INFO:teuthology.orchestra.run.smithi060.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 781 kB/s | 45 kB 00:00 2024-05-03T22:26:07.319 INFO:teuthology.orchestra.run.smithi160.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-05-03T22:26:07.327 INFO:teuthology.orchestra.run.smithi044.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-03T22:26:07.353 INFO:teuthology.orchestra.run.smithi160.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 2.2 MB/s | 358 kB 00:00 2024-05-03T22:26:07.363 INFO:teuthology.orchestra.run.smithi060.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 662 kB 00:00 2024-05-03T22:26:07.403 INFO:teuthology.orchestra.run.smithi160.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-05-03T22:26:07.428 INFO:teuthology.orchestra.run.smithi160.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 325 kB/s | 35 kB 00:00 2024-05-03T22:26:07.472 INFO:teuthology.orchestra.run.smithi060.stdout:(60/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.3 MB/s | 3.0 MB 00:00 2024-05-03T22:26:07.478 INFO:teuthology.orchestra.run.smithi160.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 1.6 MB/s | 206 kB 00:00 2024-05-03T22:26:07.497 INFO:teuthology.orchestra.run.smithi060.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 191 kB/s | 25 kB 00:00 2024-05-03T22:26:07.531 INFO:teuthology.orchestra.run.smithi060.stdout:(62/152): libtool-2.4.6-45.el9.x86_64.rpm 2.5 MB/s | 582 kB 00:00 2024-05-03T22:26:07.545 INFO:teuthology.orchestra.run.smithi160.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-05-03T22:26:07.556 INFO:teuthology.orchestra.run.smithi060.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 571 kB/s | 47 kB 00:00 2024-05-03T22:26:07.590 INFO:teuthology.orchestra.run.smithi060.stdout:(64/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-05-03T22:26:07.604 INFO:teuthology.orchestra.run.smithi160.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 86 kB/s | 11 kB 00:00 2024-05-03T22:26:07.615 INFO:teuthology.orchestra.run.smithi060.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 605 kB/s | 35 kB 00:00 2024-05-03T22:26:07.649 INFO:teuthology.orchestra.run.smithi060.stdout:(66/152): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-05-03T22:26:07.671 INFO:teuthology.orchestra.run.smithi160.stdout:(125/152): python3-grpcio-1.46.7-10.el9.x86_64. 7.6 MB/s | 2.0 MB 00:00 2024-05-03T22:26:07.696 INFO:teuthology.orchestra.run.smithi160.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 118 kB/s | 18 kB 00:00 2024-05-03T22:26:07.722 INFO:teuthology.orchestra.run.smithi160.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 199 kB/s | 23 kB 00:00 2024-05-03T22:26:07.772 INFO:teuthology.orchestra.run.smithi160.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 195 kB/s | 19 kB 00:00 2024-05-03T22:26:07.797 INFO:teuthology.orchestra.run.smithi160.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 197 kB/s | 20 kB 00:00 2024-05-03T22:26:07.807 INFO:teuthology.orchestra.run.smithi060.stdout:(67/152): openblas-openmp-0.3.21-2.el9.x86_64.r 22 MB/s | 4.7 MB 00:00 2024-05-03T22:26:07.874 INFO:teuthology.orchestra.run.smithi060.stdout:(68/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-05-03T22:26:07.897 INFO:teuthology.orchestra.run.smithi160.stdout:(130/152): python3-more-itertools-8.12.0-2.el9. 792 kB/s | 79 kB 00:00 2024-05-03T22:26:07.933 INFO:teuthology.orchestra.run.smithi060.stdout:(69/152): postgresql-13.14-1.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-05-03T22:26:07.948 INFO:teuthology.orchestra.run.smithi160.stdout:(131/152): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2024-05-03T22:26:07.967 INFO:teuthology.orchestra.run.smithi060.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-05-03T22:26:07.973 INFO:teuthology.orchestra.run.smithi160.stdout:(132/152): python3-logutils-0.3.5-21.el9.noarch 232 kB/s | 46 kB 00:00 2024-05-03T22:26:08.017 INFO:teuthology.orchestra.run.smithi060.stdout:(71/152): postgresql-contrib-13.14-1.el9.x86_64 4.3 MB/s | 911 kB 00:00 2024-05-03T22:26:08.023 INFO:teuthology.orchestra.run.smithi160.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 463 kB/s | 58 kB 00:00 2024-05-03T22:26:08.090 INFO:teuthology.orchestra.run.smithi160.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-05-03T22:26:08.100 INFO:teuthology.orchestra.run.smithi060.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-05-03T22:26:08.116 INFO:teuthology.orchestra.run.smithi160.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 116 kB/s | 16 kB 00:00 2024-05-03T22:26:08.126 INFO:teuthology.orchestra.run.smithi060.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 812 kB/s | 87 kB 00:00 2024-05-03T22:26:08.141 INFO:teuthology.orchestra.run.smithi160.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 771 kB/s | 90 kB 00:00 2024-05-03T22:26:08.193 INFO:teuthology.orchestra.run.smithi060.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2024-05-03T22:26:08.208 INFO:teuthology.orchestra.run.smithi160.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 242 kB/s | 28 kB 00:00 2024-05-03T22:26:08.268 INFO:teuthology.orchestra.run.smithi060.stdout:(75/152): python3-jinja2-2.11.3-5.el9.noarch.rp 3.3 MB/s | 248 kB 00:00 2024-05-03T22:26:08.274 INFO:teuthology.orchestra.run.smithi160.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 194 kB/s | 31 kB 00:00 2024-05-03T22:26:08.299 INFO:teuthology.orchestra.run.smithi160.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-05-03T22:26:08.362 INFO:teuthology.orchestra.run.smithi160.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 507 kB/s | 59 kB 00:00 2024-05-03T22:26:08.375 INFO:teuthology.orchestra.run.smithi160.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 358 kB/s | 36 kB 00:00 2024-05-03T22:26:08.377 INFO:teuthology.orchestra.run.smithi060.stdout:(76/152): python3-jsonpatch-1.21-16.el9.noarch. 238 kB/s | 26 kB 00:00 2024-05-03T22:26:08.468 INFO:teuthology.orchestra.run.smithi160.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-05-03T22:26:08.492 INFO:teuthology.orchestra.run.smithi160.stdout:(143/152): python3-typing-extensions-4.4.0-2.el 265 kB/s | 51 kB 00:00 2024-05-03T22:26:08.494 INFO:teuthology.orchestra.run.smithi060.stdout:(77/152): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-05-03T22:26:08.518 INFO:teuthology.orchestra.run.smithi160.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 633 kB/s | 90 kB 00:00 2024-05-03T22:26:08.519 INFO:teuthology.orchestra.run.smithi060.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 136 kB/s | 19 kB 00:00 2024-05-03T22:26:08.601 INFO:teuthology.orchestra.run.smithi160.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-05-03T22:26:08.627 INFO:teuthology.orchestra.run.smithi160.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 150 kB/s | 20 kB 00:00 2024-05-03T22:26:08.654 INFO:teuthology.orchestra.run.smithi060.stdout:(79/152): postgresql-server-13.14-1.el9.x86_64. 8.0 MB/s | 5.8 MB 00:00 2024-05-03T22:26:08.660 INFO:teuthology.orchestra.run.smithi160.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2024-05-03T22:26:08.686 INFO:teuthology.orchestra.run.smithi060.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 900 kB/s | 172 kB 00:00 2024-05-03T22:26:08.711 INFO:teuthology.orchestra.run.smithi060.stdout:(81/152): python3-markupsafe-1.1.1-12.el9.x86_6 181 kB/s | 35 kB 00:00 2024-05-03T22:26:08.778 INFO:teuthology.orchestra.run.smithi060.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-05-03T22:26:08.812 INFO:teuthology.orchestra.run.smithi060.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-05-03T22:26:08.837 INFO:teuthology.orchestra.run.smithi060.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-03T22:26:08.871 INFO:teuthology.orchestra.run.smithi060.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 722 kB/s | 42 kB 00:00 2024-05-03T22:26:08.905 INFO:teuthology.orchestra.run.smithi060.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 269 kB 00:00 2024-05-03T22:26:08.938 INFO:teuthology.orchestra.run.smithi060.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-05-03T22:26:08.952 INFO:teuthology.orchestra.run.smithi160.stdout:(148/152): librbd1-19.0.0-3450.g9a047fe7.el9.x8 11 MB/s | 3.1 MB 00:00 2024-05-03T22:26:08.972 INFO:teuthology.orchestra.run.smithi060.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-05-03T22:26:08.997 INFO:teuthology.orchestra.run.smithi060.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 883 kB/s | 51 kB 00:00 2024-05-03T22:26:09.002 INFO:teuthology.orchestra.run.smithi160.stdout:(149/152): thrift-0.15.0-2.el9.x86_64.rpm 4.0 MB/s | 1.6 MB 00:00 2024-05-03T22:26:09.031 INFO:teuthology.orchestra.run.smithi060.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 926 kB/s | 54 kB 00:00 2024-05-03T22:26:09.089 INFO:teuthology.orchestra.run.smithi060.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 723 kB/s | 42 kB 00:00 2024-05-03T22:26:09.119 INFO:teuthology.orchestra.run.smithi160.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 8.1 MB/s | 1.3 MB 00:00 2024-05-03T22:26:09.198 INFO:teuthology.orchestra.run.smithi060.stdout:(92/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.4 MB/s | 5.1 MB 00:00 2024-05-03T22:26:09.223 INFO:teuthology.orchestra.run.smithi060.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 332 kB/s | 44 kB 00:00 2024-05-03T22:26:09.261 INFO:teuthology.orchestra.run.smithi160.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 9.3 MB/s | 2.4 MB 00:00 2024-05-03T22:26:09.265 INFO:teuthology.orchestra.run.smithi060.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.3 MB/s | 221 kB 00:00 2024-05-03T22:26:09.291 INFO:teuthology.orchestra.run.smithi060.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 542 kB/s | 36 kB 00:00 2024-05-03T22:26:09.324 INFO:teuthology.orchestra.run.smithi060.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 821 kB/s | 47 kB 00:00 2024-05-03T22:26:09.358 INFO:teuthology.orchestra.run.smithi060.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-05-03T22:26:09.392 INFO:teuthology.orchestra.run.smithi060.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 872 kB/s | 58 kB 00:00 2024-05-03T22:26:09.417 INFO:teuthology.orchestra.run.smithi060.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-05-03T22:26:09.459 INFO:teuthology.orchestra.run.smithi060.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 966 kB/s | 64 kB 00:00 2024-05-03T22:26:09.484 INFO:teuthology.orchestra.run.smithi060.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 676 kB/s | 45 kB 00:00 2024-05-03T22:26:09.517 INFO:teuthology.orchestra.run.smithi060.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 386 kB/s | 22 kB 00:00 2024-05-03T22:26:09.585 INFO:teuthology.orchestra.run.smithi060.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 8.5 MB/s | 863 kB 00:00 2024-05-03T22:26:09.653 INFO:teuthology.orchestra.run.smithi160.stdout:(152/152): librados2-19.0.0-3450.g9a047fe7.el9. 3.3 MB/s | 3.4 MB 00:01 2024-05-03T22:26:09.662 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-05-03T22:26:09.662 INFO:teuthology.orchestra.run.smithi160.stdout:Total 14 MB/s | 222 MB 00:15 2024-05-03T22:26:09.770 INFO:teuthology.orchestra.run.smithi044.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-03T22:26:09.772 INFO:teuthology.orchestra.run.smithi044.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-03T22:26:09.792 INFO:teuthology.orchestra.run.smithi044.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-03T22:26:09.793 INFO:teuthology.orchestra.run.smithi044.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-03T22:26:09.795 INFO:teuthology.orchestra.run.smithi044.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-03T22:26:09.796 INFO:teuthology.orchestra.run.smithi044.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-03T22:26:09.798 INFO:teuthology.orchestra.run.smithi044.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-03T22:26:09.802 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-03T22:26:09.803 INFO:teuthology.orchestra.run.smithi044.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-03T22:26:09.879 INFO:teuthology.orchestra.run.smithi044.stdout:Dependencies resolved. 2024-05-03T22:26:09.895 INFO:teuthology.orchestra.run.smithi044.stdout:======================================================================================= 2024-05-03T22:26:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: Package Arch Version Repository Size 2024-05-03T22:26:09.896 INFO:teuthology.orchestra.run.smithi044.stdout:======================================================================================= 2024-05-03T22:26:09.896 INFO:teuthology.orchestra.run.smithi044.stdout:Installing: 2024-05-03T22:26:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-03T22:26:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: ceph x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 6.6 k 2024-05-03T22:26:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 5.4 M 2024-05-03T22:26:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 891 k 2024-05-03T22:26:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 145 k 2024-05-03T22:26:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 1.5 M 2024-05-03T22:26:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 142 k 2024-05-03T22:26:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 3.5 M 2024-05-03T22:26:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 7.4 M 2024-05-03T22:26:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 49 k 2024-05-03T22:26:09.896 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 11 M 2024-05-03T22:26:09.897 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 49 M 2024-05-03T22:26:09.897 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 273 k 2024-05-03T22:26:09.897 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 763 k 2024-05-03T22:26:09.897 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 225 k 2024-05-03T22:26:09.897 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-shell x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 27 k 2024-05-03T22:26:09.897 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 18 k 2024-05-03T22:26:09.897 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-03T22:26:09.897 INFO:teuthology.orchestra.run.smithi044.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-03T22:26:09.897 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-03T22:26:09.897 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 32 k 2024-05-03T22:26:09.897 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 747 k 2024-05-03T22:26:09.897 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 127 k 2024-05-03T22:26:09.897 INFO:teuthology.orchestra.run.smithi044.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-03T22:26:09.897 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-03T22:26:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-03T22:26:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-03T22:26:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-03T22:26:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-03T22:26:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 161 k 2024-05-03T22:26:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 320 k 2024-05-03T22:26:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 298 k 2024-05-03T22:26:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 100 k 2024-05-03T22:26:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 85 k 2024-05-03T22:26:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.1 M 2024-05-03T22:26:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 170 k 2024-05-03T22:26:09.898 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-03T22:26:09.898 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrading: 2024-05-03T22:26:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: librados2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.4 M 2024-05-03T22:26:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 3.1 M 2024-05-03T22:26:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-03T22:26:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-03T22:26:09.899 INFO:teuthology.orchestra.run.smithi044.stdout:Installing dependencies: 2024-05-03T22:26:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-03T22:26:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-03T22:26:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-03T22:26:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 21 M 2024-05-03T22:26:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 34 k 2024-05-03T22:26:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 2.4 M 2024-05-03T22:26:09.899 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 274 k 2024-05-03T22:26:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 4.7 M 2024-05-03T22:26:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 17 M 2024-05-03T22:26:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3450.g9a047fe7.el9 ceph-noarch 16 k 2024-05-03T22:26:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 25 k 2024-05-03T22:26:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-03T22:26:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-03T22:26:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-03T22:26:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-03T22:26:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-03T22:26:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-03T22:26:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-03T22:26:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-03T22:26:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 163 k 2024-05-03T22:26:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-03T22:26:09.900 INFO:teuthology.orchestra.run.smithi044.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-03T22:26:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-03T22:26:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-03T22:26:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-03T22:26:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 500 k 2024-05-03T22:26:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-03T22:26:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2 x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 5.4 M 2024-05-03T22:26:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-03T22:26:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-03T22:26:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-03T22:26:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-03T22:26:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-03T22:26:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-03T22:26:09.901 INFO:teuthology.orchestra.run.smithi044.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-03T22:26:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-03T22:26:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-03T22:26:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-03T22:26:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-03T22:26:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-03T22:26:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-03T22:26:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-03T22:26:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-03T22:26:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-03T22:26:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-03T22:26:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 45 k 2024-05-03T22:26:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common x86_64 2:19.0.0-3450.g9a047fe7.el9 ceph 135 k 2024-05-03T22:26:09.902 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-03T22:26:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-03T22:26:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-03T22:26:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-03T22:26:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-03T22:26:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-03T22:26:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-03T22:26:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-03T22:26:09.903 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-03T22:26:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-03T22:26:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-03T22:26:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-03T22:26:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-03T22:26:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-03T22:26:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-03T22:26:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-03T22:26:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-03T22:26:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-03T22:26:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-03T22:26:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-03T22:26:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-03T22:26:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-03T22:26:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-03T22:26:09.904 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-03T22:26:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-03T22:26:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-03T22:26:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-03T22:26:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-03T22:26:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-03T22:26:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-03T22:26:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-03T22:26:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-03T22:26:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-03T22:26:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-03T22:26:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-03T22:26:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-03T22:26:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-03T22:26:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-03T22:26:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-03T22:26:09.905 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-03T22:26:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-03T22:26:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-03T22:26:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-03T22:26:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-03T22:26:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-03T22:26:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-03T22:26:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-03T22:26:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-03T22:26:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-03T22:26:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-03T22:26:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-03T22:26:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-03T22:26:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-03T22:26:09.906 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-03T22:26:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-03T22:26:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-03T22:26:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-03T22:26:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-03T22:26:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-03T22:26:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-03T22:26:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-03T22:26:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-03T22:26:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-03T22:26:09.907 INFO:teuthology.orchestra.run.smithi044.stdout:Installing weak dependencies: 2024-05-03T22:26:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-03T22:26:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:26:09.907 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction Summary 2024-05-03T22:26:09.907 INFO:teuthology.orchestra.run.smithi044.stdout:======================================================================================= 2024-05-03T22:26:09.907 INFO:teuthology.orchestra.run.smithi044.stdout:Install 148 Packages 2024-05-03T22:26:09.907 INFO:teuthology.orchestra.run.smithi044.stdout:Upgrade 4 Packages 2024-05-03T22:26:09.907 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:26:09.908 INFO:teuthology.orchestra.run.smithi044.stdout:Total download size: 222 M 2024-05-03T22:26:09.908 INFO:teuthology.orchestra.run.smithi044.stdout:Downloading Packages: 2024-05-03T22:26:09.943 INFO:teuthology.orchestra.run.smithi060.stdout:(104/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-05-03T22:26:09.977 INFO:teuthology.orchestra.run.smithi060.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 790 kB/s | 309 kB 00:00 2024-05-03T22:26:10.036 INFO:teuthology.orchestra.run.smithi060.stdout:(106/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-05-03T22:26:10.069 INFO:teuthology.orchestra.run.smithi060.stdout:(107/152): grpc-data-1.46.7-10.el9.noarch.rpm 156 kB/s | 19 kB 00:00 2024-05-03T22:26:10.095 INFO:teuthology.orchestra.run.smithi060.stdout:(108/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 451 kB/s | 26 kB 00:00 2024-05-03T22:26:10.162 INFO:teuthology.orchestra.run.smithi060.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-05-03T22:26:10.187 INFO:teuthology.orchestra.run.smithi060.stdout:(110/152): liboath-2.6.7-2.el9.x86_64.rpm 417 kB/s | 49 kB 00:00 2024-05-03T22:26:10.245 INFO:teuthology.orchestra.run.smithi060.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-05-03T22:26:10.354 INFO:teuthology.orchestra.run.smithi060.stdout:(112/152): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-05-03T22:26:10.396 INFO:teuthology.orchestra.run.smithi060.stdout:(113/152): python3-asyncssh-2.13.2-5.el9.noarch 3.6 MB/s | 548 kB 00:00 2024-05-03T22:26:10.413 INFO:teuthology.orchestra.run.smithi060.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 759 kB/s | 43 kB 00:00 2024-05-03T22:26:10.447 INFO:teuthology.orchestra.run.smithi060.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 655 kB/s | 32 kB 00:00 2024-05-03T22:26:10.464 INFO:teuthology.orchestra.run.smithi060.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 298 kB/s | 15 kB 00:00 2024-05-03T22:26:10.505 INFO:teuthology.orchestra.run.smithi060.stdout:(117/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.6 MB/s | 839 kB 00:00 2024-05-03T22:26:10.539 INFO:teuthology.orchestra.run.smithi060.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-05-03T22:26:10.573 INFO:teuthology.orchestra.run.smithi060.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-05-03T22:26:10.598 INFO:teuthology.orchestra.run.smithi060.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 611 kB/s | 35 kB 00:00 2024-05-03T22:26:10.640 INFO:teuthology.orchestra.run.smithi060.stdout:(121/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-05-03T22:26:10.674 INFO:teuthology.orchestra.run.smithi060.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 2.0 MB/s | 206 kB 00:00 2024-05-03T22:26:10.716 INFO:teuthology.orchestra.run.smithi060.stdout:(123/152): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-05-03T22:26:10.741 INFO:teuthology.orchestra.run.smithi060.stdout:(124/152): python3-jaraco-8.2.1-3.el9.noarch.rp 162 kB/s | 11 kB 00:00 2024-05-03T22:26:10.775 INFO:teuthology.orchestra.run.smithi060.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 306 kB/s | 18 kB 00:00 2024-05-03T22:26:10.800 INFO:teuthology.orchestra.run.smithi060.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 401 kB/s | 23 kB 00:00 2024-05-03T22:26:10.834 INFO:teuthology.orchestra.run.smithi060.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 338 kB/s | 19 kB 00:00 2024-05-03T22:26:10.859 INFO:teuthology.orchestra.run.smithi060.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 339 kB/s | 20 kB 00:00 2024-05-03T22:26:10.943 INFO:teuthology.orchestra.run.smithi060.stdout:(129/152): python3-grpcio-1.46.7-10.el9.x86_64. 5.9 MB/s | 2.0 MB 00:00 2024-05-03T22:26:10.968 INFO:teuthology.orchestra.run.smithi060.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 429 kB/s | 46 kB 00:00 2024-05-03T22:26:11.018 INFO:teuthology.orchestra.run.smithi060.stdout:(131/152): python3-kubernetes-26.1.0-2.el9.noar 5.6 MB/s | 1.0 MB 00:00 2024-05-03T22:26:11.044 INFO:teuthology.orchestra.run.smithi060.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 791 kB/s | 79 kB 00:00 2024-05-03T22:26:11.069 INFO:teuthology.orchestra.run.smithi060.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 578 kB/s | 58 kB 00:00 2024-05-03T22:26:11.102 INFO:teuthology.orchestra.run.smithi060.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-05-03T22:26:11.152 INFO:teuthology.orchestra.run.smithi060.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 201 kB/s | 16 kB 00:00 2024-05-03T22:26:11.178 INFO:teuthology.orchestra.run.smithi060.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 379 kB/s | 28 kB 00:00 2024-05-03T22:26:11.203 INFO:teuthology.orchestra.run.smithi060.stdout:(137/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 676 kB/s | 90 kB 00:00 2024-05-03T22:26:11.212 INFO:teuthology.orchestra.run.smithi044.stdout:(1/152): ceph-19.0.0-3450.g9a047fe7.el9.x86_64. 25 kB/s | 6.6 kB 00:00 2024-05-03T22:26:11.228 INFO:teuthology.orchestra.run.smithi060.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-05-03T22:26:11.262 INFO:teuthology.orchestra.run.smithi060.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-05-03T22:26:11.287 INFO:teuthology.orchestra.run.smithi060.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 618 kB/s | 36 kB 00:00 2024-05-03T22:26:11.313 INFO:teuthology.orchestra.run.smithi060.stdout:(141/152): python3-rsa-4.9-2.el9.noarch.rpm 545 kB/s | 59 kB 00:00 2024-05-03T22:26:11.338 INFO:teuthology.orchestra.run.smithi060.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 683 kB/s | 51 kB 00:00 2024-05-03T22:26:11.371 INFO:teuthology.orchestra.run.smithi060.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-05-03T22:26:11.471 INFO:teuthology.orchestra.run.smithi044.stdout:(2/152): ceph-fuse-19.0.0-3450.g9a047fe7.el9.x8 3.4 MB/s | 891 kB 00:00 2024-05-03T22:26:11.514 INFO:teuthology.orchestra.run.smithi060.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 447 kB/s | 90 kB 00:00 2024-05-03T22:26:11.521 INFO:teuthology.orchestra.run.smithi044.stdout:(3/152): ceph-immutable-object-cache-19.0.0-345 2.9 MB/s | 145 kB 00:00 2024-05-03T22:26:11.664 INFO:teuthology.orchestra.run.smithi060.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 69 kB/s | 20 kB 00:00 2024-05-03T22:26:11.698 INFO:teuthology.orchestra.run.smithi060.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 1.0 MB/s | 192 kB 00:00 2024-05-03T22:26:11.731 INFO:teuthology.orchestra.run.smithi060.stdout:(147/152): python3-werkzeug-2.0.3-3.el9.1.noarc 1.1 MB/s | 427 kB 00:00 2024-05-03T22:26:11.846 INFO:teuthology.orchestra.run.smithi044.stdout:(4/152): ceph-mds-19.0.0-3450.g9a047fe7.el9.x86 7.3 MB/s | 2.4 MB 00:00 2024-05-03T22:26:11.881 INFO:teuthology.orchestra.run.smithi060.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 7.3 MB/s | 1.6 MB 00:00 2024-05-03T22:26:11.980 INFO:teuthology.orchestra.run.smithi044.stdout:(5/152): ceph-base-19.0.0-3450.g9a047fe7.el9.x8 5.2 MB/s | 5.4 MB 00:01 2024-05-03T22:26:12.099 INFO:teuthology.orchestra.run.smithi060.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 6.2 MB/s | 1.3 MB 00:00 2024-05-03T22:26:12.155 INFO:teuthology.orchestra.run.smithi044.stdout:(6/152): ceph-mgr-19.0.0-3450.g9a047fe7.el9.x86 4.9 MB/s | 1.5 MB 00:00 2024-05-03T22:26:12.182 INFO:teuthology.orchestra.run.smithi060.stdout:(150/152): librbd1-19.0.0-3450.g9a047fe7.el9.x8 7.0 MB/s | 3.1 MB 00:00 2024-05-03T22:26:12.399 INFO:teuthology.orchestra.run.smithi060.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 8.0 MB/s | 2.4 MB 00:00 2024-05-03T22:26:12.514 INFO:teuthology.orchestra.run.smithi044.stdout:(7/152): ceph-mon-19.0.0-3450.g9a047fe7.el9.x86 8.8 MB/s | 4.7 MB 00:00 2024-05-03T22:26:12.517 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-05-03T22:26:12.751 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-05-03T22:26:12.751 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-05-03T22:26:12.999 INFO:teuthology.orchestra.run.smithi060.stdout:(152/152): librados2-19.0.0-3450.g9a047fe7.el9. 2.6 MB/s | 3.4 MB 00:01 2024-05-03T22:26:13.006 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-05-03T22:26:13.006 INFO:teuthology.orchestra.run.smithi060.stdout:Total 13 MB/s | 222 MB 00:17 2024-05-03T22:26:13.606 INFO:teuthology.orchestra.run.smithi044.stdout:(8/152): ceph-radosgw-19.0.0-3450.g9a047fe7.el9 9.7 MB/s | 11 MB 00:01 2024-05-03T22:26:13.673 INFO:teuthology.orchestra.run.smithi044.stdout:(9/152): ceph-selinux-19.0.0-3450.g9a047fe7.el9 383 kB/s | 25 kB 00:00 2024-05-03T22:26:13.981 INFO:teuthology.orchestra.run.smithi044.stdout:(10/152): ceph-osd-19.0.0-3450.g9a047fe7.el9.x8 9.2 MB/s | 17 MB 00:01 2024-05-03T22:26:14.073 INFO:teuthology.orchestra.run.smithi044.stdout:(11/152): cephfs-mirror-19.0.0-3450.g9a047fe7.e 2.4 MB/s | 225 kB 00:00 2024-05-03T22:26:14.140 INFO:teuthology.orchestra.run.smithi044.stdout:(12/152): cephfs-shell-19.0.0-3450.g9a047fe7.el 411 kB/s | 27 kB 00:00 2024-05-03T22:26:14.199 INFO:teuthology.orchestra.run.smithi044.stdout:(13/152): libcephfs-devel-19.0.0-3450.g9a047fe7 551 kB/s | 32 kB 00:00 2024-05-03T22:26:14.362 INFO:teuthology.orchestra.run.smithi044.stdout:(14/152): libcephfs2-19.0.0-3450.g9a047fe7.el9. 4.5 MB/s | 747 kB 00:00 2024-05-03T22:26:14.450 INFO:teuthology.orchestra.run.smithi044.stdout:(15/152): libcephsqlite-19.0.0-3450.g9a047fe7.e 1.8 MB/s | 163 kB 00:00 2024-05-03T22:26:14.517 INFO:teuthology.orchestra.run.smithi044.stdout:(16/152): librados-devel-19.0.0-3450.g9a047fe7. 1.9 MB/s | 127 kB 00:00 2024-05-03T22:26:14.617 INFO:teuthology.orchestra.run.smithi044.stdout:(17/152): libradosstriper1-19.0.0-3450.g9a047fe 4.9 MB/s | 500 kB 00:00 2024-05-03T22:26:14.909 INFO:teuthology.orchestra.run.smithi044.stdout:(18/152): ceph-common-19.0.0-3450.g9a047fe7.el9 5.3 MB/s | 21 MB 00:03 2024-05-03T22:26:14.976 INFO:teuthology.orchestra.run.smithi044.stdout:(19/152): python3-ceph-argparse-19.0.0-3450.g9a 698 kB/s | 45 kB 00:00 2024-05-03T22:26:15.059 INFO:teuthology.orchestra.run.smithi044.stdout:(20/152): python3-ceph-common-19.0.0-3450.g9a04 1.6 MB/s | 135 kB 00:00 2024-05-03T22:26:15.185 INFO:teuthology.orchestra.run.smithi044.stdout:(21/152): librgw2-19.0.0-3450.g9a047fe7.el9.x86 9.5 MB/s | 5.4 MB 00:00 2024-05-03T22:26:15.218 INFO:teuthology.orchestra.run.smithi044.stdout:(22/152): python3-cephfs-19.0.0-3450.g9a047fe7. 1.0 MB/s | 161 kB 00:00 2024-05-03T22:26:15.260 INFO:teuthology.orchestra.run.smithi044.stdout:(23/152): python3-rados-19.0.0-3450.g9a047fe7.e 4.2 MB/s | 320 kB 00:00 2024-05-03T22:26:15.290 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-05-03T22:26:15.291 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-05-03T22:26:15.352 INFO:teuthology.orchestra.run.smithi044.stdout:(24/152): python3-rgw-19.0.0-3450.g9a047fe7.el9 1.1 MB/s | 100 kB 00:00 2024-05-03T22:26:15.386 INFO:teuthology.orchestra.run.smithi044.stdout:(25/152): python3-rbd-19.0.0-3450.g9a047fe7.el9 1.8 MB/s | 298 kB 00:00 2024-05-03T22:26:15.411 INFO:teuthology.orchestra.run.smithi044.stdout:(26/152): rbd-fuse-19.0.0-3450.g9a047fe7.el9.x8 1.4 MB/s | 85 kB 00:00 2024-05-03T22:26:15.470 INFO:teuthology.orchestra.run.smithi044.stdout:(27/152): rbd-nbd-19.0.0-3450.g9a047fe7.el9.x86 2.9 MB/s | 170 kB 00:00 2024-05-03T22:26:15.512 INFO:teuthology.orchestra.run.smithi044.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3450.g 840 kB/s | 34 kB 00:00 2024-05-03T22:26:15.579 INFO:teuthology.orchestra.run.smithi044.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3450.g9a047fe 2.1 MB/s | 142 kB 00:00 2024-05-03T22:26:15.863 INFO:teuthology.orchestra.run.smithi044.stdout:(30/152): rbd-mirror-19.0.0-3450.g9a047fe7.el9. 6.5 MB/s | 3.1 MB 00:00 2024-05-03T22:26:15.894 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-05-03T22:26:15.979 INFO:teuthology.orchestra.run.smithi044.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3450.g9a047 8.9 MB/s | 3.5 MB 00:00 2024-05-03T22:26:16.055 INFO:teuthology.orchestra.run.smithi044.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3450.g9a 3.6 MB/s | 274 kB 00:00 2024-05-03T22:26:16.122 INFO:teuthology.orchestra.run.smithi044.stdout:(33/152): ceph-mgr-rook-19.0.0-3450.g9a047fe7.e 754 kB/s | 49 kB 00:00 2024-05-03T22:26:16.145 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-05-03T22:26:16.145 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-05-03T22:26:16.226 INFO:teuthology.orchestra.run.smithi044.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3450.g9 160 kB/s | 16 kB 00:00 2024-05-03T22:26:16.306 INFO:teuthology.orchestra.run.smithi044.stdout:(35/152): ceph-volume-19.0.0-3450.g9a047fe7.el9 3.4 MB/s | 273 kB 00:00 2024-05-03T22:26:16.447 INFO:teuthology.orchestra.run.smithi044.stdout:(36/152): cephadm-19.0.0-3450.g9a047fe7.el9.noa 5.3 MB/s | 763 kB 00:00 2024-05-03T22:26:16.531 INFO:teuthology.orchestra.run.smithi044.stdout:(37/152): cephfs-top-19.0.0-3450.g9a047fe7.el9. 220 kB/s | 18 kB 00:00 2024-05-03T22:26:16.765 INFO:teuthology.orchestra.run.smithi044.stdout:(38/152): fuse-2.9.9-15.el9.x86_64.rpm 346 kB/s | 80 kB 00:00 2024-05-03T22:26:16.882 INFO:teuthology.orchestra.run.smithi044.stdout:(39/152): ceph-mgr-diskprediction-local-19.0.0- 7.3 MB/s | 7.4 MB 00:01 2024-05-03T22:26:17.040 INFO:teuthology.orchestra.run.smithi044.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 803 kB 00:00 2024-05-03T22:26:17.559 INFO:teuthology.orchestra.run.smithi044.stdout:(41/152): ceph-test-19.0.0-3450.g9a047fe7.el9.x 13 MB/s | 49 MB 00:03 2024-05-03T22:26:17.700 INFO:teuthology.orchestra.run.smithi044.stdout:(42/152): libquadmath-11.4.1-3.el9.x86_64.rpm 239 kB/s | 195 kB 00:00 2024-05-03T22:26:17.733 INFO:teuthology.orchestra.run.smithi044.stdout:(43/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 366 kB/s | 253 kB 00:00 2024-05-03T22:26:17.784 INFO:teuthology.orchestra.run.smithi044.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 106 kB 00:00 2024-05-03T22:26:17.817 INFO:teuthology.orchestra.run.smithi044.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-05-03T22:26:17.867 INFO:teuthology.orchestra.run.smithi044.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-05-03T22:26:17.901 INFO:teuthology.orchestra.run.smithi044.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-05-03T22:26:17.951 INFO:teuthology.orchestra.run.smithi044.stdout:(48/152): python3-cryptography-36.0.1-4.el9.x86 3.1 MB/s | 1.2 MB 00:00 2024-05-03T22:26:18.193 INFO:teuthology.orchestra.run.smithi044.stdout:(49/152): boost-program-options-1.75.0-8.el9.x8 444 kB/s | 107 kB 00:00 2024-05-03T22:26:18.261 INFO:teuthology.orchestra.run.smithi044.stdout:(50/152): elfutils-libelf-devel-0.190-2.el9.x86 326 kB/s | 21 kB 00:00 2024-05-03T22:26:18.302 INFO:teuthology.orchestra.run.smithi044.stdout:(51/152): bison-3.7.4-5.el9.x86_64.rpm 2.3 MB/s | 943 kB 00:00 2024-05-03T22:26:18.352 INFO:teuthology.orchestra.run.smithi044.stdout:(52/152): automake-1.16.2-8.el9.noarch.rpm 1.4 MB/s | 689 kB 00:00 2024-05-03T22:26:18.378 INFO:teuthology.orchestra.run.smithi044.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 438 kB/s | 33 kB 00:00 2024-05-03T22:26:18.411 INFO:teuthology.orchestra.run.smithi044.stdout:(54/152): flex-2.6.4-9.el9.x86_64.rpm 2.0 MB/s | 313 kB 00:00 2024-05-03T22:26:18.470 INFO:teuthology.orchestra.run.smithi044.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 199 kB/s | 18 kB 00:00 2024-05-03T22:26:18.487 INFO:teuthology.orchestra.run.smithi044.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 149 kB/s | 11 kB 00:00 2024-05-03T22:26:18.546 INFO:teuthology.orchestra.run.smithi044.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-05-03T22:26:18.562 INFO:teuthology.orchestra.run.smithi044.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 607 kB/s | 45 kB 00:00 2024-05-03T22:26:18.646 INFO:teuthology.orchestra.run.smithi044.stdout:(59/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-05-03T22:26:18.688 INFO:teuthology.orchestra.run.smithi044.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 4.6 MB/s | 582 kB 00:00 2024-05-03T22:26:18.722 INFO:teuthology.orchestra.run.smithi044.stdout:(61/152): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 662 kB 00:00 2024-05-03T22:26:18.747 INFO:teuthology.orchestra.run.smithi044.stdout:(62/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 255 kB/s | 25 kB 00:00 2024-05-03T22:26:18.772 INFO:teuthology.orchestra.run.smithi044.stdout:(63/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 570 kB/s | 47 kB 00:00 2024-05-03T22:26:18.822 INFO:teuthology.orchestra.run.smithi044.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-05-03T22:26:18.848 INFO:teuthology.orchestra.run.smithi044.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 471 kB/s | 35 kB 00:00 2024-05-03T22:26:18.856 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-05-03T22:26:18.857 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-05-03T22:26:19.015 INFO:teuthology.orchestra.run.smithi044.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 25 MB/s | 4.7 MB 00:00 2024-05-03T22:26:19.048 INFO:teuthology.orchestra.run.smithi044.stdout:(67/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 898 kB/s | 292 kB 00:00 2024-05-03T22:26:19.140 INFO:teuthology.orchestra.run.smithi044.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-05-03T22:26:19.241 INFO:teuthology.orchestra.run.smithi044.stdout:(69/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-05-03T22:26:19.274 INFO:teuthology.orchestra.run.smithi044.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 1.0 MB/s | 133 kB 00:00 2024-05-03T22:26:19.344 INFO:teuthology.orchestra.run.smithi044.stdout:(71/152): postgresql-contrib-13.14-1.el9.x86_64 3.0 MB/s | 911 kB 00:00 2024-05-03T22:26:19.408 INFO:teuthology.orchestra.run.smithi044.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 7.6 MB/s | 1.0 MB 00:00 2024-05-03T22:26:19.434 INFO:teuthology.orchestra.run.smithi044.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 997 kB/s | 87 kB 00:00 2024-05-03T22:26:19.517 INFO:teuthology.orchestra.run.smithi044.stdout:(74/152): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-05-03T22:26:19.651 INFO:teuthology.orchestra.run.smithi044.stdout:(75/152): postgresql-server-13.14-1.el9.x86_64. 14 MB/s | 5.8 MB 00:00 2024-05-03T22:26:19.685 INFO:teuthology.orchestra.run.smithi044.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 1.5 MB/s | 248 kB 00:00 2024-05-03T22:26:19.718 INFO:teuthology.orchestra.run.smithi044.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 389 kB/s | 26 kB 00:00 2024-05-03T22:26:19.752 INFO:teuthology.orchestra.run.smithi044.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 289 kB/s | 19 kB 00:00 2024-05-03T22:26:19.810 INFO:teuthology.orchestra.run.smithi044.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-05-03T22:26:19.836 INFO:teuthology.orchestra.run.smithi044.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 419 kB/s | 35 kB 00:00 2024-05-03T22:26:19.953 INFO:teuthology.orchestra.run.smithi044.stdout:(81/152): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-05-03T22:26:19.986 INFO:teuthology.orchestra.run.smithi044.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-05-03T22:26:20.053 INFO:teuthology.orchestra.run.smithi044.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-05-03T22:26:20.087 INFO:teuthology.orchestra.run.smithi044.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 774 kB/s | 77 kB 00:00 2024-05-03T22:26:20.129 INFO:teuthology.orchestra.run.smithi044.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 567 kB/s | 42 kB 00:00 2024-05-03T22:26:20.162 INFO:teuthology.orchestra.run.smithi044.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-05-03T22:26:20.279 INFO:teuthology.orchestra.run.smithi044.stdout:(87/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-05-03T22:26:20.313 INFO:teuthology.orchestra.run.smithi044.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 866 kB/s | 159 kB 00:00 2024-05-03T22:26:20.346 INFO:teuthology.orchestra.run.smithi044.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-05-03T22:26:20.363 INFO:teuthology.orchestra.run.smithi044.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 614 kB/s | 51 kB 00:00 2024-05-03T22:26:20.380 INFO:teuthology.orchestra.run.smithi044.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 807 kB/s | 54 kB 00:00 2024-05-03T22:26:20.422 INFO:teuthology.orchestra.run.smithi044.stdout:(92/152): python3-toml-0.10.2-6.el9.noarch.rpm 719 kB/s | 42 kB 00:00 2024-05-03T22:26:20.439 INFO:teuthology.orchestra.run.smithi044.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 761 kB/s | 44 kB 00:00 2024-05-03T22:26:20.498 INFO:teuthology.orchestra.run.smithi044.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-05-03T22:26:20.523 INFO:teuthology.orchestra.run.smithi044.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 433 kB/s | 36 kB 00:00 2024-05-03T22:26:20.574 INFO:teuthology.orchestra.run.smithi044.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 634 kB/s | 47 kB 00:00 2024-05-03T22:26:20.615 INFO:teuthology.orchestra.run.smithi044.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 3.3 MB/s | 305 kB 00:00 2024-05-03T22:26:20.686 INFO:teuthology.orchestra.run.smithi044.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 517 kB/s | 58 kB 00:00 2024-05-03T22:26:20.725 INFO:teuthology.orchestra.run.smithi044.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 863 kB/s | 94 kB 00:00 2024-05-03T22:26:20.758 INFO:teuthology.orchestra.run.smithi044.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 895 kB/s | 64 kB 00:00 2024-05-03T22:26:20.800 INFO:teuthology.orchestra.run.smithi044.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2024-05-03T22:26:20.884 INFO:teuthology.orchestra.run.smithi044.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 179 kB/s | 22 kB 00:00 2024-05-03T22:26:21.168 INFO:teuthology.orchestra.run.smithi044.stdout:(103/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-05-03T22:26:21.284 INFO:teuthology.orchestra.run.smithi044.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-05-03T22:26:21.376 INFO:teuthology.orchestra.run.smithi044.stdout:(105/152): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-05-03T22:26:21.410 INFO:teuthology.orchestra.run.smithi044.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 1.3 MB/s | 309 kB 00:00 2024-05-03T22:26:21.435 INFO:teuthology.orchestra.run.smithi044.stdout:(107/152): grpc-data-1.46.7-10.el9.noarch.rpm 130 kB/s | 19 kB 00:00 2024-05-03T22:26:21.620 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-05-03T22:26:21.624 INFO:teuthology.orchestra.run.smithi044.stdout:(108/152): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-05-03T22:26:21.661 INFO:teuthology.orchestra.run.smithi044.stdout:(109/152): libarrow-doc-9.0.0-11.el9.noarch.rpm 123 kB/s | 26 kB 00:00 2024-05-03T22:26:21.686 INFO:teuthology.orchestra.run.smithi044.stdout:(110/152): liboath-2.6.7-2.el9.x86_64.rpm 206 kB/s | 49 kB 00:00 2024-05-03T22:26:21.728 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-05-03T22:26:21.736 INFO:teuthology.orchestra.run.smithi044.stdout:(111/152): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2024-05-03T22:26:21.778 INFO:teuthology.orchestra.run.smithi044.stdout:(112/152): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-05-03T22:26:21.812 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-05-03T22:26:21.820 INFO:teuthology.orchestra.run.smithi044.stdout:(113/152): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.2 MB/s | 839 kB 00:00 2024-05-03T22:26:21.870 INFO:teuthology.orchestra.run.smithi044.stdout:(114/152): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-05-03T22:26:21.895 INFO:teuthology.orchestra.run.smithi044.stdout:(115/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 629 kB/s | 43 kB 00:00 2024-05-03T22:26:21.920 INFO:teuthology.orchestra.run.smithi044.stdout:(116/152): python3-cachetools-4.2.4-1.el9.noarc 342 kB/s | 32 kB 00:00 2024-05-03T22:26:21.930 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-05-03T22:26:21.946 INFO:teuthology.orchestra.run.smithi044.stdout:(117/152): python3-certifi-2021.10.8-2.el9.noar 202 kB/s | 15 kB 00:00 2024-05-03T22:26:21.979 INFO:teuthology.orchestra.run.smithi044.stdout:(118/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-05-03T22:26:21.991 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-05-03T22:26:22.004 INFO:teuthology.orchestra.run.smithi044.stdout:(119/152): python3-cherrypy-18.6.1-2.el9.noarch 4.3 MB/s | 358 kB 00:00 2024-05-03T22:26:22.037 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-05-03T22:26:22.062 INFO:teuthology.orchestra.run.smithi044.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-05-03T22:26:22.097 INFO:teuthology.orchestra.run.smithi044.stdout:(121/152): python3-colorama-0.4.4-12.el9.noarch 401 kB/s | 35 kB 00:00 2024-05-03T22:26:22.122 INFO:teuthology.orchestra.run.smithi044.stdout:(122/152): python3-google-auth-2.29.0-1.el9.noa 1.8 MB/s | 206 kB 00:00 2024-05-03T22:26:22.173 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-05-03T22:26:22.197 INFO:teuthology.orchestra.run.smithi044.stdout:(123/152): python3-grpcio-1.46.7-10.el9.x86_64. 15 MB/s | 2.0 MB 00:00 2024-05-03T22:26:22.222 INFO:teuthology.orchestra.run.smithi044.stdout:(124/152): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-05-03T22:26:22.248 INFO:teuthology.orchestra.run.smithi044.stdout:(125/152): python3-jaraco-8.2.1-3.el9.noarch.rp 98 kB/s | 11 kB 00:00 2024-05-03T22:26:22.273 INFO:teuthology.orchestra.run.smithi044.stdout:(126/152): python3-jaraco-classes-3.2.1-5.el9.n 242 kB/s | 18 kB 00:00 2024-05-03T22:26:22.298 INFO:teuthology.orchestra.run.smithi044.stdout:(127/152): python3-jaraco-collections-3.0.0-8.e 473 kB/s | 23 kB 00:00 2024-05-03T22:26:22.323 INFO:teuthology.orchestra.run.smithi044.stdout:(128/152): python3-jaraco-functools-3.5.0-2.el9 263 kB/s | 19 kB 00:00 2024-05-03T22:26:22.349 INFO:teuthology.orchestra.run.smithi044.stdout:(129/152): python3-jaraco-text-3.2.0-6.el9.noar 265 kB/s | 20 kB 00:00 2024-05-03T22:26:22.407 INFO:teuthology.orchestra.run.smithi044.stdout:(130/152): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-05-03T22:26:22.441 INFO:teuthology.orchestra.run.smithi044.stdout:(131/152): python3-logutils-0.3.5-21.el9.noarch 400 kB/s | 46 kB 00:00 2024-05-03T22:26:22.466 INFO:teuthology.orchestra.run.smithi044.stdout:(132/152): python3-more-itertools-8.12.0-2.el9. 753 kB/s | 79 kB 00:00 2024-05-03T22:26:22.523 INFO:teuthology.orchestra.run.smithi044.stdout:(133/152): python3-natsort-7.1.1-5.el9.noarch.r 720 kB/s | 58 kB 00:00 2024-05-03T22:26:22.558 INFO:teuthology.orchestra.run.smithi044.stdout:(134/152): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-05-03T22:26:22.583 INFO:teuthology.orchestra.run.smithi044.stdout:(135/152): python3-portend-3.1.0-2.el9.noarch.r 141 kB/s | 16 kB 00:00 2024-05-03T22:26:22.609 INFO:teuthology.orchestra.run.smithi044.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-05-03T22:26:22.627 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-05-03T22:26:22.634 INFO:teuthology.orchestra.run.smithi044.stdout:(137/152): python3-pyperclip-1.8.2-2.el9.noarch 381 kB/s | 28 kB 00:00 2024-05-03T22:26:22.659 INFO:teuthology.orchestra.run.smithi044.stdout:(138/152): python3-repoze-lru-0.7-16.el9.noarch 419 kB/s | 31 kB 00:00 2024-05-03T22:26:22.693 INFO:teuthology.orchestra.run.smithi044.stdout:(139/152): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2024-05-03T22:26:22.710 INFO:teuthology.orchestra.run.smithi044.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 802 kB/s | 59 kB 00:00 2024-05-03T22:26:22.727 INFO:teuthology.orchestra.run.smithi044.stdout:(141/152): python3-tempora-5.0.0-2.el9.noarch.r 559 kB/s | 36 kB 00:00 2024-05-03T22:26:22.743 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T22:26:22.760 INFO:teuthology.orchestra.run.smithi044.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-05-03T22:26:22.785 INFO:teuthology.orchestra.run.smithi044.stdout:(143/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-05-03T22:26:22.811 INFO:teuthology.orchestra.run.smithi044.stdout:(144/152): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2024-05-03T22:26:22.844 INFO:teuthology.orchestra.run.smithi044.stdout:(145/152): python3-werkzeug-2.0.3-3.el9.1.noarc 7.4 MB/s | 427 kB 00:00 2024-05-03T22:26:22.869 INFO:teuthology.orchestra.run.smithi044.stdout:(146/152): python3-zc-lockfile-2.0-10.el9.noarc 245 kB/s | 20 kB 00:00 2024-05-03T22:26:22.903 INFO:teuthology.orchestra.run.smithi044.stdout:(147/152): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-05-03T22:26:22.912 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T22:26:22.944 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T22:26:22.995 INFO:teuthology.orchestra.run.smithi044.stdout:(148/152): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-05-03T22:26:23.072 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T22:26:23.135 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 10/156 2024-05-03T22:26:23.196 INFO:teuthology.orchestra.run.smithi044.stdout:(149/152): librados2-19.0.0-3450.g9a047fe7.el9. 11 MB/s | 3.4 MB 00:00 2024-05-03T22:26:23.438 INFO:teuthology.orchestra.run.smithi044.stdout:(150/152): openssl-3.2.1-1.el9.x86_64.rpm 3.1 MB/s | 1.3 MB 00:00 2024-05-03T22:26:23.512 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-05-03T22:26:23.513 INFO:teuthology.orchestra.run.smithi044.stdout:(151/152): librbd1-19.0.0-3450.g9a047fe7.el9.x8 5.3 MB/s | 3.1 MB 00:00 2024-05-03T22:26:23.575 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-05-03T22:26:23.606 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T22:26:23.646 INFO:teuthology.orchestra.run.smithi044.stdout:(152/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 5.4 MB/s | 2.4 MB 00:00 2024-05-03T22:26:23.658 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-05-03T22:26:23.659 INFO:teuthology.orchestra.run.smithi044.stdout:Total 16 MB/s | 222 MB 00:13 2024-05-03T22:26:23.761 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T22:26:23.791 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 14/156 2024-05-03T22:26:23.885 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 14/156 2024-05-03T22:26:23.917 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-03T22:26:23.999 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-03T22:26:24.297 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-03T22:26:24.352 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-03T22:26:24.548 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-05-03T22:26:24.669 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-05-03T22:26:24.718 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-05-03T22:26:24.767 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-05-03T22:26:24.869 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-05-03T22:26:24.938 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-05-03T22:26:25.003 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-05-03T22:26:25.051 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-05-03T22:26:25.091 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-05-03T22:26:25.247 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-05-03T22:26:25.323 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-05-03T22:26:25.361 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-05-03T22:26:25.417 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-05-03T22:26:25.523 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-05-03T22:26:25.531 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-05-03T22:26:25.563 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9. 31/156 2024-05-03T22:26:25.641 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-05-03T22:26:25.722 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-05-03T22:26:25.816 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el 32/156 2024-05-03T22:26:25.857 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_6 33/156 2024-05-03T22:26:25.864 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-05-03T22:26:25.932 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-05-03T22:26:25.960 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-05-03T22:26:25.968 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-05-03T22:26:26.015 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-05-03T22:26:26.100 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-05-03T22:26:26.105 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-05-03T22:26:26.280 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-05-03T22:26:26.351 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-05-03T22:26:26.531 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction check 2024-05-03T22:26:26.557 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-05-03T22:26:26.665 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T22:26:26.777 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction check succeeded. 2024-05-03T22:26:26.778 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction test 2024-05-03T22:26:26.853 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T22:26:26.882 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T22:26:27.018 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-05-03T22:26:27.035 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T22:26:27.092 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 10/156 2024-05-03T22:26:27.131 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-05-03T22:26:27.336 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-05-03T22:26:27.394 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-05-03T22:26:27.444 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_6 43/156 2024-05-03T22:26:27.461 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-05-03T22:26:27.522 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-05-03T22:26:27.535 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-05-03T22:26:27.553 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T22:26:27.717 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T22:26:27.746 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 14/156 2024-05-03T22:26:27.784 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-05-03T22:26:27.841 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 14/156 2024-05-03T22:26:27.854 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-05-03T22:26:27.872 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-03T22:26:27.929 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-05-03T22:26:27.940 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-03T22:26:28.033 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-05-03T22:26:28.079 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-05-03T22:26:28.118 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-05-03T22:26:28.184 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-05-03T22:26:28.227 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-05-03T22:26:28.277 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-03T22:26:28.288 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-05-03T22:26:28.331 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-03T22:26:28.346 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-05-03T22:26:28.532 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-05-03T22:26:28.543 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-05-03T22:26:28.590 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-05-03T22:26:28.627 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-05-03T22:26:28.660 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-05-03T22:26:28.674 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-05-03T22:26:28.699 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-05-03T22:26:28.745 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-05-03T22:26:28.801 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-05-03T22:26:28.840 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-05-03T22:26:28.844 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-05-03T22:26:28.885 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-05-03T22:26:28.891 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-05-03T22:26:28.926 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-05-03T22:26:28.950 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-05-03T22:26:28.979 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-05-03T22:26:28.998 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-05-03T22:26:29.039 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-05-03T22:26:29.157 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-05-03T22:26:29.161 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-05-03T22:26:29.232 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-05-03T22:26:29.265 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-05-03T22:26:29.322 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-05-03T22:26:29.340 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-05-03T22:26:29.390 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-05-03T22:26:29.430 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-05-03T22:26:29.432 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-05-03T22:26:29.439 INFO:teuthology.orchestra.run.smithi044.stdout:Transaction test succeeded. 2024-05-03T22:26:29.440 INFO:teuthology.orchestra.run.smithi044.stdout:Running transaction 2024-05-03T22:26:29.468 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9. 31/156 2024-05-03T22:26:29.476 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-05-03T22:26:29.521 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el 32/156 2024-05-03T22:26:29.532 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-05-03T22:26:29.558 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_6 33/156 2024-05-03T22:26:29.585 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-05-03T22:26:29.627 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-05-03T22:26:29.677 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-05-03T22:26:29.681 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-05-03T22:26:29.731 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-05-03T22:26:29.741 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-05-03T22:26:29.808 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-05-03T22:26:29.854 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-05-03T22:26:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-05-03T22:26:29.992 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-05-03T22:26:30.033 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-05-03T22:26:30.059 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-05-03T22:26:30.096 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-05-03T22:26:30.103 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-05-03T22:26:30.168 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-05-03T22:26:30.307 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-05-03T22:26:30.383 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-05-03T22:26:30.765 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-05-03T22:26:30.865 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-05-03T22:26:30.983 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-05-03T22:26:31.036 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-05-03T22:26:31.085 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_6 43/156 2024-05-03T22:26:31.166 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-05-03T22:26:31.328 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-05-03T22:26:31.382 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-05-03T22:26:31.414 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-05-03T22:26:31.416 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-05-03T22:26:31.476 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-05-03T22:26:31.536 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-05-03T22:26:31.554 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-05-03T22:26:31.593 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-05-03T22:26:31.653 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-05-03T22:26:31.693 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-05-03T22:26:31.698 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-05-03T22:26:31.731 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-05-03T22:26:31.750 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-05-03T22:26:31.800 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-05-03T22:26:31.857 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-05-03T22:26:31.916 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-05-03T22:26:31.979 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-05-03T22:26:31.988 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-05-03T22:26:32.023 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-05-03T22:26:32.149 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-05-03T22:26:32.182 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-05-03T22:26:32.231 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-05-03T22:26:32.269 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-05-03T22:26:32.326 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-05-03T22:26:32.467 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-05-03T22:26:32.510 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-05-03T22:26:32.559 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-05-03T22:26:32.591 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-05-03T22:26:32.624 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-05-03T22:26:32.814 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-05-03T22:26:32.966 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-05-03T22:26:32.987 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-05-03T22:26:33.041 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-05-03T22:26:33.079 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-05-03T22:26:33.126 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-05-03T22:26:33.178 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-05-03T22:26:33.194 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-05-03T22:26:33.255 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-05-03T22:26:33.303 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-05-03T22:26:33.349 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-05-03T22:26:33.400 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-05-03T22:26:33.486 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-05-03T22:26:33.539 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-05-03T22:26:33.718 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-05-03T22:26:33.781 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-05-03T22:26:33.839 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-05-03T22:26:33.913 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-05-03T22:26:34.070 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-05-03T22:26:34.134 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-05-03T22:26:34.776 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-05-03T22:26:34.870 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-05-03T22:26:34.918 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-05-03T22:26:34.964 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-05-03T22:26:35.121 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-05-03T22:26:35.192 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-05-03T22:26:35.225 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-05-03T22:26:35.359 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-05-03T22:26:35.361 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-05-03T22:26:35.399 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 99/156 2024-05-03T22:26:35.429 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-05-03T22:26:35.521 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 99/156 2024-05-03T22:26:35.556 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 100/156 2024-05-03T22:26:35.566 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-05-03T22:26:35.601 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-05-03T22:26:35.611 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-05-03T22:26:35.848 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-05-03T22:26:35.873 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-05-03T22:26:35.978 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-05-03T22:26:35.990 INFO:teuthology.orchestra.run.smithi044.stdout: Preparing : 1/1 2024-05-03T22:26:36.115 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-05-03T22:26:36.160 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-05-03T22:26:36.194 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 103/156 2024-05-03T22:26:36.217 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-05-03T22:26:36.268 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 103/156 2024-05-03T22:26:36.296 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 104/156 2024-05-03T22:26:36.323 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-05-03T22:26:36.394 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-05-03T22:26:36.440 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-05-03T22:26:36.579 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-05-03T22:26:36.837 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-05-03T22:26:36.986 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-05-03T22:26:37.030 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-05-03T22:26:37.198 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T22:26:37.536 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T22:26:37.563 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T22:26:37.693 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T22:26:37.746 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 10/156 2024-05-03T22:26:38.174 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-05-03T22:26:38.238 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-05-03T22:26:38.301 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T22:26:38.459 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T22:26:38.493 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 14/156 2024-05-03T22:26:38.595 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 14/156 2024-05-03T22:26:38.619 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-03T22:26:38.640 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-05-03T22:26:38.679 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-05-03T22:26:38.739 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-05-03T22:26:38.788 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-05-03T22:26:38.833 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-05-03T22:26:39.032 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T22:26:39.043 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-03T22:26:39.076 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T22:26:39.104 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-05-03T22:26:39.254 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-05-03T22:26:39.301 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 99/156 2024-05-03T22:26:39.304 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-05-03T22:26:39.426 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 99/156 2024-05-03T22:26:39.434 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 18/156 2024-05-03T22:26:39.458 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 100/156 2024-05-03T22:26:39.487 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-05-03T22:26:39.518 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-05-03T22:26:39.537 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-05-03T22:26:39.647 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-05-03T22:26:39.701 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-05-03T22:26:39.742 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T22:26:39.765 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-05-03T22:26:39.787 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 106/156 2024-05-03T22:26:39.824 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-05-03T22:26:39.860 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-05-03T22:26:39.946 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 106/156 2024-05-03T22:26:39.946 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-03T22:26:39.947 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-03T22:26:39.947 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:26:39.979 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-05-03T22:26:40.005 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 107/156 2024-05-03T22:26:40.049 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-05-03T22:26:40.096 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-05-03T22:26:40.119 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-05-03T22:26:40.154 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 103/156 2024-05-03T22:26:40.157 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-05-03T22:26:40.254 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 103/156 2024-05-03T22:26:40.278 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-05-03T22:26:40.281 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 104/156 2024-05-03T22:26:40.316 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9. 31/156 2024-05-03T22:26:40.371 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el 32/156 2024-05-03T22:26:40.407 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_6 33/156 2024-05-03T22:26:40.531 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-05-03T22:26:40.602 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-05-03T22:26:40.718 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-05-03T22:26:40.907 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-05-03T22:26:40.998 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-05-03T22:26:41.733 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-05-03T22:26:41.848 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-05-03T22:26:41.888 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-05-03T22:26:41.933 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-05-03T22:26:41.974 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_6 43/156 2024-05-03T22:26:42.038 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-05-03T22:26:42.301 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-05-03T22:26:42.367 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-05-03T22:26:42.447 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-05-03T22:26:42.561 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-05-03T22:26:42.608 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-05-03T22:26:42.649 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-05-03T22:26:42.719 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-05-03T22:26:42.879 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-05-03T22:26:42.956 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-05-03T22:26:43.036 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-05-03T22:26:43.067 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T22:26:43.103 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T22:26:43.266 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-05-03T22:26:43.328 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-05-03T22:26:43.367 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-05-03T22:26:43.434 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-05-03T22:26:43.579 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-05-03T22:26:43.631 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-05-03T22:26:43.713 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-05-03T22:26:43.749 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-05-03T22:26:43.782 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 63/156 2024-05-03T22:26:43.805 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T22:26:43.856 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 106/156 2024-05-03T22:26:43.973 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-05-03T22:26:44.029 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 106/156 2024-05-03T22:26:44.029 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-03T22:26:44.029 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-03T22:26:44.030 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-03T22:26:44.074 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 107/156 2024-05-03T22:26:44.193 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-05-03T22:26:44.245 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-05-03T22:26:44.302 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-05-03T22:26:44.349 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-05-03T22:26:44.419 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-05-03T22:26:44.475 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-05-03T22:26:44.525 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-05-03T22:26:44.578 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-05-03T22:26:44.630 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-05-03T22:26:44.707 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-05-03T22:26:44.751 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-05-03T22:26:44.897 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-05-03T22:26:44.976 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-05-03T22:26:45.026 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-05-03T22:26:45.100 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-05-03T22:26:45.261 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-05-03T22:26:45.331 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-05-03T22:26:46.373 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-05-03T22:26:46.446 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-05-03T22:26:46.479 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-05-03T22:26:46.615 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-05-03T22:26:46.692 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-05-03T22:26:46.809 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-05-03T22:26:46.847 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-05-03T22:26:47.093 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-05-03T22:26:47.150 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-05-03T22:26:47.272 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-05-03T22:26:48.216 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-05-03T22:26:48.365 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-05-03T22:26:50.085 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-05-03T22:26:50.192 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-05-03T22:26:50.283 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-05-03T22:26:50.332 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-05-03T22:26:50.752 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-05-03T22:26:50.796 INFO:teuthology.orchestra.run.smithi044.stdout: Upgrading : librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 99/156 2024-05-03T22:26:50.920 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 99/156 2024-05-03T22:26:50.953 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 100/156 2024-05-03T22:26:51.012 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-05-03T22:26:51.603 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 102/156 2024-05-03T22:26:51.649 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 103/156 2024-05-03T22:26:51.751 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 103/156 2024-05-03T22:26:51.776 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 104/156 2024-05-03T22:26:53.052 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 107/156 2024-05-03T22:26:53.053 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /sys 2024-05-03T22:26:53.053 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /proc 2024-05-03T22:26:53.053 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /mnt 2024-05-03T22:26:53.053 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /var/tmp 2024-05-03T22:26:53.053 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /home 2024-05-03T22:26:53.053 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /root 2024-05-03T22:26:53.053 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /tmp 2024-05-03T22:26:53.053 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:26:53.287 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 108/156 2024-05-03T22:26:53.337 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 108/156 2024-05-03T22:26:53.337 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:26:53.338 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-03T22:26:53.338 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:26:54.720 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T22:26:54.756 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T22:26:54.988 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 109/156 2024-05-03T22:26:55.064 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 109/156 2024-05-03T22:26:55.064 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:26:55.064 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-03T22:26:55.064 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-03T22:26:55.064 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-03T22:26:55.064 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:26:55.314 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 110/156 2024-05-03T22:26:55.381 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 110/156 2024-05-03T22:26:55.381 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:26:55.381 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-03T22:26:55.381 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-03T22:26:55.381 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-03T22:26:55.381 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:26:55.461 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 105/156 2024-05-03T22:26:55.510 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 106/156 2024-05-03T22:26:55.714 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 106/156 2024-05-03T22:26:55.714 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-03T22:26:55.714 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-03T22:26:55.715 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:26:55.752 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 107/156 2024-05-03T22:26:55.864 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 111/156 2024-05-03T22:26:55.933 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 111/156 2024-05-03T22:26:55.933 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:26:55.933 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-03T22:26:55.934 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-03T22:26:55.934 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-03T22:26:55.934 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:26:56.064 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-05-03T22:26:56.116 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-05-03T22:26:56.182 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-05-03T22:26:56.407 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-05-03T22:26:56.460 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-05-03T22:26:56.546 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-05-03T22:26:56.646 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-03T22:26:56.811 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-03T22:26:56.867 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-05-03T22:26:56.909 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-05-03T22:26:56.950 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-05-03T22:26:57.283 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 107/156 2024-05-03T22:26:57.283 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /sys 2024-05-03T22:26:57.283 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /proc 2024-05-03T22:26:57.283 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /mnt 2024-05-03T22:26:57.284 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /var/tmp 2024-05-03T22:26:57.284 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /home 2024-05-03T22:26:57.284 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /root 2024-05-03T22:26:57.284 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /tmp 2024-05-03T22:26:57.284 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-03T22:26:57.526 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 108/156 2024-05-03T22:26:57.574 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 108/156 2024-05-03T22:26:57.574 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:26:57.574 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-03T22:26:57.575 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-03T22:26:57.580 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 123/156 2024-05-03T22:26:57.621 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 123/156 2024-05-03T22:26:57.676 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.e 124/156 2024-05-03T22:26:57.784 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7. 125/156 2024-05-03T22:26:57.873 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 126/156 2024-05-03T22:26:59.203 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 126/156 2024-05-03T22:26:59.248 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 127/156 2024-05-03T22:26:59.252 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 109/156 2024-05-03T22:26:59.334 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 109/156 2024-05-03T22:26:59.335 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:26:59.335 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-03T22:26:59.335 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-03T22:26:59.335 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-03T22:26:59.335 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-03T22:26:59.602 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 110/156 2024-05-03T22:26:59.676 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 110/156 2024-05-03T22:26:59.677 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:26:59.677 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-03T22:26:59.677 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-03T22:26:59.677 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-03T22:26:59.677 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-03T22:27:00.186 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 111/156 2024-05-03T22:27:00.260 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 111/156 2024-05-03T22:27:00.260 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:00.260 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-03T22:27:00.261 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-03T22:27:00.261 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-03T22:27:00.261 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-03T22:27:00.356 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 127/156 2024-05-03T22:27:00.381 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 128/156 2024-05-03T22:27:00.395 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-05-03T22:27:00.460 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-05-03T22:27:00.538 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 128/156 2024-05-03T22:27:00.547 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-05-03T22:27:00.720 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el 129/156 2024-05-03T22:27:00.758 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 130/156 2024-05-03T22:27:00.792 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-05-03T22:27:00.837 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 130/156 2024-05-03T22:27:00.838 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:00.838 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-03T22:27:00.838 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-03T22:27:00.838 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-03T22:27:00.838 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:27:00.852 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-05-03T22:27:00.903 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 131/156 2024-05-03T22:27:00.941 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-05-03T22:27:00.943 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 131/156 2024-05-03T22:27:01.058 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-03T22:27:01.074 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 132/156 2024-05-03T22:27:01.154 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 133/156 2024-05-03T22:27:01.235 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-03T22:27:01.285 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-05-03T22:27:01.325 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-05-03T22:27:01.366 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-05-03T22:27:02.016 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 123/156 2024-05-03T22:27:02.053 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 123/156 2024-05-03T22:27:02.108 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.e 124/156 2024-05-03T22:27:02.176 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-05-03T22:27:02.213 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 135/156 2024-05-03T22:27:02.220 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7. 125/156 2024-05-03T22:27:02.255 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 126/156 2024-05-03T22:27:02.293 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 135/156 2024-05-03T22:27:02.293 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:02.293 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-03T22:27:02.293 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-03T22:27:02.293 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-03T22:27:02.293 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:27:02.347 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3450.g9a047 136/156 2024-05-03T22:27:02.434 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3450.g9a047 136/156 2024-05-03T22:27:02.434 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:02.434 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-03T22:27:02.434 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:27:02.515 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 137/156 2024-05-03T22:27:02.618 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 137/156 2024-05-03T22:27:02.619 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:02.619 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-03T22:27:02.619 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-03T22:27:02.619 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-03T22:27:02.619 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:27:03.007 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 138/156 2024-05-03T22:27:03.084 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 138/156 2024-05-03T22:27:03.084 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:03.084 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-03T22:27:03.084 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-03T22:27:03.084 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-03T22:27:03.084 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:27:03.611 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 126/156 2024-05-03T22:27:03.656 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 127/156 2024-05-03T22:27:04.821 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 127/156 2024-05-03T22:27:04.856 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 128/156 2024-05-03T22:27:05.021 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 128/156 2024-05-03T22:27:05.203 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el 129/156 2024-05-03T22:27:05.234 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 130/156 2024-05-03T22:27:05.325 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 130/156 2024-05-03T22:27:05.326 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:05.326 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-03T22:27:05.326 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-03T22:27:05.326 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-03T22:27:05.326 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-03T22:27:05.384 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 131/156 2024-05-03T22:27:05.422 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 131/156 2024-05-03T22:27:05.539 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 132/156 2024-05-03T22:27:05.611 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 133/156 2024-05-03T22:27:06.675 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-05-03T22:27:06.720 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 135/156 2024-05-03T22:27:06.793 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 135/156 2024-05-03T22:27:06.793 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:06.793 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-03T22:27:06.793 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-03T22:27:06.793 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-03T22:27:06.793 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-03T22:27:06.846 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3450.g9a047 136/156 2024-05-03T22:27:06.922 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3450.g9a047 136/156 2024-05-03T22:27:06.922 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:06.922 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-03T22:27:06.923 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-03T22:27:06.997 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 137/156 2024-05-03T22:27:07.078 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 137/156 2024-05-03T22:27:07.078 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:07.078 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-03T22:27:07.078 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-03T22:27:07.078 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-03T22:27:07.079 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-03T22:27:07.464 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 138/156 2024-05-03T22:27:07.535 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 138/156 2024-05-03T22:27:07.535 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:07.535 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-03T22:27:07.535 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-03T22:27:07.536 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-03T22:27:07.536 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-03T22:27:08.147 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 139/156 2024-05-03T22:27:08.202 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 140/156 2024-05-03T22:27:08.284 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 141/156 2024-05-03T22:27:08.325 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-05-03T22:27:08.373 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-05-03T22:27:08.694 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 144/156 2024-05-03T22:27:08.750 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-05-03T22:27:08.778 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_ 146/156 2024-05-03T22:27:09.455 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 107/156 2024-05-03T22:27:09.455 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /sys 2024-05-03T22:27:09.455 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /proc 2024-05-03T22:27:09.455 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /mnt 2024-05-03T22:27:09.455 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /var/tmp 2024-05-03T22:27:09.455 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /home 2024-05-03T22:27:09.455 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /root 2024-05-03T22:27:09.455 INFO:teuthology.orchestra.run.smithi044.stdout:skipping the directory /tmp 2024-05-03T22:27:09.456 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:27:09.662 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T22:27:09.708 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 108/156 2024-05-03T22:27:09.709 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T22:27:09.759 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 108/156 2024-05-03T22:27:09.760 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:09.760 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-03T22:27:09.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:27:09.765 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T22:27:11.077 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 148/156 2024-05-03T22:27:11.191 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-05-03T22:27:11.273 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-05-03T22:27:11.460 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-05-03T22:27:11.471 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 109/156 2024-05-03T22:27:11.504 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-05-03T22:27:11.505 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-03T22:27:11.555 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 109/156 2024-05-03T22:27:11.556 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:11.556 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-03T22:27:11.556 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-03T22:27:11.556 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-03T22:27:11.556 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:27:11.639 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-03T22:27:11.686 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-03T22:27:11.687 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-03T22:27:11.829 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 110/156 2024-05-03T22:27:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-03T22:27:11.906 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 110/156 2024-05-03T22:27:11.906 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:11.906 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-03T22:27:11.906 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-03T22:27:11.906 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-03T22:27:11.906 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:27:11.966 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T22:27:12.274 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T22:27:12.274 INFO:teuthology.orchestra.run.smithi160.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-03T22:27:12.274 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:27:12.413 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 111/156 2024-05-03T22:27:12.490 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 111/156 2024-05-03T22:27:12.490 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:12.490 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-03T22:27:12.490 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-03T22:27:12.490 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-03T22:27:12.490 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:27:12.631 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-05-03T22:27:12.703 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-05-03T22:27:12.787 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-05-03T22:27:12.983 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 139/156 2024-05-03T22:27:13.047 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-05-03T22:27:13.051 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 140/156 2024-05-03T22:27:13.102 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-05-03T22:27:13.163 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 141/156 2024-05-03T22:27:13.191 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-05-03T22:27:13.210 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-05-03T22:27:13.259 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-05-03T22:27:13.310 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-03T22:27:13.488 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-03T22:27:13.537 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-05-03T22:27:13.574 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-05-03T22:27:13.610 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-05-03T22:27:13.623 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 144/156 2024-05-03T22:27:13.736 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-05-03T22:27:13.761 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_ 146/156 2024-05-03T22:27:14.242 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 123/156 2024-05-03T22:27:14.279 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 123/156 2024-05-03T22:27:14.351 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.e 124/156 2024-05-03T22:27:14.467 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7. 125/156 2024-05-03T22:27:14.506 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 126/156 2024-05-03T22:27:14.732 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T22:27:14.776 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T22:27:14.841 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T22:27:15.883 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 126/156 2024-05-03T22:27:15.916 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 127/156 2024-05-03T22:27:16.294 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 148/156 2024-05-03T22:27:16.408 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-05-03T22:27:16.501 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-05-03T22:27:16.702 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-05-03T22:27:16.748 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-05-03T22:27:16.748 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-03T22:27:16.874 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-03T22:27:16.921 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-03T22:27:16.922 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-03T22:27:17.062 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-03T22:27:17.077 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 127/156 2024-05-03T22:27:17.109 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 128/156 2024-05-03T22:27:17.207 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T22:27:17.274 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 128/156 2024-05-03T22:27:17.463 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el 129/156 2024-05-03T22:27:17.502 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 130/156 2024-05-03T22:27:17.509 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T22:27:17.509 INFO:teuthology.orchestra.run.smithi060.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-03T22:27:17.509 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-03T22:27:17.579 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 130/156 2024-05-03T22:27:17.579 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:17.580 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-03T22:27:17.580 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-03T22:27:17.580 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-03T22:27:17.580 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:27:17.645 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 131/156 2024-05-03T22:27:17.685 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 131/156 2024-05-03T22:27:17.788 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 1/156 2024-05-03T22:27:17.788 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 2/156 2024-05-03T22:27:17.789 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 3/156 2024-05-03T22:27:17.789 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 4/156 2024-05-03T22:27:17.789 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3450.g9a047 5/156 2024-05-03T22:27:17.789 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 6/156 2024-05-03T22:27:17.789 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 7/156 2024-05-03T22:27:17.789 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T22:27:17.789 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T22:27:17.789 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 10/156 2024-05-03T22:27:17.789 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 11/156 2024-05-03T22:27:17.790 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 12/156 2024-05-03T22:27:17.790 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T22:27:17.790 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 14/156 2024-05-03T22:27:17.790 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_ 15/156 2024-05-03T22:27:17.790 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 16/156 2024-05-03T22:27:17.790 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 17/156 2024-05-03T22:27:17.790 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_6 18/156 2024-05-03T22:27:17.790 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 19/156 2024-05-03T22:27:17.790 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 20/156 2024-05-03T22:27:17.790 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el 21/156 2024-05-03T22:27:17.790 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9. 22/156 2024-05-03T22:27:17.790 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_6 23/156 2024-05-03T22:27:17.790 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 24/156 2024-05-03T22:27:17.791 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 25/156 2024-05-03T22:27:17.791 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 26/156 2024-05-03T22:27:17.791 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 27/156 2024-05-03T22:27:17.791 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 28/156 2024-05-03T22:27:17.791 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 29/156 2024-05-03T22:27:17.791 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7. 30/156 2024-05-03T22:27:17.791 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 31/156 2024-05-03T22:27:17.791 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 32/156 2024-05-03T22:27:17.791 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 33/156 2024-05-03T22:27:17.791 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el 34/156 2024-05-03T22:27:17.791 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 35/156 2024-05-03T22:27:17.791 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.e 36/156 2024-05-03T22:27:17.791 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 37/156 2024-05-03T22:27:17.792 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 38/156 2024-05-03T22:27:17.792 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 39/156 2024-05-03T22:27:17.792 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-05-03T22:27:17.792 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-05-03T22:27:17.792 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-05-03T22:27:17.792 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-05-03T22:27:17.792 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-05-03T22:27:17.792 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-05-03T22:27:17.792 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-05-03T22:27:17.793 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-05-03T22:27:17.793 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-05-03T22:27:17.793 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-05-03T22:27:17.793 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-05-03T22:27:17.793 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-05-03T22:27:17.793 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-05-03T22:27:17.793 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-05-03T22:27:17.793 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-05-03T22:27:17.793 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-05-03T22:27:17.793 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-05-03T22:27:17.793 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-05-03T22:27:17.794 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-05-03T22:27:17.794 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-05-03T22:27:17.794 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-05-03T22:27:17.794 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-05-03T22:27:17.794 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-05-03T22:27:17.794 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-05-03T22:27:17.794 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-05-03T22:27:17.794 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-05-03T22:27:17.794 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-05-03T22:27:17.794 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-05-03T22:27:17.794 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-05-03T22:27:17.794 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-05-03T22:27:17.794 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-05-03T22:27:17.795 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-05-03T22:27:17.795 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-05-03T22:27:17.795 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-05-03T22:27:17.795 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-05-03T22:27:17.795 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-05-03T22:27:17.795 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-05-03T22:27:17.795 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-05-03T22:27:17.795 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-05-03T22:27:17.795 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-05-03T22:27:17.795 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-05-03T22:27:17.795 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-05-03T22:27:17.795 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-05-03T22:27:17.795 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-05-03T22:27:17.795 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-05-03T22:27:17.796 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-05-03T22:27:17.796 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-05-03T22:27:17.796 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-05-03T22:27:17.796 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-05-03T22:27:17.796 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-05-03T22:27:17.796 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-05-03T22:27:17.796 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-05-03T22:27:17.796 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-05-03T22:27:17.796 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-05-03T22:27:17.796 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-05-03T22:27:17.796 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-05-03T22:27:17.796 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-05-03T22:27:17.796 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-05-03T22:27:17.796 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-05-03T22:27:17.797 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-05-03T22:27:17.797 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-05-03T22:27:17.797 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-05-03T22:27:17.797 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-05-03T22:27:17.797 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-05-03T22:27:17.797 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-05-03T22:27:17.797 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-05-03T22:27:17.798 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-05-03T22:27:17.798 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-05-03T22:27:17.798 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-05-03T22:27:17.798 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-05-03T22:27:17.798 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-05-03T22:27:17.798 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-05-03T22:27:17.798 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-05-03T22:27:17.798 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-05-03T22:27:17.798 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-05-03T22:27:17.798 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-05-03T22:27:17.798 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-05-03T22:27:17.798 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-05-03T22:27:17.798 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-03T22:27:17.799 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-03T22:27:17.799 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-05-03T22:27:17.799 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-05-03T22:27:17.799 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-05-03T22:27:17.799 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-05-03T22:27:17.799 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-05-03T22:27:17.799 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-05-03T22:27:17.799 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-05-03T22:27:17.799 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-05-03T22:27:17.799 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-05-03T22:27:17.799 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-05-03T22:27:17.800 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-05-03T22:27:17.800 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-05-03T22:27:17.800 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-05-03T22:27:17.800 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-05-03T22:27:17.800 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-05-03T22:27:17.801 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-05-03T22:27:17.801 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-05-03T22:27:17.801 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-05-03T22:27:17.801 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-05-03T22:27:17.801 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-05-03T22:27:17.801 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-05-03T22:27:17.801 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-05-03T22:27:17.801 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-05-03T22:27:17.802 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-05-03T22:27:17.802 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-05-03T22:27:17.802 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-05-03T22:27:17.802 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-05-03T22:27:17.802 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-05-03T22:27:17.802 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-05-03T22:27:17.802 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 149/156 2024-05-03T22:27:17.802 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-05-03T22:27:17.803 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 151/156 2024-05-03T22:27:17.803 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-05-03T22:27:17.803 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-05-03T22:27:17.803 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-03T22:27:17.803 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-05-03T22:27:17.804 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 132/156 2024-05-03T22:27:17.908 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 133/156 2024-05-03T22:27:18.994 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-05-03T22:27:19.031 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 135/156 2024-05-03T22:27:19.129 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 135/156 2024-05-03T22:27:19.129 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:19.129 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-03T22:27:19.129 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-03T22:27:19.129 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-03T22:27:19.129 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:27:19.182 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3450.g9a047 136/156 2024-05-03T22:27:19.276 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3450.g9a047 136/156 2024-05-03T22:27:19.276 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:19.276 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-03T22:27:19.276 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:27:19.357 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 137/156 2024-05-03T22:27:19.437 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 137/156 2024-05-03T22:27:19.438 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:19.438 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-03T22:27:19.438 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-03T22:27:19.438 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-03T22:27:19.438 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:27:19.816 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 138/156 2024-05-03T22:27:19.889 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 138/156 2024-05-03T22:27:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-03T22:27:19.889 INFO:teuthology.orchestra.run.smithi044.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-03T22:27:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-03T22:27:19.890 INFO:teuthology.orchestra.run.smithi044.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-03T22:27:19.890 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:27:20.191 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T22:27:20.191 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:27:20.191 INFO:teuthology.orchestra.run.smithi160.stdout:Upgraded: 2024-05-03T22:27:20.191 INFO:teuthology.orchestra.run.smithi160.stdout: librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.191 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.191 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-03T22:27:20.191 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-03T22:27:20.192 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-05-03T22:27:20.192 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-03T22:27:20.192 INFO:teuthology.orchestra.run.smithi160.stdout: automake-1.16.2-8.el9.noarch 2024-05-03T22:27:20.192 INFO:teuthology.orchestra.run.smithi160.stdout: bison-3.7.4-5.el9.x86_64 2024-05-03T22:27:20.192 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-03T22:27:20.192 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.192 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.192 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.192 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.192 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:20.192 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.192 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.192 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.192 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:20.193 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:20.193 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:20.193 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:20.193 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:20.193 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.193 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.193 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:20.193 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.193 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.193 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.193 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:20.193 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:20.193 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.194 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.194 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:20.194 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-03T22:27:20.194 INFO:teuthology.orchestra.run.smithi160.stdout: flex-2.6.4-9.el9.x86_64 2024-05-03T22:27:20.194 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-03T22:27:20.194 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-03T22:27:20.194 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-03T22:27:20.194 INFO:teuthology.orchestra.run.smithi160.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-03T22:27:20.194 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-03T22:27:20.194 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-03T22:27:20.194 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-03T22:27:20.194 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-03T22:27:20.194 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-03T22:27:20.195 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.195 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.195 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.195 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-03T22:27:20.195 INFO:teuthology.orchestra.run.smithi160.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-03T22:27:20.195 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-03T22:27:20.195 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-03T22:27:20.195 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-03T22:27:20.195 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.195 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.195 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-03T22:27:20.195 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.195 INFO:teuthology.orchestra.run.smithi160.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-03T22:27:20.195 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-03T22:27:20.196 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-03T22:27:20.196 INFO:teuthology.orchestra.run.smithi160.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-03T22:27:20.196 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-03T22:27:20.196 INFO:teuthology.orchestra.run.smithi160.stdout: lua-5.4.4-4.el9.x86_64 2024-05-03T22:27:20.196 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-03T22:27:20.196 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-03T22:27:20.196 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-03T22:27:20.196 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-03T22:27:20.196 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-03T22:27:20.196 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-03T22:27:20.196 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-13.14-1.el9.x86_64 2024-05-03T22:27:20.196 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-03T22:27:20.196 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-03T22:27:20.196 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-03T22:27:20.196 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-03T22:27:20.197 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-03T22:27:20.197 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-03T22:27:20.197 INFO:teuthology.orchestra.run.smithi160.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-03T22:27:20.197 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-03T22:27:20.197 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-03T22:27:20.197 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-03T22:27:20.197 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.197 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.197 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.197 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-03T22:27:20.197 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-03T22:27:20.197 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-03T22:27:20.197 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-03T22:27:20.198 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-03T22:27:20.198 INFO:teuthology.orchestra.run.smithi160.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-03T22:27:20.198 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-03T22:27:20.198 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-03T22:27:20.198 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-03T22:27:20.198 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-03T22:27:20.198 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-03T22:27:20.198 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-03T22:27:20.198 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-03T22:27:20.198 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-03T22:27:20.198 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-03T22:27:20.198 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-03T22:27:20.198 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-03T22:27:20.198 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-03T22:27:20.198 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-03T22:27:20.199 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-03T22:27:20.199 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-03T22:27:20.199 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-03T22:27:20.199 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-03T22:27:20.199 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-03T22:27:20.199 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-03T22:27:20.199 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-03T22:27:20.199 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-03T22:27:20.199 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-03T22:27:20.199 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-03T22:27:20.199 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-03T22:27:20.199 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply-3.11-14.el9.noarch 2024-05-03T22:27:20.199 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-03T22:27:20.199 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-03T22:27:20.200 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-03T22:27:20.200 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-03T22:27:20.200 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-03T22:27:20.200 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-03T22:27:20.200 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-03T22:27:20.200 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-03T22:27:20.200 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-03T22:27:20.200 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.200 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.200 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-03T22:27:20.200 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-03T22:27:20.200 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-03T22:27:20.200 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.200 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-03T22:27:20.201 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-03T22:27:20.201 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-03T22:27:20.201 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-03T22:27:20.201 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-03T22:27:20.201 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-03T22:27:20.201 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-03T22:27:20.201 INFO:teuthology.orchestra.run.smithi160.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-03T22:27:20.201 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-03T22:27:20.201 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-03T22:27:20.201 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-03T22:27:20.201 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-03T22:27:20.201 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-03T22:27:20.201 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-03T22:27:20.201 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-03T22:27:20.202 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.202 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.202 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:20.202 INFO:teuthology.orchestra.run.smithi160.stdout: re2-1:20211101-3.el9.x86_64 2024-05-03T22:27:20.202 INFO:teuthology.orchestra.run.smithi160.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-03T22:27:20.202 INFO:teuthology.orchestra.run.smithi160.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-03T22:27:20.202 INFO:teuthology.orchestra.run.smithi160.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-03T22:27:20.202 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-03T22:27:20.202 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-03T22:27:20.203 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-03T22:27:20.203 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:27:20.203 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-05-03T22:27:20.762 DEBUG:teuthology.parallel:result is None 2024-05-03T22:27:23.578 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 1/156 2024-05-03T22:27:23.579 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 2/156 2024-05-03T22:27:23.579 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 3/156 2024-05-03T22:27:23.579 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 4/156 2024-05-03T22:27:23.579 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3450.g9a047 5/156 2024-05-03T22:27:23.579 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 6/156 2024-05-03T22:27:23.579 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 7/156 2024-05-03T22:27:23.579 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T22:27:23.579 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T22:27:23.579 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 10/156 2024-05-03T22:27:23.579 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 11/156 2024-05-03T22:27:23.579 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 12/156 2024-05-03T22:27:23.580 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T22:27:23.580 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 14/156 2024-05-03T22:27:23.580 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_ 15/156 2024-05-03T22:27:23.580 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 16/156 2024-05-03T22:27:23.580 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 17/156 2024-05-03T22:27:23.580 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_6 18/156 2024-05-03T22:27:23.580 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 19/156 2024-05-03T22:27:23.580 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 20/156 2024-05-03T22:27:23.580 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el 21/156 2024-05-03T22:27:23.580 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9. 22/156 2024-05-03T22:27:23.580 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_6 23/156 2024-05-03T22:27:23.580 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 24/156 2024-05-03T22:27:23.580 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 25/156 2024-05-03T22:27:23.580 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 26/156 2024-05-03T22:27:23.581 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 27/156 2024-05-03T22:27:23.581 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 28/156 2024-05-03T22:27:23.581 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 29/156 2024-05-03T22:27:23.581 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7. 30/156 2024-05-03T22:27:23.581 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 31/156 2024-05-03T22:27:23.581 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 32/156 2024-05-03T22:27:23.581 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 33/156 2024-05-03T22:27:23.581 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el 34/156 2024-05-03T22:27:23.581 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 35/156 2024-05-03T22:27:23.581 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.e 36/156 2024-05-03T22:27:23.581 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 37/156 2024-05-03T22:27:23.581 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 38/156 2024-05-03T22:27:23.581 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 39/156 2024-05-03T22:27:23.581 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-05-03T22:27:23.582 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-05-03T22:27:23.582 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-05-03T22:27:23.582 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-05-03T22:27:23.582 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-05-03T22:27:23.582 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-05-03T22:27:23.582 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-05-03T22:27:23.582 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-05-03T22:27:23.582 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-05-03T22:27:23.582 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-05-03T22:27:23.582 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-05-03T22:27:23.582 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-05-03T22:27:23.582 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-05-03T22:27:23.582 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-05-03T22:27:23.582 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-05-03T22:27:23.583 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-05-03T22:27:23.583 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-05-03T22:27:23.583 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-05-03T22:27:23.583 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-05-03T22:27:23.583 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-05-03T22:27:23.583 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-05-03T22:27:23.583 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-05-03T22:27:23.583 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-05-03T22:27:23.583 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-05-03T22:27:23.583 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-05-03T22:27:23.583 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-05-03T22:27:23.584 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-05-03T22:27:23.584 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-05-03T22:27:23.584 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-05-03T22:27:23.584 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-05-03T22:27:23.584 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-05-03T22:27:23.584 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-05-03T22:27:23.584 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-05-03T22:27:23.584 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-05-03T22:27:23.584 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-05-03T22:27:23.584 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-05-03T22:27:23.584 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-05-03T22:27:23.584 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-05-03T22:27:23.584 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-05-03T22:27:23.585 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-05-03T22:27:23.585 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-05-03T22:27:23.585 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-05-03T22:27:23.585 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-05-03T22:27:23.585 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-05-03T22:27:23.585 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-05-03T22:27:23.585 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-05-03T22:27:23.585 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-05-03T22:27:23.585 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-05-03T22:27:23.585 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-05-03T22:27:23.585 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-05-03T22:27:23.585 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-05-03T22:27:23.585 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-05-03T22:27:23.585 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-05-03T22:27:23.585 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-05-03T22:27:23.586 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-05-03T22:27:23.586 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-05-03T22:27:23.586 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-05-03T22:27:23.586 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-05-03T22:27:23.586 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-05-03T22:27:23.586 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-05-03T22:27:23.586 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-05-03T22:27:23.586 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-05-03T22:27:23.586 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-05-03T22:27:23.586 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-05-03T22:27:23.586 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-05-03T22:27:23.586 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-05-03T22:27:23.586 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-05-03T22:27:23.587 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-05-03T22:27:23.587 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-05-03T22:27:23.587 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-05-03T22:27:23.587 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-05-03T22:27:23.587 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-05-03T22:27:23.587 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-05-03T22:27:23.587 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-05-03T22:27:23.587 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-05-03T22:27:23.587 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-05-03T22:27:23.587 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-05-03T22:27:23.587 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-05-03T22:27:23.587 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-03T22:27:23.587 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-03T22:27:23.587 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-05-03T22:27:23.587 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-05-03T22:27:23.588 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-05-03T22:27:23.588 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-05-03T22:27:23.588 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-05-03T22:27:23.588 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-05-03T22:27:23.588 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-05-03T22:27:23.588 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-05-03T22:27:23.588 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-05-03T22:27:23.588 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-05-03T22:27:23.588 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-05-03T22:27:23.588 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-05-03T22:27:23.588 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-05-03T22:27:23.588 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-05-03T22:27:23.588 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-05-03T22:27:23.588 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-05-03T22:27:23.588 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-05-03T22:27:23.589 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-05-03T22:27:23.589 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-05-03T22:27:23.589 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-05-03T22:27:23.589 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-05-03T22:27:23.589 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-05-03T22:27:23.589 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-05-03T22:27:23.589 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-05-03T22:27:23.589 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-05-03T22:27:23.589 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-05-03T22:27:23.589 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-05-03T22:27:23.589 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-05-03T22:27:23.589 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-05-03T22:27:23.589 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 149/156 2024-05-03T22:27:23.589 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-05-03T22:27:23.589 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 151/156 2024-05-03T22:27:23.590 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-05-03T22:27:23.590 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-05-03T22:27:23.590 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-03T22:27:23.590 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-05-03T22:27:25.224 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 139/156 2024-05-03T22:27:25.281 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 140/156 2024-05-03T22:27:25.390 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 141/156 2024-05-03T22:27:25.436 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-05-03T22:27:25.484 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-05-03T22:27:25.842 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 144/156 2024-05-03T22:27:25.903 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-05-03T22:27:25.931 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_ 146/156 2024-05-03T22:27:25.946 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T22:27:25.946 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-03T22:27:25.946 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2024-05-03T22:27:25.946 INFO:teuthology.orchestra.run.smithi060.stdout: librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.946 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.946 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-03T22:27:25.946 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-03T22:27:25.946 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-05-03T22:27:25.946 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-03T22:27:25.946 INFO:teuthology.orchestra.run.smithi060.stdout: automake-1.16.2-8.el9.noarch 2024-05-03T22:27:25.946 INFO:teuthology.orchestra.run.smithi060.stdout: bison-3.7.4-5.el9.x86_64 2024-05-03T22:27:25.946 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-03T22:27:25.947 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.947 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.947 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.947 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.947 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:25.947 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.947 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.947 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.947 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:25.947 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:25.947 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:25.947 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:25.947 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:25.948 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.948 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.948 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:25.948 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.948 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.948 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.948 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:25.948 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:25.948 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.948 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.948 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:25.948 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-03T22:27:25.948 INFO:teuthology.orchestra.run.smithi060.stdout: flex-2.6.4-9.el9.x86_64 2024-05-03T22:27:25.948 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-03T22:27:25.949 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-03T22:27:25.949 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-03T22:27:25.949 INFO:teuthology.orchestra.run.smithi060.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-03T22:27:25.949 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-03T22:27:25.949 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-03T22:27:25.949 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-03T22:27:25.949 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-03T22:27:25.949 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-03T22:27:25.949 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.949 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.949 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.949 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-03T22:27:25.949 INFO:teuthology.orchestra.run.smithi060.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-03T22:27:25.950 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-03T22:27:25.950 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-03T22:27:25.950 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-03T22:27:25.950 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.950 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.950 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-03T22:27:25.950 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.950 INFO:teuthology.orchestra.run.smithi060.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-03T22:27:25.950 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-03T22:27:25.950 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-03T22:27:25.950 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-03T22:27:25.950 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-03T22:27:25.950 INFO:teuthology.orchestra.run.smithi060.stdout: lua-5.4.4-4.el9.x86_64 2024-05-03T22:27:25.950 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-03T22:27:25.951 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-03T22:27:25.951 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-03T22:27:25.951 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-03T22:27:25.951 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-03T22:27:25.951 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-03T22:27:25.951 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-13.14-1.el9.x86_64 2024-05-03T22:27:25.951 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-03T22:27:25.951 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-03T22:27:25.951 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-03T22:27:25.951 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-03T22:27:25.951 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-03T22:27:25.951 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-03T22:27:25.951 INFO:teuthology.orchestra.run.smithi060.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-03T22:27:25.951 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-03T22:27:25.952 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-03T22:27:25.952 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-03T22:27:25.952 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.952 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.952 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.952 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-03T22:27:25.952 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-03T22:27:25.952 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-03T22:27:25.952 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-03T22:27:25.952 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-03T22:27:25.952 INFO:teuthology.orchestra.run.smithi060.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-03T22:27:25.952 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-03T22:27:25.952 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-03T22:27:25.952 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-03T22:27:25.953 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-03T22:27:25.953 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-03T22:27:25.953 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-03T22:27:25.953 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-03T22:27:25.953 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-03T22:27:25.953 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-03T22:27:25.953 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-03T22:27:25.953 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-03T22:27:25.953 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-03T22:27:25.953 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-03T22:27:25.953 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-03T22:27:25.953 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-03T22:27:25.953 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-03T22:27:25.953 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-03T22:27:25.954 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-03T22:27:25.954 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-03T22:27:25.954 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-03T22:27:25.954 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-03T22:27:25.954 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-03T22:27:25.954 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-03T22:27:25.954 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-03T22:27:25.954 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply-3.11-14.el9.noarch 2024-05-03T22:27:25.954 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-03T22:27:25.954 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-03T22:27:25.954 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-03T22:27:25.954 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-03T22:27:25.954 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-03T22:27:25.955 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-03T22:27:25.955 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-03T22:27:25.955 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-03T22:27:25.955 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-03T22:27:25.955 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.955 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.955 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-03T22:27:25.955 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-03T22:27:25.955 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-03T22:27:25.955 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.955 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-03T22:27:25.955 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-03T22:27:25.955 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-03T22:27:25.955 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-03T22:27:25.955 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-03T22:27:25.956 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-03T22:27:25.956 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-03T22:27:25.956 INFO:teuthology.orchestra.run.smithi060.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-03T22:27:25.956 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-03T22:27:25.956 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-03T22:27:25.956 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-03T22:27:25.956 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-03T22:27:25.956 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-03T22:27:25.956 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-03T22:27:25.956 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-03T22:27:25.956 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.956 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.956 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:25.957 INFO:teuthology.orchestra.run.smithi060.stdout: re2-1:20211101-3.el9.x86_64 2024-05-03T22:27:25.957 INFO:teuthology.orchestra.run.smithi060.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-03T22:27:25.957 INFO:teuthology.orchestra.run.smithi060.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-03T22:27:25.957 INFO:teuthology.orchestra.run.smithi060.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-03T22:27:25.957 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-03T22:27:25.957 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-03T22:27:25.957 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-03T22:27:25.957 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-05-03T22:27:25.957 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-05-03T22:27:26.568 DEBUG:teuthology.parallel:result is None 2024-05-03T22:27:26.842 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T22:27:26.896 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T22:27:26.954 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-05-03T22:27:28.389 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 148/156 2024-05-03T22:27:28.494 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-05-03T22:27:28.576 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-05-03T22:27:28.752 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-05-03T22:27:28.801 INFO:teuthology.orchestra.run.smithi044.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-05-03T22:27:28.801 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-03T22:27:28.962 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-05-03T22:27:29.008 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-03T22:27:29.009 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-03T22:27:29.157 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-05-03T22:27:29.292 INFO:teuthology.orchestra.run.smithi044.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T22:27:29.603 INFO:teuthology.orchestra.run.smithi044.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T22:27:29.603 INFO:teuthology.orchestra.run.smithi044.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-03T22:27:29.603 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:27:35.522 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 1/156 2024-05-03T22:27:35.522 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 2/156 2024-05-03T22:27:35.522 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 3/156 2024-05-03T22:27:35.522 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 4/156 2024-05-03T22:27:35.523 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3450.g9a047 5/156 2024-05-03T22:27:35.523 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 6/156 2024-05-03T22:27:35.523 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 7/156 2024-05-03T22:27:35.523 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 8/156 2024-05-03T22:27:35.523 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 9/156 2024-05-03T22:27:35.523 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 10/156 2024-05-03T22:27:35.523 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 11/156 2024-05-03T22:27:35.523 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 12/156 2024-05-03T22:27:35.523 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 13/156 2024-05-03T22:27:35.523 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 14/156 2024-05-03T22:27:35.523 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_ 15/156 2024-05-03T22:27:35.523 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 16/156 2024-05-03T22:27:35.523 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 17/156 2024-05-03T22:27:35.523 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_6 18/156 2024-05-03T22:27:35.524 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86 19/156 2024-05-03T22:27:35.524 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 20/156 2024-05-03T22:27:35.524 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el 21/156 2024-05-03T22:27:35.524 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9. 22/156 2024-05-03T22:27:35.524 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_6 23/156 2024-05-03T22:27:35.524 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 24/156 2024-05-03T22:27:35.524 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 25/156 2024-05-03T22:27:35.524 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 26/156 2024-05-03T22:27:35.524 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 27/156 2024-05-03T22:27:35.524 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 28/156 2024-05-03T22:27:35.524 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 29/156 2024-05-03T22:27:35.524 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7. 30/156 2024-05-03T22:27:35.536 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noa 31/156 2024-05-03T22:27:35.537 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.n 32/156 2024-05-03T22:27:35.537 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a0 33/156 2024-05-03T22:27:35.537 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el 34/156 2024-05-03T22:27:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 35/156 2024-05-03T22:27:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.e 36/156 2024-05-03T22:27:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 37/156 2024-05-03T22:27:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 38/156 2024-05-03T22:27:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 39/156 2024-05-03T22:27:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-05-03T22:27:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-05-03T22:27:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-05-03T22:27:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-05-03T22:27:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-05-03T22:27:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-05-03T22:27:35.538 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-05-03T22:27:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-05-03T22:27:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-05-03T22:27:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-05-03T22:27:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-05-03T22:27:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-05-03T22:27:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-05-03T22:27:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-05-03T22:27:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-05-03T22:27:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-05-03T22:27:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-05-03T22:27:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-05-03T22:27:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-05-03T22:27:35.539 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-05-03T22:27:35.540 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-05-03T22:27:35.540 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-05-03T22:27:35.540 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-05-03T22:27:35.540 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-05-03T22:27:35.540 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-05-03T22:27:35.540 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-05-03T22:27:35.540 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-05-03T22:27:35.540 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-05-03T22:27:35.540 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-05-03T22:27:35.540 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-05-03T22:27:35.540 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-05-03T22:27:35.540 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-05-03T22:27:35.540 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-05-03T22:27:35.541 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-05-03T22:27:35.541 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-05-03T22:27:35.541 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-05-03T22:27:35.541 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-05-03T22:27:35.541 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-05-03T22:27:35.541 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-05-03T22:27:35.541 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-05-03T22:27:35.541 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-05-03T22:27:35.541 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-05-03T22:27:35.541 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-05-03T22:27:35.541 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-05-03T22:27:35.541 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-05-03T22:27:35.541 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-05-03T22:27:35.541 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-05-03T22:27:35.542 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-05-03T22:27:35.542 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-05-03T22:27:35.542 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-05-03T22:27:35.542 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-05-03T22:27:35.542 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-05-03T22:27:35.543 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-05-03T22:27:35.543 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-05-03T22:27:35.543 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-05-03T22:27:35.543 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-05-03T22:27:35.543 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-05-03T22:27:35.543 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-05-03T22:27:35.543 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-05-03T22:27:35.543 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-05-03T22:27:35.543 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-05-03T22:27:35.543 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-05-03T22:27:35.543 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-05-03T22:27:35.543 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-05-03T22:27:35.543 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-05-03T22:27:35.543 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-05-03T22:27:35.544 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-05-03T22:27:35.544 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-05-03T22:27:35.544 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/156 2024-05-03T22:27:35.544 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/156 2024-05-03T22:27:35.544 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-05-03T22:27:35.544 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-05-03T22:27:35.544 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-05-03T22:27:35.544 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/156 2024-05-03T22:27:35.544 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-05-03T22:27:35.544 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-05-03T22:27:35.544 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-05-03T22:27:35.544 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-05-03T22:27:35.544 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-05-03T22:27:35.544 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-05-03T22:27:35.545 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-05-03T22:27:35.545 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-05-03T22:27:35.545 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-05-03T22:27:35.545 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-05-03T22:27:35.545 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-05-03T22:27:35.545 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-05-03T22:27:35.545 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-05-03T22:27:35.545 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-05-03T22:27:35.545 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-05-03T22:27:35.545 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-05-03T22:27:35.545 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-05-03T22:27:35.545 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-05-03T22:27:35.545 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-05-03T22:27:35.546 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-05-03T22:27:35.546 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-05-03T22:27:35.546 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-05-03T22:27:35.546 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-05-03T22:27:35.546 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-05-03T22:27:35.546 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-05-03T22:27:35.546 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-05-03T22:27:35.546 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-05-03T22:27:35.546 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-05-03T22:27:35.546 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-05-03T22:27:35.546 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-05-03T22:27:35.546 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-05-03T22:27:35.546 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-05-03T22:27:35.547 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-05-03T22:27:35.547 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-05-03T22:27:35.547 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-05-03T22:27:35.547 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 149/156 2024-05-03T22:27:35.547 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-05-03T22:27:35.547 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 151/156 2024-05-03T22:27:35.547 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-05-03T22:27:35.547 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-05-03T22:27:35.547 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-05-03T22:27:35.547 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-05-03T22:27:38.303 INFO:teuthology.orchestra.run.smithi044.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-05-03T22:27:38.303 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:27:38.303 INFO:teuthology.orchestra.run.smithi044.stdout:Upgraded: 2024-05-03T22:27:38.303 INFO:teuthology.orchestra.run.smithi044.stdout: librados2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.303 INFO:teuthology.orchestra.run.smithi044.stdout: librbd1-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.303 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-03T22:27:38.303 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-03T22:27:38.303 INFO:teuthology.orchestra.run.smithi044.stdout:Installed: 2024-05-03T22:27:38.303 INFO:teuthology.orchestra.run.smithi044.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-03T22:27:38.303 INFO:teuthology.orchestra.run.smithi044.stdout: automake-1.16.2-8.el9.noarch 2024-05-03T22:27:38.304 INFO:teuthology.orchestra.run.smithi044.stdout: bison-3.7.4-5.el9.x86_64 2024-05-03T22:27:38.304 INFO:teuthology.orchestra.run.smithi044.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-03T22:27:38.304 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.304 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-base-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.304 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.304 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.304 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-grafana-dashboards-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:38.304 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-immutable-object-cache-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.304 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mds-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.304 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.304 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:38.304 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-dashboard-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:38.304 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:38.304 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-modules-core-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:38.305 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mgr-rook-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:38.305 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-mon-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.305 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-osd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.305 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-prometheus-alerts-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:38.305 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-radosgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.305 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-selinux-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.305 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-test-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.305 INFO:teuthology.orchestra.run.smithi044.stdout: ceph-volume-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:38.305 INFO:teuthology.orchestra.run.smithi044.stdout: cephadm-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:38.305 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.305 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-shell-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.305 INFO:teuthology.orchestra.run.smithi044.stdout: cephfs-top-2:19.0.0-3450.g9a047fe7.el9.noarch 2024-05-03T22:27:38.305 INFO:teuthology.orchestra.run.smithi044.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-03T22:27:38.305 INFO:teuthology.orchestra.run.smithi044.stdout: flex-2.6.4-9.el9.x86_64 2024-05-03T22:27:38.306 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-03T22:27:38.306 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-03T22:27:38.306 INFO:teuthology.orchestra.run.smithi044.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-03T22:27:38.306 INFO:teuthology.orchestra.run.smithi044.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-03T22:27:38.306 INFO:teuthology.orchestra.run.smithi044.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-03T22:27:38.306 INFO:teuthology.orchestra.run.smithi044.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-03T22:27:38.306 INFO:teuthology.orchestra.run.smithi044.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-03T22:27:38.306 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-03T22:27:38.306 INFO:teuthology.orchestra.run.smithi044.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-03T22:27:38.306 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs-devel-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.306 INFO:teuthology.orchestra.run.smithi044.stdout: libcephfs2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.306 INFO:teuthology.orchestra.run.smithi044.stdout: libcephsqlite-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.306 INFO:teuthology.orchestra.run.smithi044.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-03T22:27:38.307 INFO:teuthology.orchestra.run.smithi044.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-03T22:27:38.307 INFO:teuthology.orchestra.run.smithi044.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-03T22:27:38.307 INFO:teuthology.orchestra.run.smithi044.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-03T22:27:38.307 INFO:teuthology.orchestra.run.smithi044.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-03T22:27:38.307 INFO:teuthology.orchestra.run.smithi044.stdout: librados-devel-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.307 INFO:teuthology.orchestra.run.smithi044.stdout: libradosstriper1-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.307 INFO:teuthology.orchestra.run.smithi044.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-03T22:27:38.307 INFO:teuthology.orchestra.run.smithi044.stdout: librgw2-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.307 INFO:teuthology.orchestra.run.smithi044.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-03T22:27:38.307 INFO:teuthology.orchestra.run.smithi044.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-03T22:27:38.307 INFO:teuthology.orchestra.run.smithi044.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-03T22:27:38.307 INFO:teuthology.orchestra.run.smithi044.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-03T22:27:38.307 INFO:teuthology.orchestra.run.smithi044.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-03T22:27:38.307 INFO:teuthology.orchestra.run.smithi044.stdout: lua-5.4.4-4.el9.x86_64 2024-05-03T22:27:38.307 INFO:teuthology.orchestra.run.smithi044.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-03T22:27:38.308 INFO:teuthology.orchestra.run.smithi044.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-03T22:27:38.308 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-03T22:27:38.308 INFO:teuthology.orchestra.run.smithi044.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-03T22:27:38.308 INFO:teuthology.orchestra.run.smithi044.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-03T22:27:38.308 INFO:teuthology.orchestra.run.smithi044.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-03T22:27:38.308 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-13.14-1.el9.x86_64 2024-05-03T22:27:38.308 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-03T22:27:38.308 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-03T22:27:38.308 INFO:teuthology.orchestra.run.smithi044.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-03T22:27:38.308 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-03T22:27:38.308 INFO:teuthology.orchestra.run.smithi044.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-03T22:27:38.308 INFO:teuthology.orchestra.run.smithi044.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-03T22:27:38.308 INFO:teuthology.orchestra.run.smithi044.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-03T22:27:38.308 INFO:teuthology.orchestra.run.smithi044.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-03T22:27:38.309 INFO:teuthology.orchestra.run.smithi044.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-03T22:27:38.309 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-03T22:27:38.309 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-argparse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.309 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ceph-common-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.309 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cephfs-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.309 INFO:teuthology.orchestra.run.smithi044.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-03T22:27:38.309 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-03T22:27:38.309 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-03T22:27:38.309 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-03T22:27:38.309 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-03T22:27:38.309 INFO:teuthology.orchestra.run.smithi044.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-03T22:27:38.309 INFO:teuthology.orchestra.run.smithi044.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-03T22:27:38.309 INFO:teuthology.orchestra.run.smithi044.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-03T22:27:38.309 INFO:teuthology.orchestra.run.smithi044.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-03T22:27:38.310 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-03T22:27:38.310 INFO:teuthology.orchestra.run.smithi044.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-03T22:27:38.310 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-03T22:27:38.310 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-03T22:27:38.310 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-03T22:27:38.310 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-03T22:27:38.310 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-03T22:27:38.310 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-03T22:27:38.310 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-03T22:27:38.310 INFO:teuthology.orchestra.run.smithi044.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-03T22:27:38.310 INFO:teuthology.orchestra.run.smithi044.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-03T22:27:38.310 INFO:teuthology.orchestra.run.smithi044.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-03T22:27:38.310 INFO:teuthology.orchestra.run.smithi044.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-03T22:27:38.311 INFO:teuthology.orchestra.run.smithi044.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-03T22:27:38.311 INFO:teuthology.orchestra.run.smithi044.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-03T22:27:38.311 INFO:teuthology.orchestra.run.smithi044.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-03T22:27:38.311 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-03T22:27:38.311 INFO:teuthology.orchestra.run.smithi044.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-03T22:27:38.311 INFO:teuthology.orchestra.run.smithi044.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-03T22:27:38.311 INFO:teuthology.orchestra.run.smithi044.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-03T22:27:38.311 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-03T22:27:38.311 INFO:teuthology.orchestra.run.smithi044.stdout: python3-ply-3.11-14.el9.noarch 2024-05-03T22:27:38.311 INFO:teuthology.orchestra.run.smithi044.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-03T22:27:38.311 INFO:teuthology.orchestra.run.smithi044.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-03T22:27:38.311 INFO:teuthology.orchestra.run.smithi044.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-03T22:27:38.311 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-03T22:27:38.311 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-03T22:27:38.311 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-03T22:27:38.312 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-03T22:27:38.312 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-03T22:27:38.312 INFO:teuthology.orchestra.run.smithi044.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-03T22:27:38.312 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rados-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.312 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.312 INFO:teuthology.orchestra.run.smithi044.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-03T22:27:38.312 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-03T22:27:38.312 INFO:teuthology.orchestra.run.smithi044.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-03T22:27:38.312 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rgw-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.312 INFO:teuthology.orchestra.run.smithi044.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-03T22:27:38.312 INFO:teuthology.orchestra.run.smithi044.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-03T22:27:38.312 INFO:teuthology.orchestra.run.smithi044.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-03T22:27:38.312 INFO:teuthology.orchestra.run.smithi044.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-03T22:27:38.312 INFO:teuthology.orchestra.run.smithi044.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-03T22:27:38.312 INFO:teuthology.orchestra.run.smithi044.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-03T22:27:38.313 INFO:teuthology.orchestra.run.smithi044.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-03T22:27:38.313 INFO:teuthology.orchestra.run.smithi044.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-03T22:27:38.313 INFO:teuthology.orchestra.run.smithi044.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-03T22:27:38.313 INFO:teuthology.orchestra.run.smithi044.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-03T22:27:38.313 INFO:teuthology.orchestra.run.smithi044.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-03T22:27:38.313 INFO:teuthology.orchestra.run.smithi044.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-03T22:27:38.313 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-03T22:27:38.313 INFO:teuthology.orchestra.run.smithi044.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-03T22:27:38.313 INFO:teuthology.orchestra.run.smithi044.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-03T22:27:38.313 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-fuse-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.313 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-mirror-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.313 INFO:teuthology.orchestra.run.smithi044.stdout: rbd-nbd-2:19.0.0-3450.g9a047fe7.el9.x86_64 2024-05-03T22:27:38.313 INFO:teuthology.orchestra.run.smithi044.stdout: re2-1:20211101-3.el9.x86_64 2024-05-03T22:27:38.313 INFO:teuthology.orchestra.run.smithi044.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-03T22:27:38.314 INFO:teuthology.orchestra.run.smithi044.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-03T22:27:38.314 INFO:teuthology.orchestra.run.smithi044.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-03T22:27:38.314 INFO:teuthology.orchestra.run.smithi044.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-03T22:27:38.314 INFO:teuthology.orchestra.run.smithi044.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-03T22:27:38.314 INFO:teuthology.orchestra.run.smithi044.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-03T22:27:38.314 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:27:38.314 INFO:teuthology.orchestra.run.smithi044.stdout:Complete! 2024-05-03T22:27:39.140 DEBUG:teuthology.parallel:result is None 2024-05-03T22:27:39.141 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:27:39.281 DEBUG:teuthology.orchestra.run.smithi044:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-03T22:27:39.338 INFO:teuthology.orchestra.run.smithi044.stdout:19.0.0-3450.g9a047fe7.el9 2024-05-03T22:27:39.339 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3450.g9a047fe7.el9 2024-05-03T22:27:39.339 INFO:teuthology.task.install:The correct ceph version 19.0.0-3450.g9a047fe7 is installed. 2024-05-03T22:27:39.341 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:27:39.479 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-03T22:27:39.545 INFO:teuthology.orchestra.run.smithi060.stdout:19.0.0-3450.g9a047fe7.el9 2024-05-03T22:27:39.545 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3450.g9a047fe7.el9 2024-05-03T22:27:39.546 INFO:teuthology.task.install:The correct ceph version 19.0.0-3450.g9a047fe7 is installed. 2024-05-03T22:27:39.548 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:27:39.761 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-03T22:27:39.834 INFO:teuthology.orchestra.run.smithi160.stdout:19.0.0-3450.g9a047fe7.el9 2024-05-03T22:27:39.834 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3450.g9a047fe7.el9 2024-05-03T22:27:39.834 INFO:teuthology.task.install:The correct ceph version 19.0.0-3450.g9a047fe7 is installed. 2024-05-03T22:27:39.836 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-03T22:27:39.836 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T22:27:39.836 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-03T22:27:39.918 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-03T22:27:39.919 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-03T22:27:39.998 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-03T22:27:39.998 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-03T22:27:40.089 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-03T22:27:40.090 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T22:27:40.090 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/daemon-helper 2024-05-03T22:27:40.161 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-03T22:27:40.266 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-03T22:27:40.266 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2024-05-03T22:27:40.351 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-03T22:27:40.469 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-03T22:27:40.469 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/daemon-helper 2024-05-03T22:27:40.558 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-03T22:27:40.686 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-03T22:27:40.686 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T22:27:40.686 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-03T22:27:40.753 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-03T22:27:40.856 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-03T22:27:40.856 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-03T22:27:40.928 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-03T22:27:41.052 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-03T22:27:41.053 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-03T22:27:41.142 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-03T22:27:41.270 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-03T22:27:41.271 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T22:27:41.271 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/usr/bin/stdin-killer 2024-05-03T22:27:41.340 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-03T22:27:41.443 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-03T22:27:41.444 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/stdin-killer 2024-05-03T22:27:41.535 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-03T22:27:41.626 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-03T22:27:41.626 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/stdin-killer 2024-05-03T22:27:41.718 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-03T22:27:41.803 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-03T22:27:41.902 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'fuse default permissions': False, 'fuse set user groups': True, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea', 'subvols': {'create': 2}} 2024-05-03T22:27:41.902 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:27:41.903 INFO:tasks.cephadm:Cluster fsid is 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:27:41.903 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-03T22:27:41.903 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.44', 'mon.b': '172.21.15.60', 'mon.c': '172.21.15.160'} 2024-05-03T22:27:41.903 INFO:tasks.cephadm:First mon is mon.a on smithi044 2024-05-03T22:27:41.903 INFO:tasks.cephadm:First mgr is x 2024-05-03T22:27:41.903 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-03T22:27:41.904 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname $(hostname -s) 2024-05-03T22:27:41.974 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname $(hostname -s) 2024-05-03T22:27:42.067 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname $(hostname -s) 2024-05-03T22:27:42.160 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-03T22:27:42.160 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:27:42.296 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '9a047fe7599a549042d06a3fb5b6813a203eabea', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79034/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3450-g9a047fe7', 'node_name': '172.21.5.34+adami04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3450.g9a047fe7'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-02 00:36:37.664792', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240501.193033', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-05-03T22:27:42.508 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-rishabh-testing-20240501.193033, sha1 9a047fe7599a549042d06a3fb5b6813a203eabea from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:27:42.509 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/x86_64/flavors/default/cephadm 2024-05-03T22:27:42.509 DEBUG:teuthology.orchestra.run.smithi044:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-03T22:27:43.659 INFO:teuthology.orchestra.run.smithi044.stdout:-rw-r--r--. 1 ubuntu ubuntu 782467 May 3 22:27 /home/ubuntu/cephtest/cephadm 2024-05-03T22:27:43.660 DEBUG:teuthology.orchestra.run.smithi060:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-03T22:27:44.496 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r--. 1 ubuntu ubuntu 782467 May 3 22:27 /home/ubuntu/cephtest/cephadm 2024-05-03T22:27:44.496 DEBUG:teuthology.orchestra.run.smithi160:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240501.193033/9a047fe7599a549042d06a3fb5b6813a203eabea/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-03T22:27:45.413 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-r--r--. 1 ubuntu ubuntu 782467 May 3 22:27 /home/ubuntu/cephtest/cephadm 2024-05-03T22:27:45.413 DEBUG:teuthology.orchestra.run.smithi044:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-03T22:27:45.460 DEBUG:teuthology.orchestra.run.smithi060:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-03T22:27:45.524 DEBUG:teuthology.orchestra.run.smithi160:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-03T22:27:45.600 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea on all hosts... 2024-05-03T22:27:45.600 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea pull 2024-05-03T22:27:45.605 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea pull 2024-05-03T22:27:45.613 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea pull 2024-05-03T22:27:47.557 INFO:teuthology.orchestra.run.smithi160.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea... 2024-05-03T22:27:47.611 INFO:teuthology.orchestra.run.smithi060.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea... 2024-05-03T22:27:48.290 INFO:teuthology.orchestra.run.smithi044.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea... 2024-05-03T22:28:25.071 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-05-03T22:28:25.071 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_version": "ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev)", 2024-05-03T22:28:25.071 INFO:teuthology.orchestra.run.smithi060.stdout: "image_id": "ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012", 2024-05-03T22:28:25.071 INFO:teuthology.orchestra.run.smithi060.stdout: "repo_digests": [ 2024-05-03T22:28:25.071 INFO:teuthology.orchestra.run.smithi060.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd" 2024-05-03T22:28:25.072 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-05-03T22:28:25.072 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-05-03T22:28:35.107 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-03T22:28:35.107 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev)", 2024-05-03T22:28:35.107 INFO:teuthology.orchestra.run.smithi044.stdout: "image_id": "ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012", 2024-05-03T22:28:35.108 INFO:teuthology.orchestra.run.smithi044.stdout: "repo_digests": [ 2024-05-03T22:28:35.108 INFO:teuthology.orchestra.run.smithi044.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd" 2024-05-03T22:28:35.108 INFO:teuthology.orchestra.run.smithi044.stdout: ] 2024-05-03T22:28:35.108 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-03T22:28:36.573 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-05-03T22:28:36.574 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev)", 2024-05-03T22:28:36.574 INFO:teuthology.orchestra.run.smithi160.stdout: "image_id": "ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012", 2024-05-03T22:28:36.574 INFO:teuthology.orchestra.run.smithi160.stdout: "repo_digests": [ 2024-05-03T22:28:36.574 INFO:teuthology.orchestra.run.smithi160.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd" 2024-05-03T22:28:36.574 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2024-05-03T22:28:36.574 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-05-03T22:28:36.639 DEBUG:teuthology.orchestra.run.smithi044:> sudo mkdir -p /etc/ceph 2024-05-03T22:28:36.738 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph 2024-05-03T22:28:36.836 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /etc/ceph 2024-05-03T22:28:36.929 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 777 /etc/ceph 2024-05-03T22:28:37.023 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /etc/ceph 2024-05-03T22:28:37.122 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 777 /etc/ceph 2024-05-03T22:28:37.210 INFO:tasks.cephadm:Writing seed config... 2024-05-03T22:28:37.211 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-03T22:28:37.212 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-03T22:28:37.212 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-03T22:28:37.212 INFO:tasks.cephadm: override: [client] fuse default permissions = False 2024-05-03T22:28:37.212 INFO:tasks.cephadm: override: [client] fuse set user groups = True 2024-05-03T22:28:37.212 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-03T22:28:37.212 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-03T22:28:37.212 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-03T22:28:37.212 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-03T22:28:37.212 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-03T22:28:37.212 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-03T22:28:37.212 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-03T22:28:37.212 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-03T22:28:37.213 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-03T22:28:37.213 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-03T22:28:37.213 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-03T22:28:37.213 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-03T22:28:37.213 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-03T22:28:37.213 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-05-03T22:28:37.213 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-03T22:28:37.213 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-03T22:28:37.213 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-03T22:28:37.213 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-03T22:28:37.213 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-03T22:28:37.213 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-03T22:28:37.213 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-03T22:28:37.213 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-03T22:28:37.213 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-03T22:28:37.213 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-03T22:28:37.214 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-03T22:28:37.214 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-03T22:28:37.214 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-03T22:28:37.214 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-03T22:28:37.214 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-05-03T22:28:37.214 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-05-03T22:28:37.214 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-03T22:28:37.214 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-03T22:28:37.214 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-05-03T22:28:37.214 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-03T22:28:37.214 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-03T22:28:37.214 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-03T22:28:37.215 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-03T22:28:37.215 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-03T22:28:37.215 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-03T22:28:37.215 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-03T22:28:37.215 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-05-03T22:28:37.216 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T22:28:37.216 DEBUG:teuthology.orchestra.run.smithi044:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-03T22:28:37.275 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 5b0efdca-099c-11ef-bc97-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 fuse default permissions = False fuse set user groups = True rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-03T22:28:37.276 DEBUG:teuthology.orchestra.run.smithi044:mon.a> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mon.a.service 2024-05-03T22:28:37.324 DEBUG:teuthology.orchestra.run.smithi044:mgr.x> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mgr.x.service 2024-05-03T22:28:37.370 INFO:tasks.cephadm:Bootstrapping... 2024-05-03T22:28:37.370 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea -v bootstrap --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.44 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-03T22:28:37.650 INFO:teuthology.orchestra.run.smithi044.stdout:-------------------------------------------------------------------------------- 2024-05-03T22:28:37.650 INFO:teuthology.orchestra.run.smithi044.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea', '-v', 'bootstrap', '--fsid', '5b0efdca-099c-11ef-bc97-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.44', '--skip-admin-label'] 2024-05-03T22:28:37.651 INFO:teuthology.orchestra.run.smithi044.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-03T22:28:37.651 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying podman|docker is present... 2024-05-03T22:28:37.713 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-03T22:28:37.713 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying lvm2 is present... 2024-05-03T22:28:37.713 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying time synchronization is in place... 2024-05-03T22:28:37.732 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-03T22:28:37.732 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-03T22:28:37.748 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-03T22:28:37.748 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-05-03T22:28:37.769 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout enabled 2024-05-03T22:28:37.788 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout active 2024-05-03T22:28:37.788 INFO:teuthology.orchestra.run.smithi044.stdout:Unit chronyd.service is enabled and running 2024-05-03T22:28:37.789 INFO:teuthology.orchestra.run.smithi044.stdout:Repeating the final host check... 2024-05-03T22:28:37.872 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-03T22:28:37.872 INFO:teuthology.orchestra.run.smithi044.stdout:podman (/bin/podman) version 4.9.4 is present 2024-05-03T22:28:37.872 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl is present 2024-05-03T22:28:37.873 INFO:teuthology.orchestra.run.smithi044.stdout:lvcreate is present 2024-05-03T22:28:37.892 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-03T22:28:37.892 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-03T22:28:37.911 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-03T22:28:37.911 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-05-03T22:28:37.932 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout enabled 2024-05-03T22:28:37.953 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout active 2024-05-03T22:28:37.954 INFO:teuthology.orchestra.run.smithi044.stdout:Unit chronyd.service is enabled and running 2024-05-03T22:28:37.954 INFO:teuthology.orchestra.run.smithi044.stdout:Host looks OK 2024-05-03T22:28:37.954 INFO:teuthology.orchestra.run.smithi044.stdout:Cluster fsid: 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:28:37.955 INFO:teuthology.orchestra.run.smithi044.stdout:Acquiring lock 139722090340304 on /run/cephadm/5b0efdca-099c-11ef-bc97-c7b262605968.lock 2024-05-03T22:28:37.955 INFO:teuthology.orchestra.run.smithi044.stdout:Lock 139722090340304 acquired on /run/cephadm/5b0efdca-099c-11ef-bc97-c7b262605968.lock 2024-05-03T22:28:37.956 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying IP 172.21.15.44 port 3300 ... 2024-05-03T22:28:37.957 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying IP 172.21.15.44 port 6789 ... 2024-05-03T22:28:37.957 INFO:teuthology.orchestra.run.smithi044.stdout:Base mon IP(s) is [172.21.15.44:3300, 172.21.15.44:6789], mon addrv is [v2:172.21.15.44:3300,v1:172.21.15.44:6789] 2024-05-03T22:28:37.970 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.44 metric 100 2024-05-03T22:28:37.970 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.44 metric 100 2024-05-03T22:28:37.981 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-03T22:28:37.981 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-05-03T22:28:37.982 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-05-03T22:28:37.992 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-03T22:28:37.992 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-03T22:28:37.992 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-03T22:28:37.992 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-05-03T22:28:37.992 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:1572/64 scope link noprefixroute 2024-05-03T22:28:37.992 INFO:teuthology.orchestra.run.smithi044.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-03T22:28:37.994 INFO:teuthology.orchestra.run.smithi044.stdout:Mon IP `172.21.15.44` is in CIDR network `172.21.0.0/20` 2024-05-03T22:28:37.994 INFO:teuthology.orchestra.run.smithi044.stdout:Mon IP `172.21.15.44` is in CIDR network `172.21.0.0/20` 2024-05-03T22:28:37.994 INFO:teuthology.orchestra.run.smithi044.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-03T22:28:37.997 INFO:teuthology.orchestra.run.smithi044.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-03T22:28:37.999 INFO:teuthology.orchestra.run.smithi044.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea... 2024-05-03T22:28:38.696 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stdout ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 2024-05-03T22:28:38.697 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea... 2024-05-03T22:28:38.697 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stderr Getting image source signatures 2024-05-03T22:28:38.697 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stderr Copying blob sha256:e2f2fd2adca92139da4b4b907fa90a6775d3eb4eddaa977c42ef37c66eea70bd 2024-05-03T22:28:38.697 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stderr Copying blob sha256:8173fd91c96404ae0424bb08037c57749051dcbdfaeee9354a65e201dad7b0e2 2024-05-03T22:28:38.697 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stderr Copying config sha256:ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 2024-05-03T22:28:38.697 INFO:teuthology.orchestra.run.smithi044.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-03T22:28:39.982 INFO:teuthology.orchestra.run.smithi044.stdout:ceph: stdout ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev) 2024-05-03T22:28:39.983 INFO:teuthology.orchestra.run.smithi044.stdout:Ceph version: ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev) 2024-05-03T22:28:39.983 INFO:teuthology.orchestra.run.smithi044.stdout:Extracting ceph user uid/gid from container image... 2024-05-03T22:28:41.227 INFO:teuthology.orchestra.run.smithi044.stdout:stat: stdout 167 167 2024-05-03T22:28:41.227 INFO:teuthology.orchestra.run.smithi044.stdout:Creating initial keys... 2024-05-03T22:28:42.298 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-authtool: stdout AQAZZTVmvKbAKRAA2SxMI+oYodQbB4FOs7BWSg== 2024-05-03T22:28:43.456 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-authtool: stdout AQAaZTVmK4dIMBAAIBva+dxKx4EaBq0Cu5fsxw== 2024-05-03T22:28:44.561 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph-authtool: stdout AQAbZTVm032MNhAAU0jWB0m38RgLglE7ouH6Dw== 2024-05-03T22:28:44.563 INFO:teuthology.orchestra.run.smithi044.stdout:Creating initial monmap... 2024-05-03T22:28:45.781 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-03T22:28:45.781 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-05-03T22:28:45.781 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:28:45.781 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-03T22:28:45.781 INFO:teuthology.orchestra.run.smithi044.stdout:monmaptool for a [v2:172.21.15.44:3300,v1:172.21.15.44:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-03T22:28:45.781 INFO:teuthology.orchestra.run.smithi044.stdout:setting min_mon_release = quincy 2024-05-03T22:28:45.781 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: set fsid to 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:28:45.781 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-03T22:28:45.782 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:28:45.782 INFO:teuthology.orchestra.run.smithi044.stdout:Creating mon... 2024-05-03T22:28:46.987 INFO:teuthology.orchestra.run.smithi044.stdout:create mon.a on 2024-05-03T22:28:47.392 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-03T22:28:47.643 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-03T22:28:47.945 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-5b0efdca-099c-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-5b0efdca-099c-11ef-bc97-c7b262605968.target. 2024-05-03T22:28:47.945 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-5b0efdca-099c-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-5b0efdca-099c-11ef-bc97-c7b262605968.target. 2024-05-03T22:28:48.343 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mon.a 2024-05-03T22:28:48.343 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mon.a.service: Unit ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mon.a.service not loaded. 2024-05-03T22:28:48.670 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5b0efdca-099c-11ef-bc97-c7b262605968.target.wants/ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mon.a.service → /etc/systemd/system/ceph-5b0efdca-099c-11ef-bc97-c7b262605968@.service. 2024-05-03T22:28:49.385 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:49 smithi044 podman[28217]: 2024-05-03 22:28:49.382187925 +0000 UTC m=+0.447629402 container init e632d8b5512517d49b38fad083fb4f58594c62f4eb7ca6d6c6781666de8da09c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-a, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:28:49.506 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-03T22:28:49.506 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout disabled 2024-05-03T22:28:49.521 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-03T22:28:49.522 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-05-03T22:28:49.522 INFO:teuthology.orchestra.run.smithi044.stdout:firewalld.service is not enabled 2024-05-03T22:28:49.522 INFO:teuthology.orchestra.run.smithi044.stdout:Not possible to enable service . firewalld.service is not available 2024-05-03T22:28:49.524 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mon to start... 2024-05-03T22:28:49.524 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mon... 2024-05-03T22:28:49.675 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:49 smithi044 podman[28217]: 2024-05-03 22:28:49.39362023 +0000 UTC m=+0.459061706 container start e632d8b5512517d49b38fad083fb4f58594c62f4eb7ca6d6c6781666de8da09c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240430, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:28:49.675 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:49 smithi044 bash[28217]: e632d8b5512517d49b38fad083fb4f58594c62f4eb7ca6d6c6781666de8da09c 2024-05-03T22:28:49.675 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:49 smithi044 ceph-mon[28237]: mkfs 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:28:49.675 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:49 smithi044 systemd[1]: Started Ceph mon.a for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:28:49.675 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:49 smithi044 ceph-mon[28237]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-03T22:28:50.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:50 smithi044 ceph-mon[28237]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-03T22:28:50.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:50 smithi044 ceph-mon[28237]: monmap epoch 1 2024-05-03T22:28:50.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:50 smithi044 ceph-mon[28237]: fsid 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:28:50.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:50 smithi044 ceph-mon[28237]: last_changed 2024-05-03T22:28:45.098903+0000 2024-05-03T22:28:50.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:50 smithi044 ceph-mon[28237]: created 2024-05-03T22:28:45.098903+0000 2024-05-03T22:28:50.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:50 smithi044 ceph-mon[28237]: min_mon_release 19 (squid) 2024-05-03T22:28:50.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:50 smithi044 ceph-mon[28237]: election_strategy: 1 2024-05-03T22:28:50.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:50 smithi044 ceph-mon[28237]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-05-03T22:28:50.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:50 smithi044 ceph-mon[28237]: fsmap 2024-05-03T22:28:50.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:50 smithi044 ceph-mon[28237]: osdmap e1: 0 total, 0 up, 0 in 2024-05-03T22:28:50.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:50 smithi044 ceph-mon[28237]: mgrmap e1: no daemons active 2024-05-03T22:28:50.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:50 smithi044 ceph-mon[28237]: from='client.? 172.21.15.44:0/2940609085' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-03T22:28:50.898 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout cluster: 2024-05-03T22:28:50.899 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout id: 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:28:50.899 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-03T22:28:50.899 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-05-03T22:28:50.899 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout services: 2024-05-03T22:28:50.900 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.765846s) 2024-05-03T22:28:50.900 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-03T22:28:50.900 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-03T22:28:50.900 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-05-03T22:28:50.900 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout data: 2024-05-03T22:28:50.900 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-03T22:28:50.900 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-03T22:28:50.903 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-03T22:28:50.903 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout pgs: 2024-05-03T22:28:50.903 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-05-03T22:28:50.903 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.141+0000 7fc515e00700 1 Processor -- start 2024-05-03T22:28:50.903 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.141+0000 7fc515e00700 1 -- start start 2024-05-03T22:28:50.903 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.141+0000 7fc515e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc510107e60 0x7fc510108280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:28:50.903 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.142+0000 7fc515e00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc5101087c0 con 0x7fc510107e60 2024-05-03T22:28:50.903 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.142+0000 7fc50ea00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc510107e60 0x7fc510108280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:28:50.903 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.142+0000 7fc50ea00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc510107e60 0x7fc510108280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37732/0 (socket says 172.21.15.44:37732) 2024-05-03T22:28:50.903 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.142+0000 7fc50ea00700 1 -- 172.21.15.44:0/1578238707 learned_addr learned my addr 172.21.15.44:0/1578238707 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:28:50.903 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.143+0000 7fc50ea00700 1 -- 172.21.15.44:0/1578238707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc510108fc0 con 0x7fc510107e60 2024-05-03T22:28:50.904 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.143+0000 7fc50ea00700 1 --2- 172.21.15.44:0/1578238707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc510107e60 0x7fc510108280 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc5000098a0 tx=0x7fc500009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ff59d75ccbb395 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:28:50.904 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.144+0000 7fc50d600700 1 -- 172.21.15.44:0/1578238707 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc500004160 con 0x7fc510107e60 2024-05-03T22:28:50.904 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.144+0000 7fc50d600700 1 -- 172.21.15.44:0/1578238707 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc500004300 con 0x7fc510107e60 2024-05-03T22:28:50.904 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.144+0000 7fc50d600700 1 -- 172.21.15.44:0/1578238707 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5000036a0 con 0x7fc510107e60 2024-05-03T22:28:50.904 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.144+0000 7fc515e00700 1 -- 172.21.15.44:0/1578238707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc510107e60 msgr2=0x7fc510108280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:28:50.904 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.144+0000 7fc515e00700 1 --2- 172.21.15.44:0/1578238707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc510107e60 0x7fc510108280 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc5000098a0 tx=0x7fc500009bb0 comp rx=0 tx=0).stop 2024-05-03T22:28:50.904 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.144+0000 7fc515e00700 1 -- 172.21.15.44:0/1578238707 shutdown_connections 2024-05-03T22:28:50.904 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.144+0000 7fc515e00700 1 --2- 172.21.15.44:0/1578238707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc510107e60 0x7fc510108280 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:28:50.904 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.144+0000 7fc515e00700 1 -- 172.21.15.44:0/1578238707 >> 172.21.15.44:0/1578238707 conn(0x7fc5101033e0 msgr2=0x7fc510105840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:28:50.904 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.144+0000 7fc515e00700 1 -- 172.21.15.44:0/1578238707 shutdown_connections 2024-05-03T22:28:50.904 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.145+0000 7fc515e00700 1 -- 172.21.15.44:0/1578238707 wait complete. 2024-05-03T22:28:50.904 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.146+0000 7fc515e00700 1 Processor -- start 2024-05-03T22:28:50.907 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.146+0000 7fc515e00700 1 -- start start 2024-05-03T22:28:50.907 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.146+0000 7fc515e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc510107e60 0x7fc51019e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:28:50.908 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.146+0000 7fc515e00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc510109490 con 0x7fc510107e60 2024-05-03T22:28:50.908 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.146+0000 7fc50ea00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc510107e60 0x7fc51019e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:28:50.908 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.146+0000 7fc50ea00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc510107e60 0x7fc51019e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37746/0 (socket says 172.21.15.44:37746) 2024-05-03T22:28:50.908 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.146+0000 7fc50ea00700 1 -- 172.21.15.44:0/2940609085 learned_addr learned my addr 172.21.15.44:0/2940609085 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:28:50.908 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.147+0000 7fc50ea00700 1 -- 172.21.15.44:0/2940609085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc51019ed70 con 0x7fc510107e60 2024-05-03T22:28:50.908 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.147+0000 7fc50ea00700 1 --2- 172.21.15.44:0/2940609085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc510107e60 0x7fc51019e830 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc500000c00 tx=0x7fc500004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:28:50.908 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.147+0000 7fc514a00700 1 -- 172.21.15.44:0/2940609085 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc500003db0 con 0x7fc510107e60 2024-05-03T22:28:50.908 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.147+0000 7fc514a00700 1 -- 172.21.15.44:0/2940609085 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc500011630 con 0x7fc510107e60 2024-05-03T22:28:50.908 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.147+0000 7fc514a00700 1 -- 172.21.15.44:0/2940609085 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc500011950 con 0x7fc510107e60 2024-05-03T22:28:50.908 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.147+0000 7fc515e00700 1 -- 172.21.15.44:0/2940609085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc51019f000 con 0x7fc510107e60 2024-05-03T22:28:50.908 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.148+0000 7fc515e00700 1 -- 172.21.15.44:0/2940609085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5101a1cf0 con 0x7fc510107e60 2024-05-03T22:28:50.908 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.148+0000 7fc514a00700 1 -- 172.21.15.44:0/2940609085 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc50001a460 con 0x7fc510107e60 2024-05-03T22:28:50.908 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.148+0000 7fc514a00700 1 -- 172.21.15.44:0/2940609085 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc50001b780 con 0x7fc510107e60 2024-05-03T22:28:50.908 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.149+0000 7fc515e00700 1 -- 172.21.15.44:0/2940609085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc510064b00 con 0x7fc510107e60 2024-05-03T22:28:50.909 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.153+0000 7fc514a00700 1 -- 172.21.15.44:0/2940609085 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc50001b980 con 0x7fc510107e60 2024-05-03T22:28:50.909 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.234+0000 7fc515e00700 1 -- 172.21.15.44:0/2940609085 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fc51002e760 con 0x7fc510107e60 2024-05-03T22:28:50.909 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.234+0000 7fc514a00700 1 -- 172.21.15.44:0/2940609085 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fc50001bb60 con 0x7fc510107e60 2024-05-03T22:28:50.909 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.236+0000 7fc515e00700 1 -- 172.21.15.44:0/2940609085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc510107e60 msgr2=0x7fc51019e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:28:50.909 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.236+0000 7fc515e00700 1 --2- 172.21.15.44:0/2940609085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc510107e60 0x7fc51019e830 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc500000c00 tx=0x7fc500004750 comp rx=0 tx=0).stop 2024-05-03T22:28:50.909 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.236+0000 7fc515e00700 1 -- 172.21.15.44:0/2940609085 shutdown_connections 2024-05-03T22:28:50.909 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.236+0000 7fc515e00700 1 --2- 172.21.15.44:0/2940609085 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc510107e60 0x7fc51019e830 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:28:50.909 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.236+0000 7fc515e00700 1 -- 172.21.15.44:0/2940609085 >> 172.21.15.44:0/2940609085 conn(0x7fc5101033e0 msgr2=0x7fc5101955a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:28:50.909 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.236+0000 7fc515e00700 1 -- 172.21.15.44:0/2940609085 shutdown_connections 2024-05-03T22:28:50.909 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:50.236+0000 7fc515e00700 1 -- 172.21.15.44:0/2940609085 wait complete. 2024-05-03T22:28:50.909 INFO:teuthology.orchestra.run.smithi044.stdout:mon is available 2024-05-03T22:28:50.909 INFO:teuthology.orchestra.run.smithi044.stdout:Assimilating anything we can from ceph.conf... 2024-05-03T22:28:51.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:51 smithi044 ceph-mon[28237]: from='client.? 172.21.15.44:0/2781722255' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-03T22:28:51.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:51 smithi044 ceph-mon[28237]: from='client.? 172.21.15.44:0/2781722255' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-03T22:28:52.288 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-05-03T22:28:52.288 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [global] 2024-05-03T22:28:52.289 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout fsid = 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:28:52.289 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-03T22:28:52.289 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.44:3300,v1:172.21.15.44:6789] 2024-05-03T22:28:52.289 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-03T22:28:52.289 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-03T22:28:52.290 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-03T22:28:52.290 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-03T22:28:52.290 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-05-03T22:28:52.290 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-03T22:28:52.290 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-03T22:28:52.290 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-05-03T22:28:52.290 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [osd] 2024-05-03T22:28:52.292 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-03T22:28:52.292 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-03T22:28:52.292 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-03T22:28:52.292 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-03T22:28:52.292 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-03T22:28:52.292 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.487+0000 7fe730800700 1 Processor -- start 2024-05-03T22:28:52.292 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.487+0000 7fe730800700 1 -- start start 2024-05-03T22:28:52.292 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.488+0000 7fe730800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe72810b130 0x7fe72810b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:28:52.292 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.488+0000 7fe730800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe72810bb20 con 0x7fe72810b130 2024-05-03T22:28:52.292 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.489+0000 7fe72de00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe72810b130 0x7fe72810b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:28:52.293 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.489+0000 7fe72de00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe72810b130 0x7fe72810b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37762/0 (socket says 172.21.15.44:37762) 2024-05-03T22:28:52.295 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.489+0000 7fe72de00700 1 -- 172.21.15.44:0/2704582998 learned_addr learned my addr 172.21.15.44:0/2704582998 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:28:52.295 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.489+0000 7fe72de00700 1 -- 172.21.15.44:0/2704582998 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72810c330 con 0x7fe72810b130 2024-05-03T22:28:52.295 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.490+0000 7fe72de00700 1 --2- 172.21.15.44:0/2704582998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe72810b130 0x7fe72810b550 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0098a0 tx=0x7fe71c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685e7c8485097f1a server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:28:52.295 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.490+0000 7fe72ca00700 1 -- 172.21.15.44:0/2704582998 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe71c004160 con 0x7fe72810b130 2024-05-03T22:28:52.296 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.490+0000 7fe72ca00700 1 -- 172.21.15.44:0/2704582998 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe71c004300 con 0x7fe72810b130 2024-05-03T22:28:52.296 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.490+0000 7fe72ca00700 1 -- 172.21.15.44:0/2704582998 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe71c0036a0 con 0x7fe72810b130 2024-05-03T22:28:52.296 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.491+0000 7fe730800700 1 -- 172.21.15.44:0/2704582998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe72810b130 msgr2=0x7fe72810b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:28:52.296 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.491+0000 7fe730800700 1 --2- 172.21.15.44:0/2704582998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe72810b130 0x7fe72810b550 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0098a0 tx=0x7fe71c009bb0 comp rx=0 tx=0).stop 2024-05-03T22:28:52.296 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.491+0000 7fe730800700 1 -- 172.21.15.44:0/2704582998 shutdown_connections 2024-05-03T22:28:52.296 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.491+0000 7fe730800700 1 --2- 172.21.15.44:0/2704582998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe72810b130 0x7fe72810b550 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:28:52.296 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.491+0000 7fe730800700 1 -- 172.21.15.44:0/2704582998 >> 172.21.15.44:0/2704582998 conn(0x7fe72807e520 msgr2=0x7fe72807e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:28:52.296 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.491+0000 7fe730800700 1 -- 172.21.15.44:0/2704582998 shutdown_connections 2024-05-03T22:28:52.296 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.491+0000 7fe730800700 1 -- 172.21.15.44:0/2704582998 wait complete. 2024-05-03T22:28:52.296 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.492+0000 7fe730800700 1 Processor -- start 2024-05-03T22:28:52.296 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.492+0000 7fe730800700 1 -- start start 2024-05-03T22:28:52.297 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.493+0000 7fe730800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe72810b130 0x7fe72819e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:28:52.297 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.493+0000 7fe730800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe72810c860 con 0x7fe72810b130 2024-05-03T22:28:52.297 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.493+0000 7fe72de00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe72810b130 0x7fe72819e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:28:52.297 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.494+0000 7fe72de00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe72810b130 0x7fe72819e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37772/0 (socket says 172.21.15.44:37772) 2024-05-03T22:28:52.297 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.494+0000 7fe72de00700 1 -- 172.21.15.44:0/2781722255 learned_addr learned my addr 172.21.15.44:0/2781722255 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:28:52.297 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.494+0000 7fe72de00700 1 -- 172.21.15.44:0/2781722255 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72819ed70 con 0x7fe72810b130 2024-05-03T22:28:52.299 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.494+0000 7fe72de00700 1 --2- 172.21.15.44:0/2781722255 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe72810b130 0x7fe72819e830 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe71c000c00 tx=0x7fe71c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:28:52.299 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.495+0000 7fe722a00700 1 -- 172.21.15.44:0/2781722255 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe71c003db0 con 0x7fe72810b130 2024-05-03T22:28:52.299 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.495+0000 7fe722a00700 1 -- 172.21.15.44:0/2781722255 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe71c011630 con 0x7fe72810b130 2024-05-03T22:28:52.299 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.495+0000 7fe722a00700 1 -- 172.21.15.44:0/2781722255 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe71c011950 con 0x7fe72810b130 2024-05-03T22:28:52.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.495+0000 7fe730800700 1 -- 172.21.15.44:0/2781722255 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe72819f000 con 0x7fe72810b130 2024-05-03T22:28:52.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.495+0000 7fe730800700 1 -- 172.21.15.44:0/2781722255 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7281a1cf0 con 0x7fe72810b130 2024-05-03T22:28:52.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.495+0000 7fe722a00700 1 -- 172.21.15.44:0/2781722255 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe71c01a460 con 0x7fe72810b130 2024-05-03T22:28:52.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.495+0000 7fe722a00700 1 -- 172.21.15.44:0/2781722255 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe71c01b780 con 0x7fe72810b130 2024-05-03T22:28:52.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.496+0000 7fe730800700 1 -- 172.21.15.44:0/2781722255 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe728064b00 con 0x7fe72810b130 2024-05-03T22:28:52.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.499+0000 7fe722a00700 1 -- 172.21.15.44:0/2781722255 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fe71c031020 con 0x7fe72810b130 2024-05-03T22:28:52.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.577+0000 7fe730800700 1 -- 172.21.15.44:0/2781722255 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fe72802e810 con 0x7fe72810b130 2024-05-03T22:28:52.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.584+0000 7fe722a00700 1 -- 172.21.15.44:0/2781722255 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7fe71c01b9d0 con 0x7fe72810b130 2024-05-03T22:28:52.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.585+0000 7fe730800700 1 -- 172.21.15.44:0/2781722255 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe72810b130 msgr2=0x7fe72819e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:28:52.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.585+0000 7fe730800700 1 --2- 172.21.15.44:0/2781722255 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe72810b130 0x7fe72819e830 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe71c000c00 tx=0x7fe71c004750 comp rx=0 tx=0).stop 2024-05-03T22:28:52.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.585+0000 7fe730800700 1 -- 172.21.15.44:0/2781722255 shutdown_connections 2024-05-03T22:28:52.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.585+0000 7fe730800700 1 --2- 172.21.15.44:0/2781722255 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe72810b130 0x7fe72819e830 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:28:52.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.585+0000 7fe730800700 1 -- 172.21.15.44:0/2781722255 >> 172.21.15.44:0/2781722255 conn(0x7fe72807e520 msgr2=0x7fe728195490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:28:52.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.586+0000 7fe730800700 1 -- 172.21.15.44:0/2781722255 shutdown_connections 2024-05-03T22:28:52.300 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:51.586+0000 7fe730800700 1 -- 172.21.15.44:0/2781722255 wait complete. 2024-05-03T22:28:52.301 INFO:teuthology.orchestra.run.smithi044.stdout:Generating new minimal ceph.conf... 2024-05-03T22:28:53.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:53 smithi044 ceph-mon[28237]: from='client.? 172.21.15.44:0/2254428820' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:28:53.940 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.035+0000 7f5a35400700 1 Processor -- start 2024-05-03T22:28:53.940 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.035+0000 7f5a35400700 1 -- start start 2024-05-03T22:28:53.940 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.035+0000 7f5a35400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a3007f750 0x7f5a3007dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:28:53.940 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.035+0000 7f5a35400700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3007e180 con 0x7f5a3007f750 2024-05-03T22:28:53.940 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.036+0000 7f5a2e800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a3007f750 0x7f5a3007dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:28:53.940 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.036+0000 7f5a2e800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a3007f750 0x7f5a3007dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37784/0 (socket says 172.21.15.44:37784) 2024-05-03T22:28:53.943 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.036+0000 7f5a2e800700 1 -- 172.21.15.44:0/1065350107 learned_addr learned my addr 172.21.15.44:0/1065350107 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:28:53.943 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.036+0000 7f5a2e800700 1 -- 172.21.15.44:0/1065350107 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3007e300 con 0x7f5a3007f750 2024-05-03T22:28:53.943 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.037+0000 7f5a2e800700 1 --2- 172.21.15.44:0/1065350107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a3007f750 0x7f5a3007dbb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5a180098a0 tx=0x7f5a18009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32cb7de4503f08f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:28:53.943 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.037+0000 7f5a2d400700 1 -- 172.21.15.44:0/1065350107 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a18004160 con 0x7f5a3007f750 2024-05-03T22:28:53.943 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.037+0000 7f5a2d400700 1 -- 172.21.15.44:0/1065350107 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a18004300 con 0x7f5a3007f750 2024-05-03T22:28:53.943 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.037+0000 7f5a2d400700 1 -- 172.21.15.44:0/1065350107 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a18011b30 con 0x7f5a3007f750 2024-05-03T22:28:53.943 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.038+0000 7f5a35400700 1 -- 172.21.15.44:0/1065350107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a3007f750 msgr2=0x7f5a3007dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:28:53.943 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.038+0000 7f5a35400700 1 --2- 172.21.15.44:0/1065350107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a3007f750 0x7f5a3007dbb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5a180098a0 tx=0x7f5a18009bb0 comp rx=0 tx=0).stop 2024-05-03T22:28:53.943 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.038+0000 7f5a35400700 1 -- 172.21.15.44:0/1065350107 shutdown_connections 2024-05-03T22:28:53.943 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.038+0000 7f5a35400700 1 --2- 172.21.15.44:0/1065350107 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a3007f750 0x7f5a3007dbb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:28:53.943 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.038+0000 7f5a35400700 1 -- 172.21.15.44:0/1065350107 >> 172.21.15.44:0/1065350107 conn(0x7f5a301044e0 msgr2=0x7f5a30106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:28:53.943 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.038+0000 7f5a35400700 1 -- 172.21.15.44:0/1065350107 shutdown_connections 2024-05-03T22:28:53.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.038+0000 7f5a35400700 1 -- 172.21.15.44:0/1065350107 wait complete. 2024-05-03T22:28:53.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.039+0000 7f5a35400700 1 Processor -- start 2024-05-03T22:28:53.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.039+0000 7f5a35400700 1 -- start start 2024-05-03T22:28:53.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.040+0000 7f5a35400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a3007f750 0x7f5a3019f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:28:53.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.040+0000 7f5a35400700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3010f4e0 con 0x7f5a3007f750 2024-05-03T22:28:53.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.040+0000 7f5a2e800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a3007f750 0x7f5a3019f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:28:53.944 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.040+0000 7f5a2e800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a3007f750 0x7f5a3019f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37790/0 (socket says 172.21.15.44:37790) 2024-05-03T22:28:53.946 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.040+0000 7f5a2e800700 1 -- 172.21.15.44:0/2254428820 learned_addr learned my addr 172.21.15.44:0/2254428820 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:28:53.947 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.040+0000 7f5a2e800700 1 -- 172.21.15.44:0/2254428820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3019f650 con 0x7f5a3007f750 2024-05-03T22:28:53.947 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.041+0000 7f5a2e800700 1 --2- 172.21.15.44:0/2254428820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a3007f750 0x7f5a3019f110 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5a18011840 tx=0x7f5a18011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:28:53.947 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.041+0000 7f5a27400700 1 -- 172.21.15.44:0/2254428820 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a180039e0 con 0x7f5a3007f750 2024-05-03T22:28:53.947 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.041+0000 7f5a27400700 1 -- 172.21.15.44:0/2254428820 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a18020070 con 0x7f5a3007f750 2024-05-03T22:28:53.947 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.041+0000 7f5a35400700 1 -- 172.21.15.44:0/2254428820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3019f8e0 con 0x7f5a3007f750 2024-05-03T22:28:53.947 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.041+0000 7f5a27400700 1 -- 172.21.15.44:0/2254428820 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a18019550 con 0x7f5a3007f750 2024-05-03T22:28:53.947 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.041+0000 7f5a35400700 1 -- 172.21.15.44:0/2254428820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a301a25d0 con 0x7f5a3007f750 2024-05-03T22:28:53.947 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.042+0000 7f5a27400700 1 -- 172.21.15.44:0/2254428820 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5a18019b90 con 0x7f5a3007f750 2024-05-03T22:28:53.947 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.042+0000 7f5a27400700 1 -- 172.21.15.44:0/2254428820 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5a1800b720 con 0x7f5a3007f750 2024-05-03T22:28:53.947 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.043+0000 7f5a35400700 1 -- 172.21.15.44:0/2254428820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a30064b00 con 0x7f5a3007f750 2024-05-03T22:28:53.947 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.045+0000 7f5a27400700 1 -- 172.21.15.44:0/2254428820 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5a18003b80 con 0x7f5a3007f750 2024-05-03T22:28:53.947 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.124+0000 7f5a35400700 1 -- 172.21.15.44:0/2254428820 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f5a301a27a0 con 0x7f5a3007f750 2024-05-03T22:28:53.948 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.124+0000 7f5a27400700 1 -- 172.21.15.44:0/2254428820 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f5a1800b970 con 0x7f5a3007f750 2024-05-03T22:28:53.948 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.126+0000 7f5a35400700 1 -- 172.21.15.44:0/2254428820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a3007f750 msgr2=0x7f5a3019f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:28:53.948 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.126+0000 7f5a35400700 1 --2- 172.21.15.44:0/2254428820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a3007f750 0x7f5a3019f110 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5a18011840 tx=0x7f5a18011c00 comp rx=0 tx=0).stop 2024-05-03T22:28:53.948 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.126+0000 7f5a35400700 1 -- 172.21.15.44:0/2254428820 shutdown_connections 2024-05-03T22:28:53.948 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.126+0000 7f5a35400700 1 --2- 172.21.15.44:0/2254428820 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5a3007f750 0x7f5a3019f110 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:28:53.948 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.126+0000 7f5a35400700 1 -- 172.21.15.44:0/2254428820 >> 172.21.15.44:0/2254428820 conn(0x7f5a301044e0 msgr2=0x7f5a301050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:28:53.948 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.126+0000 7f5a35400700 1 -- 172.21.15.44:0/2254428820 shutdown_connections 2024-05-03T22:28:53.948 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:53.126+0000 7f5a35400700 1 -- 172.21.15.44:0/2254428820 wait complete. 2024-05-03T22:28:53.948 INFO:teuthology.orchestra.run.smithi044.stdout:Restarting the monitor... 2024-05-03T22:28:54.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:53 smithi044 systemd[1]: Stopping Ceph mon.a for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T22:28:54.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:54 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-a[28233]: 2024-05-03T22:28:54.442+0000 7fc8bfc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T22:28:54.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:54 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-a[28233]: 2024-05-03T22:28:54.442+0000 7fc8bfc00700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-03T22:28:54.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:54 smithi044 podman[28479]: 2024-05-03 22:28:54.650294198 +0000 UTC m=+0.326889252 container died e632d8b5512517d49b38fad083fb4f58594c62f4eb7ca6d6c6781666de8da09c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-05-03T22:28:55.246 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:55 smithi044 podman[28479]: 2024-05-03 22:28:55.027361382 +0000 UTC m=+0.703956477 container cleanup e632d8b5512517d49b38fad083fb4f58594c62f4eb7ca6d6c6781666de8da09c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-a, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-03T22:28:55.247 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:55 smithi044 bash[28479]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-a 2024-05-03T22:28:55.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:55 smithi044 podman[28493]: 2024-05-03 22:28:55.244826273 +0000 UTC m=+0.574628557 container remove e632d8b5512517d49b38fad083fb4f58594c62f4eb7ca6d6c6781666de8da09c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2) 2024-05-03T22:28:56.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:55 smithi044 systemd[1]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-03T22:28:56.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:55 smithi044 systemd[1]: Stopped Ceph mon.a for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:28:56.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:55 smithi044 systemd[1]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mon.a.service: Consumed 1.921s CPU time. 2024-05-03T22:28:56.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:55 smithi044 systemd[1]: Starting Ceph mon.a for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T22:28:56.362 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 podman[28585]: 2024-05-03 22:28:56.010234678 +0000 UTC m=+0.039856302 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:28:56.362 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 podman[28585]: 2024-05-03 22:28:56.120470007 +0000 UTC m=+0.150091631 container create de4db08ce6345c7bd078146653f3a317a3fb794c980d38fb3b956f151ffc69b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-03T22:28:56.362 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 podman[28585]: 2024-05-03 22:28:56.349305318 +0000 UTC m=+0.378926973 container init de4db08ce6345c7bd078146653f3a317a3fb794c980d38fb3b956f151ffc69b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-a, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240430, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:28:56.362 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 podman[28585]: 2024-05-03 22:28:56.360686664 +0000 UTC m=+0.390308313 container start de4db08ce6345c7bd078146653f3a317a3fb794c980d38fb3b956f151ffc69b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-a, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True) 2024-05-03T22:28:56.450 INFO:teuthology.orchestra.run.smithi044.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-03T22:28:56.731 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: set uid:gid to 167:167 (ceph:ceph) 2024-05-03T22:28:56.732 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev), process ceph-mon, pid 2 2024-05-03T22:28:56.732 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: pidfile_write: ignore empty --pid-file 2024-05-03T22:28:56.732 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: load: jerasure load: lrc 2024-05-03T22:28:56.732 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: RocksDB version: 7.9.2 2024-05-03T22:28:56.732 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Git sha 0 2024-05-03T22:28:56.732 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Compile date 2024-05-01 21:12:03 2024-05-03T22:28:56.732 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: DB SUMMARY 2024-05-03T22:28:56.732 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: DB Session ID: PNEQ3506PKUXYHAKLFMW 2024-05-03T22:28:56.732 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: CURRENT file: CURRENT 2024-05-03T22:28:56.732 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: IDENTITY file: IDENTITY 2024-05-03T22:28:56.732 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-03T22:28:56.732 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-03T22:28:56.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104604 ; 2024-05-03T22:28:56.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.error_if_exists: 0 2024-05-03T22:28:56.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.create_if_missing: 0 2024-05-03T22:28:56.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.paranoid_checks: 1 2024-05-03T22:28:56.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-03T22:28:56.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-03T22:28:56.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-03T22:28:56.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.env: 0x55a7d78cacc0 2024-05-03T22:28:56.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.fs: PosixFileSystem 2024-05-03T22:28:56.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.info_log: 0x55a7f6f9fde0 2024-05-03T22:28:56.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_file_opening_threads: 16 2024-05-03T22:28:56.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.statistics: (nil) 2024-05-03T22:28:56.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.use_fsync: 0 2024-05-03T22:28:56.733 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_log_file_size: 0 2024-05-03T22:28:56.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-03T22:28:56.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-03T22:28:56.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.keep_log_file_num: 1000 2024-05-03T22:28:56.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.recycle_log_file_num: 0 2024-05-03T22:28:56.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.allow_fallocate: 1 2024-05-03T22:28:56.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.allow_mmap_reads: 0 2024-05-03T22:28:56.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.allow_mmap_writes: 0 2024-05-03T22:28:56.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.use_direct_reads: 0 2024-05-03T22:28:56.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-03T22:28:56.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.create_missing_column_families: 0 2024-05-03T22:28:56.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.db_log_dir: 2024-05-03T22:28:56.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.wal_dir: 2024-05-03T22:28:56.734 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-03T22:28:56.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-03T22:28:56.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-03T22:28:56.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-03T22:28:56.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-03T22:28:56.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-03T22:28:56.735 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.advise_random_on_open: 1 2024-05-03T22:28:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.db_write_buffer_size: 0 2024-05-03T22:28:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.write_buffer_manager: 0x55a7f6f710e0 2024-05-03T22:28:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-03T22:28:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-03T22:28:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-03T22:28:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.rate_limiter: (nil) 2024-05-03T22:28:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-03T22:28:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.wal_recovery_mode: 2 2024-05-03T22:28:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.enable_thread_tracking: 0 2024-05-03T22:28:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.enable_pipelined_write: 0 2024-05-03T22:28:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.unordered_write: 0 2024-05-03T22:28:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-03T22:28:56.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-03T22:28:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-03T22:28:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-03T22:28:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.row_cache: None 2024-05-03T22:28:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.wal_filter: None 2024-05-03T22:28:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-03T22:28:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.allow_ingest_behind: 0 2024-05-03T22:28:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.two_write_queues: 0 2024-05-03T22:28:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.manual_wal_flush: 0 2024-05-03T22:28:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.wal_compression: 0 2024-05-03T22:28:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.atomic_flush: 0 2024-05-03T22:28:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-03T22:28:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-03T22:28:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-03T22:28:56.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.log_readahead_size: 0 2024-05-03T22:28:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-03T22:28:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.best_efforts_recovery: 0 2024-05-03T22:28:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-03T22:28:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-03T22:28:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.allow_data_in_errors: 0 2024-05-03T22:28:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.db_host_id: __hostname__ 2024-05-03T22:28:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-03T22:28:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_background_jobs: 2 2024-05-03T22:28:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_background_compactions: -1 2024-05-03T22:28:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_subcompactions: 1 2024-05-03T22:28:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-03T22:28:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-03T22:28:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-03T22:28:56.738 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_total_wal_size: 0 2024-05-03T22:28:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-03T22:28:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-03T22:28:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-03T22:28:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-03T22:28:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_open_files: -1 2024-05-03T22:28:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.bytes_per_sync: 0 2024-05-03T22:28:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-03T22:28:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-03T22:28:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compaction_readahead_size: 0 2024-05-03T22:28:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_background_flushes: -1 2024-05-03T22:28:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Compression algorithms supported: 2024-05-03T22:28:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-03T22:28:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: kZSTD supported: 0 2024-05-03T22:28:56.739 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: kXpressCompression supported: 0 2024-05-03T22:28:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: kLZ4HCCompression supported: 1 2024-05-03T22:28:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: kZlibCompression supported: 1 2024-05-03T22:28:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: kSnappyCompression supported: 1 2024-05-03T22:28:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: kLZ4Compression supported: 1 2024-05-03T22:28:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: kBZip2Compression supported: 0 2024-05-03T22:28:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-03T22:28:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-03T22:28:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-03T22:28:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-03T22:28:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-03T22:28:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.merge_operator: 2024-05-03T22:28:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compaction_filter: None 2024-05-03T22:28:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compaction_filter_factory: None 2024-05-03T22:28:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.sst_partitioner_factory: None 2024-05-03T22:28:56.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-03T22:28:56.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-03T22:28:56.741 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a7f6f9ffa0) 2024-05-03T22:28:56.741 INFO:journalctl@ceph.mon.a.smithi044.stdout: cache_index_and_filter_blocks: 1 2024-05-03T22:28:56.741 INFO:journalctl@ceph.mon.a.smithi044.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-03T22:28:56.742 INFO:journalctl@ceph.mon.a.smithi044.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-03T22:28:56.742 INFO:journalctl@ceph.mon.a.smithi044.stdout: pin_top_level_index_and_filter: 1 2024-05-03T22:28:56.742 INFO:journalctl@ceph.mon.a.smithi044.stdout: index_type: 0 2024-05-03T22:28:56.742 INFO:journalctl@ceph.mon.a.smithi044.stdout: data_block_index_type: 0 2024-05-03T22:28:56.742 INFO:journalctl@ceph.mon.a.smithi044.stdout: index_shortening: 1 2024-05-03T22:28:56.742 INFO:journalctl@ceph.mon.a.smithi044.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-03T22:28:56.742 INFO:journalctl@ceph.mon.a.smithi044.stdout: checksum: 4 2024-05-03T22:28:56.742 INFO:journalctl@ceph.mon.a.smithi044.stdout: no_block_cache: 0 2024-05-03T22:28:56.742 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_cache: 0x55a7f6fa31f0 2024-05-03T22:28:56.742 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_cache_name: BinnedLRUCache 2024-05-03T22:28:56.742 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_cache_options: 2024-05-03T22:28:56.743 INFO:journalctl@ceph.mon.a.smithi044.stdout: capacity : 536870912 2024-05-03T22:28:56.743 INFO:journalctl@ceph.mon.a.smithi044.stdout: num_shard_bits : 4 2024-05-03T22:28:56.743 INFO:journalctl@ceph.mon.a.smithi044.stdout: strict_capacity_limit : 0 2024-05-03T22:28:56.743 INFO:journalctl@ceph.mon.a.smithi044.stdout: high_pri_pool_ratio: 0.000 2024-05-03T22:28:56.743 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_cache_compressed: (nil) 2024-05-03T22:28:56.743 INFO:journalctl@ceph.mon.a.smithi044.stdout: persistent_cache: (nil) 2024-05-03T22:28:56.743 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_size: 4096 2024-05-03T22:28:56.743 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_size_deviation: 10 2024-05-03T22:28:56.743 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_restart_interval: 16 2024-05-03T22:28:56.743 INFO:journalctl@ceph.mon.a.smithi044.stdout: index_block_restart_interval: 1 2024-05-03T22:28:56.743 INFO:journalctl@ceph.mon.a.smithi044.stdout: metadata_block_size: 4096 2024-05-03T22:28:56.743 INFO:journalctl@ceph.mon.a.smithi044.stdout: partition_filters: 0 2024-05-03T22:28:56.743 INFO:journalctl@ceph.mon.a.smithi044.stdout: use_delta_encoding: 1 2024-05-03T22:28:56.743 INFO:journalctl@ceph.mon.a.smithi044.stdout: filter_policy: bloomfilter 2024-05-03T22:28:56.744 INFO:journalctl@ceph.mon.a.smithi044.stdout: whole_key_filtering: 1 2024-05-03T22:28:56.744 INFO:journalctl@ceph.mon.a.smithi044.stdout: verify_compression: 0 2024-05-03T22:28:56.744 INFO:journalctl@ceph.mon.a.smithi044.stdout: read_amp_bytes_per_bit: 0 2024-05-03T22:28:56.744 INFO:journalctl@ceph.mon.a.smithi044.stdout: format_version: 5 2024-05-03T22:28:56.744 INFO:journalctl@ceph.mon.a.smithi044.stdout: enable_index_compression: 1 2024-05-03T22:28:56.744 INFO:journalctl@ceph.mon.a.smithi044.stdout: block_align: 0 2024-05-03T22:28:56.744 INFO:journalctl@ceph.mon.a.smithi044.stdout: max_auto_readahead_size: 262144 2024-05-03T22:28:56.744 INFO:journalctl@ceph.mon.a.smithi044.stdout: prepopulate_block_cache: 0 2024-05-03T22:28:56.744 INFO:journalctl@ceph.mon.a.smithi044.stdout: initial_auto_readahead_size: 8192 2024-05-03T22:28:56.744 INFO:journalctl@ceph.mon.a.smithi044.stdout: num_file_reads_for_auto_readahead: 2 2024-05-03T22:28:56.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.write_buffer_size: 33554432 2024-05-03T22:28:56.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_write_buffer_number: 2 2024-05-03T22:28:56.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compression: NoCompression 2024-05-03T22:28:56.744 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.bottommost_compression: Disabled 2024-05-03T22:28:56.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.prefix_extractor: nullptr 2024-05-03T22:28:56.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-03T22:28:56.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.num_levels: 7 2024-05-03T22:28:56.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-03T22:28:56.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-03T22:28:56.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-03T22:28:56.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-03T22:28:56.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-03T22:28:56.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-03T22:28:56.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-03T22:28:56.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-03T22:28:56.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-03T22:28:56.745 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-03T22:28:56.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-03T22:28:56.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-03T22:28:56.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-03T22:28:56.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compression_opts.level: 32767 2024-05-03T22:28:56.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compression_opts.strategy: 0 2024-05-03T22:28:56.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-03T22:28:56.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-03T22:28:56.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-03T22:28:56.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-03T22:28:56.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compression_opts.enabled: false 2024-05-03T22:28:56.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-03T22:28:56.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-03T22:28:56.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-03T22:28:56.746 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-03T22:28:56.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.target_file_size_base: 67108864 2024-05-03T22:28:56.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-03T22:28:56.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-03T22:28:56.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-03T22:28:56.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-03T22:28:56.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-03T22:28:56.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-03T22:28:56.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-03T22:28:56.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-03T22:28:56.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-03T22:28:56.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-03T22:28:56.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-03T22:28:56.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-03T22:28:56.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-03T22:28:56.747 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-03T22:28:56.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.arena_block_size: 1048576 2024-05-03T22:28:56.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-03T22:28:56.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-03T22:28:56.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.disable_auto_compactions: 0 2024-05-03T22:28:56.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-03T22:28:56.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-03T22:28:56.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-03T22:28:56.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-03T22:28:56.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-03T22:28:56.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-03T22:28:56.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-03T22:28:56.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-03T22:28:56.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-03T22:28:56.748 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-03T22:28:56.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-03T22:28:56.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.inplace_update_support: 0 2024-05-03T22:28:56.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-03T22:28:56.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-03T22:28:56.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-03T22:28:56.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-03T22:28:56.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.bloom_locality: 0 2024-05-03T22:28:56.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.max_successive_merges: 0 2024-05-03T22:28:56.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-03T22:28:56.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.paranoid_file_checks: 0 2024-05-03T22:28:56.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.force_consistency_checks: 1 2024-05-03T22:28:56.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.report_bg_io_stats: 0 2024-05-03T22:28:56.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.ttl: 2592000 2024-05-03T22:28:56.749 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-03T22:28:56.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-03T22:28:56.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-03T22:28:56.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.enable_blob_files: false 2024-05-03T22:28:56.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.min_blob_size: 0 2024-05-03T22:28:56.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.blob_file_size: 268435456 2024-05-03T22:28:56.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-03T22:28:56.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-03T22:28:56.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-03T22:28:56.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-03T22:28:56.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-03T22:28:56.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.blob_file_starting_level: 0 2024-05-03T22:28:56.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-03T22:28:56.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-03T22:28:56.750 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-03T22:28:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9049a69f-43a0-4bb7-9f0c-26b7ae78137d 2024-05-03T22:28:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714775336419876, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-03T22:28:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-03T22:28:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714775336421431, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99878, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 324, "table_properties": {"data_size": 97762, "index_size": 308, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14050, "raw_average_key_size": 49, "raw_value_size": 90049, "raw_average_value_size": 318, "num_data_blocks": 12, "num_entries": 283, "num_filter_entries": 283, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714775336, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9049a69f-43a0-4bb7-9f0c-26b7ae78137d", "db_session_id": "PNEQ3506PKUXYHAKLFMW", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-03T22:28:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714775336421608, "job": 1, "event": "recovery_finished"} 2024-05-03T22:28:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-03T22:28:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-03T22:28:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a7f70c0000 2024-05-03T22:28:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: DB pointer 0x55a7f70ac000 2024-05-03T22:28:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-03T22:28:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-03T22:28:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout: ** DB Stats ** 2024-05-03T22:28:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-03T22:28:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-03T22:28:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-03T22:28:56.752 INFO:journalctl@ceph.mon.a.smithi044.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-03T22:28:56.752 INFO:journalctl@ceph.mon.a.smithi044.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-03T22:28:56.752 INFO:journalctl@ceph.mon.a.smithi044.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-03T22:28:56.752 INFO:journalctl@ceph.mon.a.smithi044.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-03T22:28:56.752 INFO:journalctl@ceph.mon.a.smithi044.stdout: 2024-05-03T22:28:56.752 INFO:journalctl@ceph.mon.a.smithi044.stdout: ** Compaction Stats [default] ** 2024-05-03T22:28:56.752 INFO:journalctl@ceph.mon.a.smithi044.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-03T22:28:56.752 INFO:journalctl@ceph.mon.a.smithi044.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-03T22:28:56.752 INFO:journalctl@ceph.mon.a.smithi044.stdout: L0 2/0 99.40 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 95.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:28:56.752 INFO:journalctl@ceph.mon.a.smithi044.stdout: Sum 2/0 99.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 95.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:28:56.752 INFO:journalctl@ceph.mon.a.smithi044.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 95.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:28:56.752 INFO:journalctl@ceph.mon.a.smithi044.stdout: 2024-05-03T22:28:56.752 INFO:journalctl@ceph.mon.a.smithi044.stdout: ** Compaction Stats [default] ** 2024-05-03T22:28:56.752 INFO:journalctl@ceph.mon.a.smithi044.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-03T22:28:56.753 INFO:journalctl@ceph.mon.a.smithi044.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-03T22:28:56.753 INFO:journalctl@ceph.mon.a.smithi044.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 95.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:28:56.753 INFO:journalctl@ceph.mon.a.smithi044.stdout: 2024-05-03T22:28:56.753 INFO:journalctl@ceph.mon.a.smithi044.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-03T22:28:56.753 INFO:journalctl@ceph.mon.a.smithi044.stdout: 2024-05-03T22:28:56.753 INFO:journalctl@ceph.mon.a.smithi044.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-03T22:28:56.753 INFO:journalctl@ceph.mon.a.smithi044.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-03T22:28:56.753 INFO:journalctl@ceph.mon.a.smithi044.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-03T22:28:56.753 INFO:journalctl@ceph.mon.a.smithi044.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-03T22:28:56.753 INFO:journalctl@ceph.mon.a.smithi044.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-03T22:28:56.753 INFO:journalctl@ceph.mon.a.smithi044.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-03T22:28:56.753 INFO:journalctl@ceph.mon.a.smithi044.stdout: Cumulative compaction: 0.00 GB write, 12.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-03T22:28:56.753 INFO:journalctl@ceph.mon.a.smithi044.stdout: Interval compaction: 0.00 GB write, 12.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-03T22:28:56.754 INFO:journalctl@ceph.mon.a.smithi044.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-03T22:28:56.754 INFO:journalctl@ceph.mon.a.smithi044.stdout: Block cache BinnedLRUCache@0x55a7f6fa31f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-05-03T22:28:56.754 INFO:journalctl@ceph.mon.a.smithi044.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-05-03T22:28:56.754 INFO:journalctl@ceph.mon.a.smithi044.stdout: 2024-05-03T22:28:56.754 INFO:journalctl@ceph.mon.a.smithi044.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-03T22:28:56.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: starting mon.a rank 0 at public addrs [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] at bind addrs [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:28:56.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: mon.a@-1(???) e1 preinit fsid 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:28:56.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: mon.a@-1(???).mds e1 new map 2024-05-03T22:28:56.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: mon.a@-1(???).mds e1 print_map 2024-05-03T22:28:56.754 INFO:journalctl@ceph.mon.a.smithi044.stdout: e1 2024-05-03T22:28:56.755 INFO:journalctl@ceph.mon.a.smithi044.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-03T22:28:56.755 INFO:journalctl@ceph.mon.a.smithi044.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-03T22:28:56.755 INFO:journalctl@ceph.mon.a.smithi044.stdout: legacy client fscid: -1 2024-05-03T22:28:56.755 INFO:journalctl@ceph.mon.a.smithi044.stdout: 2024-05-03T22:28:56.755 INFO:journalctl@ceph.mon.a.smithi044.stdout: No filesystems configured 2024-05-03T22:28:56.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-03T22:28:56.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T22:28:56.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T22:28:56.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T22:28:56.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-03T22:28:56.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 bash[28585]: de4db08ce6345c7bd078146653f3a317a3fb794c980d38fb3b956f151ffc69b6 2024-05-03T22:28:56.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 systemd[1]: Started Ceph mon.a for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:28:56.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-03T22:28:56.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: monmap epoch 1 2024-05-03T22:28:56.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: fsid 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:28:56.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: last_changed 2024-05-03T22:28:45.098903+0000 2024-05-03T22:28:56.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: created 2024-05-03T22:28:45.098903+0000 2024-05-03T22:28:56.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: min_mon_release 19 (squid) 2024-05-03T22:28:56.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: election_strategy: 1 2024-05-03T22:28:56.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-05-03T22:28:56.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: fsmap 2024-05-03T22:28:56.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: osdmap e1: 0 total, 0 up, 0 in 2024-05-03T22:28:56.756 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:56 smithi044 ceph-mon[28604]: mgrmap e1: no daemons active 2024-05-03T22:28:58.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:28:58 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1083871848' entity='client.admin' 2024-05-03T22:29:06.859 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.045+0000 7fd77e800700 1 Processor -- start 2024-05-03T22:29:06.859 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.045+0000 7fd77e800700 1 -- start start 2024-05-03T22:29:06.859 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.046+0000 7fd77e800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd778107280 0x7fd7781076a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:06.859 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.046+0000 7fd77e800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd778107be0 con 0x7fd778107280 2024-05-03T22:29:06.859 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.047+0000 7fd777400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd778107280 0x7fd7781076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:06.859 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.047+0000 7fd777400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd778107280 0x7fd7781076a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37802/0 (socket says 172.21.15.44:37802) 2024-05-03T22:29:06.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.047+0000 7fd777400700 1 -- 172.21.15.44:0/2727045916 learned_addr learned my addr 172.21.15.44:0/2727045916 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:06.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.047+0000 7fd777400700 1 -- 172.21.15.44:0/2727045916 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd778107d60 con 0x7fd778107280 2024-05-03T22:29:06.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.048+0000 7fd777400700 1 --2- 172.21.15.44:0/2727045916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd778107280 0x7fd7781076a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd7680098a0 tx=0x7fd768009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63b9627eb134bcd server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:06.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.048+0000 7fd776000700 1 -- 172.21.15.44:0/2727045916 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd768004160 con 0x7fd778107280 2024-05-03T22:29:06.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.048+0000 7fd776000700 1 -- 172.21.15.44:0/2727045916 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd768004300 con 0x7fd778107280 2024-05-03T22:29:06.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.048+0000 7fd776000700 1 -- 172.21.15.44:0/2727045916 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd768011b30 con 0x7fd778107280 2024-05-03T22:29:06.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.048+0000 7fd77e800700 1 -- 172.21.15.44:0/2727045916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd778107280 msgr2=0x7fd7781076a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:06.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.048+0000 7fd77e800700 1 --2- 172.21.15.44:0/2727045916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd778107280 0x7fd7781076a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd7680098a0 tx=0x7fd768009bb0 comp rx=0 tx=0).stop 2024-05-03T22:29:06.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.049+0000 7fd77e800700 1 -- 172.21.15.44:0/2727045916 shutdown_connections 2024-05-03T22:29:06.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.049+0000 7fd77e800700 1 --2- 172.21.15.44:0/2727045916 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd778107280 0x7fd7781076a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:06.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.049+0000 7fd77e800700 1 -- 172.21.15.44:0/2727045916 >> 172.21.15.44:0/2727045916 conn(0x7fd778102b60 msgr2=0x7fd778104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:06.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.049+0000 7fd77e800700 1 -- 172.21.15.44:0/2727045916 shutdown_connections 2024-05-03T22:29:06.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.049+0000 7fd77e800700 1 -- 172.21.15.44:0/2727045916 wait complete. 2024-05-03T22:29:06.860 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.050+0000 7fd77e800700 1 Processor -- start 2024-05-03T22:29:06.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.050+0000 7fd77e800700 1 -- start start 2024-05-03T22:29:06.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.050+0000 7fd77e800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd778107280 0x7fd77819f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:06.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.050+0000 7fd77e800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd77810d350 con 0x7fd778107280 2024-05-03T22:29:06.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.051+0000 7fd777400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd778107280 0x7fd77819f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:06.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.051+0000 7fd777400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd778107280 0x7fd77819f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37810/0 (socket says 172.21.15.44:37810) 2024-05-03T22:29:06.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.051+0000 7fd777400700 1 -- 172.21.15.44:0/1083871848 learned_addr learned my addr 172.21.15.44:0/1083871848 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:06.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.051+0000 7fd777400700 1 -- 172.21.15.44:0/1083871848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77819f680 con 0x7fd778107280 2024-05-03T22:29:06.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.052+0000 7fd777400700 1 --2- 172.21.15.44:0/1083871848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd778107280 0x7fd77819f140 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd768011840 tx=0x7fd768011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:06.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.052+0000 7fd76fe00700 1 -- 172.21.15.44:0/1083871848 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd768003aa0 con 0x7fd778107280 2024-05-03T22:29:06.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.052+0000 7fd76fe00700 1 -- 172.21.15.44:0/1083871848 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd768003c40 con 0x7fd778107280 2024-05-03T22:29:06.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.052+0000 7fd77e800700 1 -- 172.21.15.44:0/1083871848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd77819f910 con 0x7fd778107280 2024-05-03T22:29:06.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.052+0000 7fd76fe00700 1 -- 172.21.15.44:0/1083871848 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd7680247f0 con 0x7fd778107280 2024-05-03T22:29:06.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.052+0000 7fd77e800700 1 -- 172.21.15.44:0/1083871848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7781a2600 con 0x7fd778107280 2024-05-03T22:29:06.861 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.052+0000 7fd76fe00700 1 -- 172.21.15.44:0/1083871848 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd768022020 con 0x7fd778107280 2024-05-03T22:29:06.862 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.052+0000 7fd76fe00700 1 -- 172.21.15.44:0/1083871848 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd76802dcf0 con 0x7fd778107280 2024-05-03T22:29:06.862 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.053+0000 7fd77e800700 1 -- 172.21.15.44:0/1083871848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd778064b00 con 0x7fd778107280 2024-05-03T22:29:06.862 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.057+0000 7fd76fe00700 1 -- 172.21.15.44:0/1083871848 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd76801ac00 con 0x7fd778107280 2024-05-03T22:29:06.862 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.137+0000 7fd77e800700 1 -- 172.21.15.44:0/1083871848 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fd7781a27d0 con 0x7fd778107280 2024-05-03T22:29:06.862 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.141+0000 7fd76fe00700 1 -- 172.21.15.44:0/1083871848 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fd76802d3f0 con 0x7fd778107280 2024-05-03T22:29:06.862 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.143+0000 7fd77e800700 1 -- 172.21.15.44:0/1083871848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd778107280 msgr2=0x7fd77819f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:06.862 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.143+0000 7fd77e800700 1 --2- 172.21.15.44:0/1083871848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd778107280 0x7fd77819f140 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd768011840 tx=0x7fd768011c00 comp rx=0 tx=0).stop 2024-05-03T22:29:06.862 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.143+0000 7fd77e800700 1 -- 172.21.15.44:0/1083871848 shutdown_connections 2024-05-03T22:29:06.862 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.143+0000 7fd77e800700 1 --2- 172.21.15.44:0/1083871848 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd778107280 0x7fd77819f140 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:06.862 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.143+0000 7fd77e800700 1 -- 172.21.15.44:0/1083871848 >> 172.21.15.44:0/1083871848 conn(0x7fd778102b60 msgr2=0x7fd778103760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:06.862 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.143+0000 7fd77e800700 1 -- 172.21.15.44:0/1083871848 shutdown_connections 2024-05-03T22:29:06.862 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:28:57.143+0000 7fd77e800700 1 -- 172.21.15.44:0/1083871848 wait complete. 2024-05-03T22:29:06.863 INFO:teuthology.orchestra.run.smithi044.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-03T22:29:06.883 INFO:teuthology.orchestra.run.smithi044.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-03T22:29:06.883 INFO:teuthology.orchestra.run.smithi044.stdout:Creating mgr... 2024-05-03T22:29:06.885 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-03T22:29:06.886 INFO:teuthology.orchestra.run.smithi044.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-03T22:29:07.322 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mgr.x 2024-05-03T22:29:07.323 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Failed to reset failed state of unit ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mgr.x.service: Unit ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mgr.x.service not loaded. 2024-05-03T22:29:07.569 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-5b0efdca-099c-11ef-bc97-c7b262605968.target.wants/ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-5b0efdca-099c-11ef-bc97-c7b262605968@.service. 2024-05-03T22:29:07.963 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:07 smithi044 systemd[1]: Starting Ceph mgr.x for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T22:29:08.241 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:07 smithi044 podman[28823]: 2024-05-03 22:29:07.865118738 +0000 UTC m=+0.032521593 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea 2024-05-03T22:29:08.241 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:08 smithi044 podman[28823]: 2024-05-03 22:29:08.009795538 +0000 UTC m=+0.177198400 container create 4867f67c70cc9defc3ba41477d3a7a087f4d7f10eef800081321111b7696f91f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-03T22:29:08.241 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:08 smithi044 podman[28823]: 2024-05-03 22:29:08.238550803 +0000 UTC m=+0.405953702 container init 4867f67c70cc9defc3ba41477d3a7a087f4d7f10eef800081321111b7696f91f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:29:08.352 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-03T22:29:08.352 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout disabled 2024-05-03T22:29:08.368 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-03T22:29:08.368 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-05-03T22:29:08.369 INFO:teuthology.orchestra.run.smithi044.stdout:firewalld.service is not enabled 2024-05-03T22:29:08.369 INFO:teuthology.orchestra.run.smithi044.stdout:Not possible to enable service . firewalld.service is not available 2024-05-03T22:29:08.389 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-03T22:29:08.389 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout disabled 2024-05-03T22:29:08.406 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-03T22:29:08.407 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-05-03T22:29:08.407 INFO:teuthology.orchestra.run.smithi044.stdout:firewalld.service is not enabled 2024-05-03T22:29:08.407 INFO:teuthology.orchestra.run.smithi044.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-03T22:29:08.407 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mgr to start... 2024-05-03T22:29:08.407 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mgr... 2024-05-03T22:29:08.501 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:08 smithi044 podman[28823]: 2024-05-03 22:29:08.250538991 +0000 UTC m=+0.417941889 container start 4867f67c70cc9defc3ba41477d3a7a087f4d7f10eef800081321111b7696f91f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T22:29:08.502 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:08 smithi044 bash[28823]: 4867f67c70cc9defc3ba41477d3a7a087f4d7f10eef800081321111b7696f91f 2024-05-03T22:29:08.502 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:08 smithi044 systemd[1]: Started Ceph mgr.x for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:29:08.756 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:08 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:08.501+0000 7f0f887d7200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-03T22:29:09.017 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:08 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:08.770+0000 7f0f887d7200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:29:09.017 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:08 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:08.913+0000 7f0f887d7200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-03T22:29:09.354 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:09 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3734207293' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-03T22:29:09.752 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:09 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:09.352+0000 7f0f887d7200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-03T22:29:09.752 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:09 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:09.468+0000 7f0f887d7200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-03T22:29:10.204 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-05-03T22:29:10.207 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-05-03T22:29:10.207 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsid": "5b0efdca-099c-11ef-bc97-c7b262605968", 2024-05-03T22:29:10.207 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "health": { 2024-05-03T22:29:10.207 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-03T22:29:10.207 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-03T22:29:10.207 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-03T22:29:10.207 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:10.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-03T22:29:10.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-03T22:29:10.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 0 2024-05-03T22:29:10.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:29:10.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-03T22:29:10.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "a" 2024-05-03T22:29:10.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:29:10.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-05-03T22:29:10.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-03T22:29:10.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:29:10.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-03T22:29:10.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-03T22:29:10.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:10.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-03T22:29:10.208 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:29:10.209 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-03T22:29:10.209 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-03T22:29:10.209 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-03T22:29:10.217 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-03T22:29:10.217 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-03T22:29:10.217 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-03T22:29:10.217 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:10.217 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-03T22:29:10.217 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-03T22:29:10.217 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-03T22:29:10.217 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-03T22:29:10.217 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-03T22:29:10.217 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-03T22:29:10.217 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-03T22:29:10.217 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-03T22:29:10.218 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-03T22:29:10.218 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:10.218 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-03T22:29:10.218 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:29:10.218 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-03T22:29:10.218 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-03T22:29:10.218 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:10.218 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-03T22:29:10.218 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-03T22:29:10.218 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-03T22:29:10.218 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-03T22:29:10.218 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-03T22:29:10.218 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-03T22:29:10.219 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "restful" 2024-05-03T22:29:10.219 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:29:10.219 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T22:29:10.219 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:10.219 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-03T22:29:10.219 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:29:10.219 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modified": "2024-05-03T22:28:49.473012+0000", 2024-05-03T22:29:10.219 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T22:29:10.219 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:10.219 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-03T22:29:10.219 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-05-03T22:29:10.219 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.059+0000 7f62dd000700 1 Processor -- start 2024-05-03T22:29:10.219 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.059+0000 7f62dd000700 1 -- start start 2024-05-03T22:29:10.219 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.059+0000 7f62dd000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62d807ee80 0x7f62d807d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:10.219 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.059+0000 7f62dd000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f62d807d8b0 con 0x7f62d807ee80 2024-05-03T22:29:10.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.060+0000 7f62d7400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62d807ee80 0x7f62d807d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:10.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.060+0000 7f62d7400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62d807ee80 0x7f62d807d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37594/0 (socket says 172.21.15.44:37594) 2024-05-03T22:29:10.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.060+0000 7f62d7400700 1 -- 172.21.15.44:0/4253313454 learned_addr learned my addr 172.21.15.44:0/4253313454 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:10.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.061+0000 7f62d7400700 1 -- 172.21.15.44:0/4253313454 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d807da30 con 0x7f62d807ee80 2024-05-03T22:29:10.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.061+0000 7f62d7400700 1 --2- 172.21.15.44:0/4253313454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62d807ee80 0x7f62d807d2e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f62c80098a0 tx=0x7f62c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581fad7faef207fe server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:10.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.061+0000 7f62d6000700 1 -- 172.21.15.44:0/4253313454 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62c8004160 con 0x7f62d807ee80 2024-05-03T22:29:10.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.061+0000 7f62d6000700 1 -- 172.21.15.44:0/4253313454 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62c8004300 con 0x7f62d807ee80 2024-05-03T22:29:10.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.061+0000 7f62d6000700 1 -- 172.21.15.44:0/4253313454 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62c8011b30 con 0x7f62d807ee80 2024-05-03T22:29:10.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.062+0000 7f62dd000700 1 -- 172.21.15.44:0/4253313454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62d807ee80 msgr2=0x7f62d807d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:10.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.062+0000 7f62dd000700 1 --2- 172.21.15.44:0/4253313454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62d807ee80 0x7f62d807d2e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f62c80098a0 tx=0x7f62c8009bb0 comp rx=0 tx=0).stop 2024-05-03T22:29:10.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.062+0000 7f62dd000700 1 -- 172.21.15.44:0/4253313454 shutdown_connections 2024-05-03T22:29:10.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.062+0000 7f62dd000700 1 --2- 172.21.15.44:0/4253313454 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62d807ee80 0x7f62d807d2e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:10.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.062+0000 7f62dd000700 1 -- 172.21.15.44:0/4253313454 >> 172.21.15.44:0/4253313454 conn(0x7f62d8104270 msgr2=0x7f62d81066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:10.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.062+0000 7f62dd000700 1 -- 172.21.15.44:0/4253313454 shutdown_connections 2024-05-03T22:29:10.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.063+0000 7f62dd000700 1 -- 172.21.15.44:0/4253313454 wait complete. 2024-05-03T22:29:10.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.063+0000 7f62dd000700 1 Processor -- start 2024-05-03T22:29:10.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.064+0000 7f62dd000700 1 -- start start 2024-05-03T22:29:10.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.064+0000 7f62dd000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62d807ee80 0x7f62d819ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:10.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.064+0000 7f62dd000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f62d810f2c0 con 0x7f62d807ee80 2024-05-03T22:29:10.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.064+0000 7f62d7400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62d807ee80 0x7f62d819ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:10.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.064+0000 7f62d7400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62d807ee80 0x7f62d819ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37610/0 (socket says 172.21.15.44:37610) 2024-05-03T22:29:10.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.064+0000 7f62d7400700 1 -- 172.21.15.44:0/3734207293 learned_addr learned my addr 172.21.15.44:0/3734207293 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:10.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.065+0000 7f62d7400700 1 -- 172.21.15.44:0/3734207293 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d819f480 con 0x7f62d807ee80 2024-05-03T22:29:10.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.065+0000 7f62d7400700 1 --2- 172.21.15.44:0/3734207293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62d807ee80 0x7f62d819ef40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f62c8011840 tx=0x7f62c8011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:10.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.065+0000 7f62cfe00700 1 -- 172.21.15.44:0/3734207293 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62c8003aa0 con 0x7f62d807ee80 2024-05-03T22:29:10.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.065+0000 7f62cfe00700 1 -- 172.21.15.44:0/3734207293 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62c8003c40 con 0x7f62d807ee80 2024-05-03T22:29:10.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.065+0000 7f62dd000700 1 -- 172.21.15.44:0/3734207293 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62d819f710 con 0x7f62d807ee80 2024-05-03T22:29:10.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.065+0000 7f62cfe00700 1 -- 172.21.15.44:0/3734207293 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62c80247f0 con 0x7f62d807ee80 2024-05-03T22:29:10.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.066+0000 7f62dd000700 1 -- 172.21.15.44:0/3734207293 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62d81a2400 con 0x7f62d807ee80 2024-05-03T22:29:10.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.066+0000 7f62cfe00700 1 -- 172.21.15.44:0/3734207293 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f62c8022020 con 0x7f62d807ee80 2024-05-03T22:29:10.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.066+0000 7f62cfe00700 1 -- 172.21.15.44:0/3734207293 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f62c802d8f0 con 0x7f62d807ee80 2024-05-03T22:29:10.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.067+0000 7f62dd000700 1 -- 172.21.15.44:0/3734207293 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62d8064b00 con 0x7f62d807ee80 2024-05-03T22:29:10.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.069+0000 7f62cfe00700 1 -- 172.21.15.44:0/3734207293 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f62c802d3f0 con 0x7f62d807ee80 2024-05-03T22:29:10.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.147+0000 7f62dd000700 1 -- 172.21.15.44:0/3734207293 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f62d81a29a0 con 0x7f62d807ee80 2024-05-03T22:29:10.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.148+0000 7f62cfe00700 1 -- 172.21.15.44:0/3734207293 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f62c801a8b0 con 0x7f62d807ee80 2024-05-03T22:29:10.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.150+0000 7f62dd000700 1 -- 172.21.15.44:0/3734207293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62d807ee80 msgr2=0x7f62d819ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:10.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.150+0000 7f62dd000700 1 --2- 172.21.15.44:0/3734207293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62d807ee80 0x7f62d819ef40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f62c8011840 tx=0x7f62c8011c00 comp rx=0 tx=0).stop 2024-05-03T22:29:10.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.150+0000 7f62dd000700 1 -- 172.21.15.44:0/3734207293 shutdown_connections 2024-05-03T22:29:10.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.150+0000 7f62dd000700 1 --2- 172.21.15.44:0/3734207293 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62d807ee80 0x7f62d819ef40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:10.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.150+0000 7f62dd000700 1 -- 172.21.15.44:0/3734207293 >> 172.21.15.44:0/3734207293 conn(0x7f62d8104270 msgr2=0x7f62d8104f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:10.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.150+0000 7f62dd000700 1 -- 172.21.15.44:0/3734207293 shutdown_connections 2024-05-03T22:29:10.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:09.150+0000 7f62dd000700 1 -- 172.21.15.44:0/3734207293 wait complete. 2024-05-03T22:29:10.223 INFO:teuthology.orchestra.run.smithi044.stdout:mgr not available, waiting (1/15)... 2024-05-03T22:29:11.501 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:11 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:11.100+0000 7f0f887d7200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-03T22:29:11.502 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:11 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:11.332+0000 7f0f887d7200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-03T22:29:11.943 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:11 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:11.549+0000 7f0f887d7200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-03T22:29:11.944 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:11 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:11.941+0000 7f0f887d7200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-03T22:29:12.251 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:12 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:12.067+0000 7f0f887d7200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-03T22:29:12.589 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:12 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:12.324+0000 7f0f887d7200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-03T22:29:12.589 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:12 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:12.587+0000 7f0f887d7200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:29:13.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:13 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/800386173' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-03T22:29:13.709 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:13 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:13.410+0000 7f0f887d7200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-03T22:29:13.709 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:13 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:13.706+0000 7f0f887d7200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-03T22:29:13.727 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-05-03T22:29:13.728 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-05-03T22:29:13.728 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsid": "5b0efdca-099c-11ef-bc97-c7b262605968", 2024-05-03T22:29:13.730 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "health": { 2024-05-03T22:29:13.730 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-03T22:29:13.730 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-03T22:29:13.730 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-03T22:29:13.730 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:13.730 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-03T22:29:13.730 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-03T22:29:13.730 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 0 2024-05-03T22:29:13.730 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:29:13.730 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-03T22:29:13.731 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "a" 2024-05-03T22:29:13.732 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:29:13.732 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_age": 16, 2024-05-03T22:29:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-03T22:29:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:29:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-03T22:29:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-03T22:29:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-03T22:29:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:29:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-03T22:29:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-03T22:29:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-03T22:29:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-03T22:29:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-03T22:29:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-03T22:29:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-03T22:29:13.733 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-03T22:29:13.734 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-03T22:29:13.739 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-03T22:29:13.740 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-03T22:29:13.740 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-03T22:29:13.740 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-03T22:29:13.740 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-03T22:29:13.740 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-03T22:29:13.740 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:13.740 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-03T22:29:13.740 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:29:13.740 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-03T22:29:13.740 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-03T22:29:13.740 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:13.740 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-03T22:29:13.740 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-03T22:29:13.740 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-03T22:29:13.741 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-03T22:29:13.741 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-03T22:29:13.741 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-03T22:29:13.741 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "restful" 2024-05-03T22:29:13.741 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:29:13.741 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T22:29:13.741 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:13.741 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-03T22:29:13.741 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:29:13.741 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modified": "2024-05-03T22:28:49.473012+0000", 2024-05-03T22:29:13.741 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T22:29:13.741 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:13.741 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-03T22:29:13.741 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-05-03T22:29:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.858+0000 7f6172200700 1 Processor -- start 2024-05-03T22:29:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.858+0000 7f6172200700 1 -- start start 2024-05-03T22:29:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.859+0000 7f6172200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c07ee80 0x7f616c07d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.859+0000 7f6172200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f616c07d8b0 con 0x7f616c07ee80 2024-05-03T22:29:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.859+0000 7f616b400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c07ee80 0x7f616c07d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.859+0000 7f616b400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c07ee80 0x7f616c07d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52940/0 (socket says 172.21.15.44:52940) 2024-05-03T22:29:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.859+0000 7f616b400700 1 -- 172.21.15.44:0/4025615416 learned_addr learned my addr 172.21.15.44:0/4025615416 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.860+0000 7f616b400700 1 -- 172.21.15.44:0/4025615416 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f616c07da30 con 0x7f616c07ee80 2024-05-03T22:29:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.860+0000 7f616b400700 1 --2- 172.21.15.44:0/4025615416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c07ee80 0x7f616c07d2e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f615c0098a0 tx=0x7f615c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf075c8ffca4230 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.860+0000 7f616a000700 1 -- 172.21.15.44:0/4025615416 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f615c004160 con 0x7f616c07ee80 2024-05-03T22:29:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.860+0000 7f616a000700 1 -- 172.21.15.44:0/4025615416 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f615c004300 con 0x7f616c07ee80 2024-05-03T22:29:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.860+0000 7f616a000700 1 -- 172.21.15.44:0/4025615416 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f615c011b30 con 0x7f616c07ee80 2024-05-03T22:29:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.861+0000 7f6172200700 1 -- 172.21.15.44:0/4025615416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c07ee80 msgr2=0x7f616c07d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:13.742 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.861+0000 7f6172200700 1 --2- 172.21.15.44:0/4025615416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c07ee80 0x7f616c07d2e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f615c0098a0 tx=0x7f615c009bb0 comp rx=0 tx=0).stop 2024-05-03T22:29:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.861+0000 7f6172200700 1 -- 172.21.15.44:0/4025615416 shutdown_connections 2024-05-03T22:29:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.861+0000 7f6172200700 1 --2- 172.21.15.44:0/4025615416 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c07ee80 0x7f616c07d2e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.861+0000 7f6172200700 1 -- 172.21.15.44:0/4025615416 >> 172.21.15.44:0/4025615416 conn(0x7f616c1044a0 msgr2=0x7f616c1068e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.861+0000 7f6172200700 1 -- 172.21.15.44:0/4025615416 shutdown_connections 2024-05-03T22:29:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.861+0000 7f6172200700 1 -- 172.21.15.44:0/4025615416 wait complete. 2024-05-03T22:29:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.862+0000 7f6172200700 1 Processor -- start 2024-05-03T22:29:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.863+0000 7f6172200700 1 -- start start 2024-05-03T22:29:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.863+0000 7f6172200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c07ee80 0x7f616c19f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.863+0000 7f6172200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f616c10f4b0 con 0x7f616c07ee80 2024-05-03T22:29:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.863+0000 7f616b400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c07ee80 0x7f616c19f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.863+0000 7f616b400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c07ee80 0x7f616c19f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52942/0 (socket says 172.21.15.44:52942) 2024-05-03T22:29:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.863+0000 7f616b400700 1 -- 172.21.15.44:0/800386173 learned_addr learned my addr 172.21.15.44:0/800386173 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.863+0000 7f616b400700 1 -- 172.21.15.44:0/800386173 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f616c19f600 con 0x7f616c07ee80 2024-05-03T22:29:13.743 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.864+0000 7f616b400700 1 --2- 172.21.15.44:0/800386173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c07ee80 0x7f616c19f0c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f615c011840 tx=0x7f615c011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:13.744 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.864+0000 7f6163e00700 1 -- 172.21.15.44:0/800386173 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f615c003aa0 con 0x7f616c07ee80 2024-05-03T22:29:13.744 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.864+0000 7f6163e00700 1 -- 172.21.15.44:0/800386173 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f615c003c40 con 0x7f616c07ee80 2024-05-03T22:29:13.744 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.864+0000 7f6163e00700 1 -- 172.21.15.44:0/800386173 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f615c0247f0 con 0x7f616c07ee80 2024-05-03T22:29:13.745 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.864+0000 7f6172200700 1 -- 172.21.15.44:0/800386173 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f616c19f890 con 0x7f616c07ee80 2024-05-03T22:29:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.864+0000 7f6172200700 1 -- 172.21.15.44:0/800386173 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f616c1a2580 con 0x7f616c07ee80 2024-05-03T22:29:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.865+0000 7f6163e00700 1 -- 172.21.15.44:0/800386173 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f615c022020 con 0x7f616c07ee80 2024-05-03T22:29:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.865+0000 7f6163e00700 1 -- 172.21.15.44:0/800386173 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f615c02dcf0 con 0x7f616c07ee80 2024-05-03T22:29:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.865+0000 7f6172200700 1 -- 172.21.15.44:0/800386173 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f616c064b00 con 0x7f616c07ee80 2024-05-03T22:29:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.868+0000 7f6163e00700 1 -- 172.21.15.44:0/800386173 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f615c01ac00 con 0x7f616c07ee80 2024-05-03T22:29:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.948+0000 7f6172200700 1 -- 172.21.15.44:0/800386173 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f616c1a2ad0 con 0x7f616c07ee80 2024-05-03T22:29:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.949+0000 7f6163e00700 1 -- 172.21.15.44:0/800386173 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f615c02d3f0 con 0x7f616c07ee80 2024-05-03T22:29:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.950+0000 7f6172200700 1 -- 172.21.15.44:0/800386173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c07ee80 msgr2=0x7f616c19f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.950+0000 7f6172200700 1 --2- 172.21.15.44:0/800386173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c07ee80 0x7f616c19f0c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f615c011840 tx=0x7f615c011c00 comp rx=0 tx=0).stop 2024-05-03T22:29:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.950+0000 7f6172200700 1 -- 172.21.15.44:0/800386173 shutdown_connections 2024-05-03T22:29:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.950+0000 7f6172200700 1 --2- 172.21.15.44:0/800386173 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f616c07ee80 0x7f616c19f0c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.950+0000 7f6172200700 1 -- 172.21.15.44:0/800386173 >> 172.21.15.44:0/800386173 conn(0x7f616c1044a0 msgr2=0x7f616c105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.951+0000 7f6172200700 1 -- 172.21.15.44:0/800386173 shutdown_connections 2024-05-03T22:29:13.746 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:12.951+0000 7f6172200700 1 -- 172.21.15.44:0/800386173 wait complete. 2024-05-03T22:29:13.747 INFO:teuthology.orchestra.run.smithi044.stdout:mgr not available, waiting (2/15)... 2024-05-03T22:29:14.752 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:14 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:14.278+0000 7f0f887d7200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-03T22:29:14.752 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:14 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:14.409+0000 7f0f887d7200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-03T22:29:15.251 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:14 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:14.887+0000 7f0f887d7200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-03T22:29:15.752 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:15 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:15.354+0000 7f0f887d7200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-03T22:29:15.752 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:15 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:15.479+0000 7f0f887d7200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-03T22:29:16.077 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:15 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:15.809+0000 7f0f887d7200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-03T22:29:16.077 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:15 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:15.995+0000 7f0f887d7200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-03T22:29:16.671 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:16 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/281713326' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-03T22:29:16.671 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:16 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:16.382+0000 7f0f887d7200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-03T22:29:16.671 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:16 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:16.546+0000 7f0f887d7200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-03T22:29:16.671 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:16 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:16.669+0000 7f0f887d7200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-03T22:29:17.127 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-05-03T22:29:17.127 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-05-03T22:29:17.127 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsid": "5b0efdca-099c-11ef-bc97-c7b262605968", 2024-05-03T22:29:17.127 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "health": { 2024-05-03T22:29:17.127 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-03T22:29:17.128 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-03T22:29:17.128 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-03T22:29:17.128 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:17.128 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-03T22:29:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-03T22:29:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 0 2024-05-03T22:29:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:29:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-03T22:29:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "a" 2024-05-03T22:29:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:29:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_age": 20, 2024-05-03T22:29:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-03T22:29:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:29:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-03T22:29:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-03T22:29:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:17.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-03T22:29:17.131 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:29:17.131 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-03T22:29:17.131 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-03T22:29:17.131 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-03T22:29:17.137 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-03T22:29:17.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-03T22:29:17.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-03T22:29:17.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:17.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-03T22:29:17.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-03T22:29:17.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-03T22:29:17.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-03T22:29:17.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-03T22:29:17.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-03T22:29:17.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-03T22:29:17.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-03T22:29:17.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-03T22:29:17.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:17.138 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-03T22:29:17.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:29:17.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-03T22:29:17.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-03T22:29:17.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:17.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-03T22:29:17.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-03T22:29:17.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-03T22:29:17.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-03T22:29:17.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-03T22:29:17.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-03T22:29:17.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "restful" 2024-05-03T22:29:17.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:29:17.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T22:29:17.139 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-03T22:29:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:29:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modified": "2024-05-03T22:28:49.473012+0000", 2024-05-03T22:29:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T22:29:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-03T22:29:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-05-03T22:29:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.359+0000 7f031f000700 1 Processor -- start 2024-05-03T22:29:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.359+0000 7f031f000700 1 -- start start 2024-05-03T22:29:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.360+0000 7f031f000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03181099d0 0x7f031810bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.360+0000 7f031f000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f031807ce90 con 0x7f03181099d0 2024-05-03T22:29:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.360+0000 7f0317e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03181099d0 0x7f031810bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.361+0000 7f0317e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03181099d0 0x7f031810bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52944/0 (socket says 172.21.15.44:52944) 2024-05-03T22:29:17.140 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.361+0000 7f0317e00700 1 -- 172.21.15.44:0/2509406447 learned_addr learned my addr 172.21.15.44:0/2509406447 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:17.141 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.361+0000 7f0317e00700 1 -- 172.21.15.44:0/2509406447 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031810c300 con 0x7f03181099d0 2024-05-03T22:29:17.141 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.361+0000 7f0317e00700 1 --2- 172.21.15.44:0/2509406447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03181099d0 0x7f031810bdc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f03080098a0 tx=0x7f0308009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d080d8e23814ee server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:17.141 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.361+0000 7f0316a00700 1 -- 172.21.15.44:0/2509406447 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0308004160 con 0x7f03181099d0 2024-05-03T22:29:17.141 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.362+0000 7f0316a00700 1 -- 172.21.15.44:0/2509406447 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0308004300 con 0x7f03181099d0 2024-05-03T22:29:17.141 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.362+0000 7f0316a00700 1 -- 172.21.15.44:0/2509406447 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0308011b30 con 0x7f03181099d0 2024-05-03T22:29:17.141 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.362+0000 7f031f000700 1 -- 172.21.15.44:0/2509406447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03181099d0 msgr2=0x7f031810bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:17.141 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.362+0000 7f031f000700 1 --2- 172.21.15.44:0/2509406447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03181099d0 0x7f031810bdc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f03080098a0 tx=0x7f0308009bb0 comp rx=0 tx=0).stop 2024-05-03T22:29:17.141 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.363+0000 7f031f000700 1 -- 172.21.15.44:0/2509406447 shutdown_connections 2024-05-03T22:29:17.141 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.363+0000 7f031f000700 1 --2- 172.21.15.44:0/2509406447 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03181099d0 0x7f031810bdc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:17.141 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.363+0000 7f031f000700 1 -- 172.21.15.44:0/2509406447 >> 172.21.15.44:0/2509406447 conn(0x7f03181033e0 msgr2=0x7f0318105840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:17.141 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.363+0000 7f031f000700 1 -- 172.21.15.44:0/2509406447 shutdown_connections 2024-05-03T22:29:17.141 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.363+0000 7f031f000700 1 -- 172.21.15.44:0/2509406447 wait complete. 2024-05-03T22:29:17.141 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.364+0000 7f031f000700 1 Processor -- start 2024-05-03T22:29:17.141 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.364+0000 7f031f000700 1 -- start start 2024-05-03T22:29:17.142 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.364+0000 7f031f000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03181099d0 0x7f031819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:17.142 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.364+0000 7f031f000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f031810d2c0 con 0x7f03181099d0 2024-05-03T22:29:17.142 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.365+0000 7f0317e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03181099d0 0x7f031819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:17.142 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.365+0000 7f0317e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03181099d0 0x7f031819cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52956/0 (socket says 172.21.15.44:52956) 2024-05-03T22:29:17.142 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.365+0000 7f0317e00700 1 -- 172.21.15.44:0/281713326 learned_addr learned my addr 172.21.15.44:0/281713326 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:17.142 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.365+0000 7f0317e00700 1 -- 172.21.15.44:0/281713326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031819d400 con 0x7f03181099d0 2024-05-03T22:29:17.142 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.365+0000 7f0317e00700 1 --2- 172.21.15.44:0/281713326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03181099d0 0x7f031819cec0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0308011b50 tx=0x7f0308011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:17.142 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.366+0000 7f0314c00700 1 -- 172.21.15.44:0/281713326 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0308003aa0 con 0x7f03181099d0 2024-05-03T22:29:17.144 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.366+0000 7f0314c00700 1 -- 172.21.15.44:0/281713326 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0308020070 con 0x7f03181099d0 2024-05-03T22:29:17.144 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.366+0000 7f0314c00700 1 -- 172.21.15.44:0/281713326 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0308019550 con 0x7f03181099d0 2024-05-03T22:29:17.144 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.366+0000 7f031f000700 1 -- 172.21.15.44:0/281713326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f031819d690 con 0x7f03181099d0 2024-05-03T22:29:17.144 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.366+0000 7f031f000700 1 -- 172.21.15.44:0/281713326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03181a0380 con 0x7f03181099d0 2024-05-03T22:29:17.144 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.366+0000 7f0314c00700 1 -- 172.21.15.44:0/281713326 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0308019b50 con 0x7f03181099d0 2024-05-03T22:29:17.144 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.366+0000 7f0314c00700 1 -- 172.21.15.44:0/281713326 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f030800b720 con 0x7f03181099d0 2024-05-03T22:29:17.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.367+0000 7f031f000700 1 -- 172.21.15.44:0/281713326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0318064b00 con 0x7f03181099d0 2024-05-03T22:29:17.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.370+0000 7f0314c00700 1 -- 172.21.15.44:0/281713326 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0308003c40 con 0x7f03181099d0 2024-05-03T22:29:17.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.451+0000 7f031f000700 1 -- 172.21.15.44:0/281713326 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f03181a08d0 con 0x7f03181099d0 2024-05-03T22:29:17.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.451+0000 7f0314c00700 1 -- 172.21.15.44:0/281713326 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f030801aa00 con 0x7f03181099d0 2024-05-03T22:29:17.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.453+0000 7f031f000700 1 -- 172.21.15.44:0/281713326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03181099d0 msgr2=0x7f031819cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:17.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.453+0000 7f031f000700 1 --2- 172.21.15.44:0/281713326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03181099d0 0x7f031819cec0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0308011b50 tx=0x7f0308011c30 comp rx=0 tx=0).stop 2024-05-03T22:29:17.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.453+0000 7f031f000700 1 -- 172.21.15.44:0/281713326 shutdown_connections 2024-05-03T22:29:17.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.453+0000 7f031f000700 1 --2- 172.21.15.44:0/281713326 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f03181099d0 0x7f031819cec0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:17.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.453+0000 7f031f000700 1 -- 172.21.15.44:0/281713326 >> 172.21.15.44:0/281713326 conn(0x7f03181033e0 msgr2=0x7f0318103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:17.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.453+0000 7f031f000700 1 -- 172.21.15.44:0/281713326 shutdown_connections 2024-05-03T22:29:17.145 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:16.453+0000 7f031f000700 1 -- 172.21.15.44:0/281713326 wait complete. 2024-05-03T22:29:17.145 INFO:teuthology.orchestra.run.smithi044.stdout:mgr not available, waiting (3/15)... 2024-05-03T22:29:17.750 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:17 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:17.455+0000 7f0f887d7200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-03T22:29:17.750 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:17 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:17.748+0000 7f0f887d7200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-03T22:29:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:17 smithi044 ceph-mon[28604]: Activating manager daemon x 2024-05-03T22:29:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:17 smithi044 ceph-mon[28604]: mgrmap e2: x(active, starting, since 0.013812s) 2024-05-03T22:29:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:17 smithi044 ceph-mon[28604]: from='mgr.14100 172.21.15.44:0/2434728008' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-03T22:29:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:17 smithi044 ceph-mon[28604]: from='mgr.14100 172.21.15.44:0/2434728008' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-03T22:29:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:17 smithi044 ceph-mon[28604]: from='mgr.14100 172.21.15.44:0/2434728008' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-03T22:29:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:17 smithi044 ceph-mon[28604]: from='mgr.14100 172.21.15.44:0/2434728008' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:29:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:17 smithi044 ceph-mon[28604]: from='mgr.14100 172.21.15.44:0/2434728008' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-03T22:29:18.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:17 smithi044 ceph-mon[28604]: Manager daemon x is now available 2024-05-03T22:29:18.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:17 smithi044 ceph-mon[28604]: from='mgr.14100 172.21.15.44:0/2434728008' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-03T22:29:18.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:17 smithi044 ceph-mon[28604]: from='mgr.14100 172.21.15.44:0/2434728008' entity='mgr.x' 2024-05-03T22:29:18.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:17 smithi044 ceph-mon[28604]: from='mgr.14100 172.21.15.44:0/2434728008' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-03T22:29:19.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:18 smithi044 ceph-mon[28604]: from='mgr.14100 172.21.15.44:0/2434728008' entity='mgr.x' 2024-05-03T22:29:19.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:18 smithi044 ceph-mon[28604]: from='mgr.14100 172.21.15.44:0/2434728008' entity='mgr.x' 2024-05-03T22:29:19.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:18 smithi044 ceph-mon[28604]: mgrmap e3: x(active, since 1.02133s) 2024-05-03T22:29:20.759 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-05-03T22:29:20.760 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-05-03T22:29:20.760 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsid": "5b0efdca-099c-11ef-bc97-c7b262605968", 2024-05-03T22:29:20.760 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "health": { 2024-05-03T22:29:20.760 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-03T22:29:20.760 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-03T22:29:20.760 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-03T22:29:20.762 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:20.762 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-03T22:29:20.762 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-03T22:29:20.762 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 0 2024-05-03T22:29:20.762 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:29:20.762 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-03T22:29:20.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "a" 2024-05-03T22:29:20.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:29:20.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "quorum_age": 23, 2024-05-03T22:29:20.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-03T22:29:20.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:29:20.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-03T22:29:20.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-03T22:29:20.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:20.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-03T22:29:20.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:29:20.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-03T22:29:20.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-03T22:29:20.763 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-03T22:29:20.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-03T22:29:20.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-03T22:29:20.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-03T22:29:20.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:20.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-03T22:29:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-03T22:29:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-03T22:29:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-03T22:29:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-03T22:29:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-03T22:29:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-03T22:29:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-03T22:29:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-03T22:29:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-03T22:29:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:29:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-03T22:29:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-03T22:29:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:20.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-03T22:29:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-03T22:29:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-03T22:29:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-03T22:29:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-03T22:29:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-03T22:29:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "restful" 2024-05-03T22:29:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ], 2024-05-03T22:29:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T22:29:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-03T22:29:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-03T22:29:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "modified": "2024-05-03T22:28:49.473012+0000", 2024-05-03T22:29:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-03T22:29:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout }, 2024-05-03T22:29:20.769 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-03T22:29:20.770 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-05-03T22:29:20.770 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.771+0000 7f8a64000700 1 Processor -- start 2024-05-03T22:29:20.770 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.771+0000 7f8a64000700 1 -- start start 2024-05-03T22:29:20.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.772+0000 7f8a64000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a5c10b0e0 0x7f8a5c10b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:20.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.772+0000 7f8a64000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c10bad0 con 0x7f8a5c10b0e0 2024-05-03T22:29:20.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.772+0000 7f8a61600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a5c10b0e0 0x7f8a5c10b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:20.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.772+0000 7f8a61600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a5c10b0e0 0x7f8a5c10b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53034/0 (socket says 172.21.15.44:53034) 2024-05-03T22:29:20.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.772+0000 7f8a61600700 1 -- 172.21.15.44:0/3607149443 learned_addr learned my addr 172.21.15.44:0/3607149443 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:20.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.772+0000 7f8a61600700 1 -- 172.21.15.44:0/3607149443 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5c10c330 con 0x7f8a5c10b0e0 2024-05-03T22:29:20.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.773+0000 7f8a61600700 1 --2- 172.21.15.44:0/3607149443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a5c10b0e0 0x7f8a5c10b500 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8a500098a0 tx=0x7f8a50009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2806043125e2f584 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:20.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.773+0000 7f8a5be00700 1 -- 172.21.15.44:0/3607149443 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a50004160 con 0x7f8a5c10b0e0 2024-05-03T22:29:20.775 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.773+0000 7f8a5be00700 1 -- 172.21.15.44:0/3607149443 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a50004300 con 0x7f8a5c10b0e0 2024-05-03T22:29:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.773+0000 7f8a5be00700 1 -- 172.21.15.44:0/3607149443 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a50011b30 con 0x7f8a5c10b0e0 2024-05-03T22:29:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.774+0000 7f8a64000700 1 -- 172.21.15.44:0/3607149443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a5c10b0e0 msgr2=0x7f8a5c10b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.774+0000 7f8a64000700 1 --2- 172.21.15.44:0/3607149443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a5c10b0e0 0x7f8a5c10b500 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8a500098a0 tx=0x7f8a50009bb0 comp rx=0 tx=0).stop 2024-05-03T22:29:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.774+0000 7f8a64000700 1 -- 172.21.15.44:0/3607149443 shutdown_connections 2024-05-03T22:29:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.774+0000 7f8a64000700 1 --2- 172.21.15.44:0/3607149443 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a5c10b0e0 0x7f8a5c10b500 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.774+0000 7f8a64000700 1 -- 172.21.15.44:0/3607149443 >> 172.21.15.44:0/3607149443 conn(0x7f8a5c07e6a0 msgr2=0x7f8a5c07ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.774+0000 7f8a64000700 1 -- 172.21.15.44:0/3607149443 shutdown_connections 2024-05-03T22:29:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.774+0000 7f8a64000700 1 -- 172.21.15.44:0/3607149443 wait complete. 2024-05-03T22:29:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.775+0000 7f8a64000700 1 Processor -- start 2024-05-03T22:29:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.775+0000 7f8a64000700 1 -- start start 2024-05-03T22:29:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.776+0000 7f8a64000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a5c10b0e0 0x7f8a5c19f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.776+0000 7f8a64000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c10f6e0 con 0x7f8a5c10b0e0 2024-05-03T22:29:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.776+0000 7f8a61600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a5c10b0e0 0x7f8a5c19f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.776+0000 7f8a61600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a5c10b0e0 0x7f8a5c19f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53048/0 (socket says 172.21.15.44:53048) 2024-05-03T22:29:20.776 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.776+0000 7f8a61600700 1 -- 172.21.15.44:0/2134522498 learned_addr learned my addr 172.21.15.44:0/2134522498 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:20.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.776+0000 7f8a61600700 1 -- 172.21.15.44:0/2134522498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5c19f5a0 con 0x7f8a5c10b0e0 2024-05-03T22:29:20.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.777+0000 7f8a61600700 1 --2- 172.21.15.44:0/2134522498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a5c10b0e0 0x7f8a5c19f060 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8a50011b50 tx=0x7f8a50011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:20.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.777+0000 7f8a5a000700 1 -- 172.21.15.44:0/2134522498 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a50003aa0 con 0x7f8a5c10b0e0 2024-05-03T22:29:20.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.777+0000 7f8a5a000700 1 -- 172.21.15.44:0/2134522498 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a50020070 con 0x7f8a5c10b0e0 2024-05-03T22:29:20.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.777+0000 7f8a64000700 1 -- 172.21.15.44:0/2134522498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a5c19f830 con 0x7f8a5c10b0e0 2024-05-03T22:29:20.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.777+0000 7f8a5a000700 1 -- 172.21.15.44:0/2134522498 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8a50019550 con 0x7f8a5c10b0e0 2024-05-03T22:29:20.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.777+0000 7f8a64000700 1 -- 172.21.15.44:0/2134522498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a5c1a2520 con 0x7f8a5c10b0e0 2024-05-03T22:29:20.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.778+0000 7f8a64000700 1 -- 172.21.15.44:0/2134522498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a5c064b00 con 0x7f8a5c10b0e0 2024-05-03T22:29:20.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.778+0000 7f8a5a000700 1 -- 172.21.15.44:0/2134522498 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 3) ==== 50105+0+0 (secure 0 0 0) 0x7f8a5001a430 con 0x7f8a5c10b0e0 2024-05-03T22:29:20.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.779+0000 7f8a5a000700 1 --2- 172.21.15.44:0/2134522498 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f8a4403e300 0x7f8a440407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:20.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.779+0000 7f8a5a000700 1 -- 172.21.15.44:0/2134522498 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8a50053780 con 0x7f8a5c10b0e0 2024-05-03T22:29:20.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.779+0000 7f8a60c00700 1 --2- 172.21.15.44:0/2134522498 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f8a4403e300 0x7f8a440407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:20.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.780+0000 7f8a60c00700 1 --2- 172.21.15.44:0/2134522498 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f8a4403e300 0x7f8a440407c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8a48006fd0 tx=0x7f8a48006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:20.777 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.786+0000 7f8a5a000700 1 -- 172.21.15.44:0/2134522498 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8a50019810 con 0x7f8a5c10b0e0 2024-05-03T22:29:20.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:19.815+0000 7f8a5a000700 1 -- 172.21.15.44:0/2134522498 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f8a5002dd00 con 0x7f8a5c10b0e0 2024-05-03T22:29:20.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:20.118+0000 7f8a64000700 1 -- 172.21.15.44:0/2134522498 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8a5c1a26f0 con 0x7f8a5c10b0e0 2024-05-03T22:29:20.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:20.119+0000 7f8a5a000700 1 -- 172.21.15.44:0/2134522498 <== mon.0 v2:172.21.15.44:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f8a5c1a26f0 con 0x7f8a5c10b0e0 2024-05-03T22:29:20.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:20.122+0000 7f8a64000700 1 -- 172.21.15.44:0/2134522498 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f8a4403e300 msgr2=0x7f8a440407c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:20.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:20.122+0000 7f8a64000700 1 --2- 172.21.15.44:0/2134522498 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f8a4403e300 0x7f8a440407c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8a48006fd0 tx=0x7f8a48006e40 comp rx=0 tx=0).stop 2024-05-03T22:29:20.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:20.122+0000 7f8a64000700 1 -- 172.21.15.44:0/2134522498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a5c10b0e0 msgr2=0x7f8a5c19f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:20.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:20.122+0000 7f8a64000700 1 --2- 172.21.15.44:0/2134522498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a5c10b0e0 0x7f8a5c19f060 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8a50011b50 tx=0x7f8a50011c30 comp rx=0 tx=0).stop 2024-05-03T22:29:20.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:20.122+0000 7f8a64000700 1 -- 172.21.15.44:0/2134522498 shutdown_connections 2024-05-03T22:29:20.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:20.122+0000 7f8a64000700 1 --2- 172.21.15.44:0/2134522498 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f8a4403e300 0x7f8a440407c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:20.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:20.122+0000 7f8a64000700 1 --2- 172.21.15.44:0/2134522498 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a5c10b0e0 0x7f8a5c19f060 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:20.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:20.122+0000 7f8a64000700 1 -- 172.21.15.44:0/2134522498 >> 172.21.15.44:0/2134522498 conn(0x7f8a5c07e6a0 msgr2=0x7f8a5c108dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:20.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:20.123+0000 7f8a64000700 1 -- 172.21.15.44:0/2134522498 shutdown_connections 2024-05-03T22:29:20.778 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:20.123+0000 7f8a64000700 1 -- 172.21.15.44:0/2134522498 wait complete. 2024-05-03T22:29:20.779 INFO:teuthology.orchestra.run.smithi044.stdout:mgr is available 2024-05-03T22:29:20.997 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:20 smithi044 ceph-mon[28604]: mgrmap e4: x(active, since 2s) 2024-05-03T22:29:20.998 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:20 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2134522498' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-03T22:29:22.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:21 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3402077330' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-03T22:29:22.388 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-05-03T22:29:22.388 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [global] 2024-05-03T22:29:22.389 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout fsid = 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:29:22.389 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-03T22:29:22.389 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-03T22:29:22.389 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-03T22:29:22.389 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-03T22:29:22.389 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-03T22:29:22.389 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-05-03T22:29:22.389 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-03T22:29:22.389 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-03T22:29:22.389 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 2024-05-03T22:29:22.389 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout [osd] 2024-05-03T22:29:22.390 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-03T22:29:22.390 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-03T22:29:22.390 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-03T22:29:22.390 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-03T22:29:22.390 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-03T22:29:22.390 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.445+0000 7f703be00700 1 Processor -- start 2024-05-03T22:29:22.390 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.445+0000 7f703be00700 1 -- start start 2024-05-03T22:29:22.390 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.446+0000 7f703be00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703c108d40 0x7f703c109160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:22.390 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.446+0000 7f703be00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f703c109730 con 0x7f703c108d40 2024-05-03T22:29:22.390 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.446+0000 7f703aa00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703c108d40 0x7f703c109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:22.390 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.447+0000 7f703aa00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703c108d40 0x7f703c109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59432/0 (socket says 172.21.15.44:59432) 2024-05-03T22:29:22.391 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.447+0000 7f703aa00700 1 -- 172.21.15.44:0/1899791314 learned_addr learned my addr 172.21.15.44:0/1899791314 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:22.391 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.447+0000 7f703aa00700 1 -- 172.21.15.44:0/1899791314 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703c109f40 con 0x7f703c108d40 2024-05-03T22:29:22.391 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.447+0000 7f703aa00700 1 --2- 172.21.15.44:0/1899791314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703c108d40 0x7f703c109160 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f702c0098a0 tx=0x7f702c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8b5ce42ed49938 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:22.391 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.448+0000 7f7039600700 1 -- 172.21.15.44:0/1899791314 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f702c004160 con 0x7f703c108d40 2024-05-03T22:29:22.391 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.448+0000 7f7039600700 1 -- 172.21.15.44:0/1899791314 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f702c004300 con 0x7f703c108d40 2024-05-03T22:29:22.391 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.448+0000 7f7039600700 1 -- 172.21.15.44:0/1899791314 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f702c011b30 con 0x7f703c108d40 2024-05-03T22:29:22.391 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.449+0000 7f703be00700 1 -- 172.21.15.44:0/1899791314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703c108d40 msgr2=0x7f703c109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:22.391 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.449+0000 7f703be00700 1 --2- 172.21.15.44:0/1899791314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703c108d40 0x7f703c109160 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f702c0098a0 tx=0x7f702c009bb0 comp rx=0 tx=0).stop 2024-05-03T22:29:22.391 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.449+0000 7f703be00700 1 -- 172.21.15.44:0/1899791314 shutdown_connections 2024-05-03T22:29:22.391 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.449+0000 7f703be00700 1 --2- 172.21.15.44:0/1899791314 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703c108d40 0x7f703c109160 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:22.391 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.449+0000 7f703be00700 1 -- 172.21.15.44:0/1899791314 >> 172.21.15.44:0/1899791314 conn(0x7f703c1042c0 msgr2=0x7f703c106720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:22.391 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.449+0000 7f703be00700 1 -- 172.21.15.44:0/1899791314 shutdown_connections 2024-05-03T22:29:22.392 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.449+0000 7f703be00700 1 -- 172.21.15.44:0/1899791314 wait complete. 2024-05-03T22:29:22.392 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.450+0000 7f703be00700 1 Processor -- start 2024-05-03T22:29:22.392 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.451+0000 7f703be00700 1 -- start start 2024-05-03T22:29:22.392 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.451+0000 7f703be00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703c108d40 0x7f703c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:22.392 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.451+0000 7f703be00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f703c10d2f0 con 0x7f703c108d40 2024-05-03T22:29:22.392 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.451+0000 7f703aa00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703c108d40 0x7f703c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:22.392 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.451+0000 7f703aa00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703c108d40 0x7f703c19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59442/0 (socket says 172.21.15.44:59442) 2024-05-03T22:29:22.392 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.451+0000 7f703aa00700 1 -- 172.21.15.44:0/3402077330 learned_addr learned my addr 172.21.15.44:0/3402077330 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:22.392 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.452+0000 7f703aa00700 1 -- 172.21.15.44:0/3402077330 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f703c19d260 con 0x7f703c108d40 2024-05-03T22:29:22.392 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.452+0000 7f703aa00700 1 --2- 172.21.15.44:0/3402077330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703c108d40 0x7f703c19cd20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f702c011840 tx=0x7f702c011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:22.392 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.452+0000 7f7033400700 1 -- 172.21.15.44:0/3402077330 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f702c003aa0 con 0x7f703c108d40 2024-05-03T22:29:22.392 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.453+0000 7f7033400700 1 -- 172.21.15.44:0/3402077330 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f702c003c40 con 0x7f703c108d40 2024-05-03T22:29:22.393 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.453+0000 7f7033400700 1 -- 172.21.15.44:0/3402077330 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f702c0247f0 con 0x7f703c108d40 2024-05-03T22:29:22.393 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.453+0000 7f703be00700 1 -- 172.21.15.44:0/3402077330 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f703c19d4f0 con 0x7f703c108d40 2024-05-03T22:29:22.393 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.453+0000 7f703be00700 1 -- 172.21.15.44:0/3402077330 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f703c1a01d0 con 0x7f703c108d40 2024-05-03T22:29:22.393 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.454+0000 7f7033400700 1 -- 172.21.15.44:0/3402077330 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f702c022020 con 0x7f703c108d40 2024-05-03T22:29:22.393 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.454+0000 7f703be00700 1 -- 172.21.15.44:0/3402077330 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f703c064b00 con 0x7f703c108d40 2024-05-03T22:29:22.393 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.455+0000 7f7033400700 1 --2- 172.21.15.44:0/3402077330 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f702003e470 0x7f7020040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:22.393 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.455+0000 7f7033400700 1 -- 172.21.15.44:0/3402077330 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f702c053190 con 0x7f703c108d40 2024-05-03T22:29:22.393 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.455+0000 7f703a000700 1 --2- 172.21.15.44:0/3402077330 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f702003e470 0x7f7020040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:22.393 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.456+0000 7f703a000700 1 --2- 172.21.15.44:0/3402077330 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f702003e470 0x7f7020040930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7028006fd0 tx=0x7f7028006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:22.393 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.461+0000 7f7033400700 1 -- 172.21.15.44:0/3402077330 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f702c00b3e0 con 0x7f703c108d40 2024-05-03T22:29:22.393 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.700+0000 7f703be00700 1 -- 172.21.15.44:0/3402077330 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f703c1a03a0 con 0x7f703c108d40 2024-05-03T22:29:22.393 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.701+0000 7f7033400700 1 -- 172.21.15.44:0/3402077330 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+409 (secure 0 0 0) 0x7f703c1a03a0 con 0x7f703c108d40 2024-05-03T22:29:22.393 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.704+0000 7f703be00700 1 -- 172.21.15.44:0/3402077330 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f702003e470 msgr2=0x7f7020040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:22.394 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.704+0000 7f703be00700 1 --2- 172.21.15.44:0/3402077330 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f702003e470 0x7f7020040930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7028006fd0 tx=0x7f7028006e40 comp rx=0 tx=0).stop 2024-05-03T22:29:22.394 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.704+0000 7f703be00700 1 -- 172.21.15.44:0/3402077330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703c108d40 msgr2=0x7f703c19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:22.394 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.704+0000 7f703be00700 1 --2- 172.21.15.44:0/3402077330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703c108d40 0x7f703c19cd20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f702c011840 tx=0x7f702c011c00 comp rx=0 tx=0).stop 2024-05-03T22:29:22.394 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.704+0000 7f703be00700 1 -- 172.21.15.44:0/3402077330 shutdown_connections 2024-05-03T22:29:22.394 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.704+0000 7f703be00700 1 --2- 172.21.15.44:0/3402077330 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f702003e470 0x7f7020040930 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:22.394 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.704+0000 7f703be00700 1 --2- 172.21.15.44:0/3402077330 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f703c108d40 0x7f703c19cd20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:22.394 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.704+0000 7f703be00700 1 -- 172.21.15.44:0/3402077330 >> 172.21.15.44:0/3402077330 conn(0x7f703c1042c0 msgr2=0x7f703c104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:22.394 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.704+0000 7f703be00700 1 -- 172.21.15.44:0/3402077330 shutdown_connections 2024-05-03T22:29:22.394 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:21.704+0000 7f703be00700 1 -- 172.21.15.44:0/3402077330 wait complete. 2024-05-03T22:29:22.394 INFO:teuthology.orchestra.run.smithi044.stdout:Enabling cephadm module... 2024-05-03T22:29:23.650 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:23 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3054669588' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-03T22:29:23.650 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:23 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: ignoring --setuser ceph since I am not root 2024-05-03T22:29:23.650 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:23 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: ignoring --setgroup ceph since I am not root 2024-05-03T22:29:23.650 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:23 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:23.647+0000 7fe4f5f6f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-03T22:29:24.036 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.961+0000 7f472ca00700 1 Processor -- start 2024-05-03T22:29:24.036 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.961+0000 7f472ca00700 1 -- start start 2024-05-03T22:29:24.036 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.962+0000 7f472ca00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472810b0e0 0x7f472810b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:24.036 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.962+0000 7f472ca00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f472810ba40 con 0x7f472810b0e0 2024-05-03T22:29:24.036 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.962+0000 7f4727400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472810b0e0 0x7f472810b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:24.036 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.962+0000 7f4727400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472810b0e0 0x7f472810b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59444/0 (socket says 172.21.15.44:59444) 2024-05-03T22:29:24.036 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.962+0000 7f4727400700 1 -- 172.21.15.44:0/859495014 learned_addr learned my addr 172.21.15.44:0/859495014 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:24.036 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.963+0000 7f4727400700 1 -- 172.21.15.44:0/859495014 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472810c0c0 con 0x7f472810b0e0 2024-05-03T22:29:24.036 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.963+0000 7f4727400700 1 --2- 172.21.15.44:0/859495014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472810b0e0 0x7f472810b500 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f47180098a0 tx=0x7f4718009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc716ba1c2e7205 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:24.036 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.964+0000 7f4726000700 1 -- 172.21.15.44:0/859495014 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4718004160 con 0x7f472810b0e0 2024-05-03T22:29:24.037 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.964+0000 7f4726000700 1 -- 172.21.15.44:0/859495014 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4718004300 con 0x7f472810b0e0 2024-05-03T22:29:24.037 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.964+0000 7f4726000700 1 -- 172.21.15.44:0/859495014 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4718011b30 con 0x7f472810b0e0 2024-05-03T22:29:24.037 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.964+0000 7f472ca00700 1 -- 172.21.15.44:0/859495014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472810b0e0 msgr2=0x7f472810b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:24.037 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.964+0000 7f472ca00700 1 --2- 172.21.15.44:0/859495014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472810b0e0 0x7f472810b500 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f47180098a0 tx=0x7f4718009bb0 comp rx=0 tx=0).stop 2024-05-03T22:29:24.037 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.964+0000 7f472ca00700 1 -- 172.21.15.44:0/859495014 shutdown_connections 2024-05-03T22:29:24.037 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.964+0000 7f472ca00700 1 --2- 172.21.15.44:0/859495014 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472810b0e0 0x7f472810b500 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:24.037 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.964+0000 7f472ca00700 1 -- 172.21.15.44:0/859495014 >> 172.21.15.44:0/859495014 conn(0x7f472807e2f0 msgr2=0x7f472807e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:24.037 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.965+0000 7f472ca00700 1 -- 172.21.15.44:0/859495014 shutdown_connections 2024-05-03T22:29:24.037 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.965+0000 7f472ca00700 1 -- 172.21.15.44:0/859495014 wait complete. 2024-05-03T22:29:24.037 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.966+0000 7f472ca00700 1 Processor -- start 2024-05-03T22:29:24.037 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.966+0000 7f472ca00700 1 -- start start 2024-05-03T22:29:24.037 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.966+0000 7f472ca00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472810b0e0 0x7f472819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:24.037 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.966+0000 7f472ca00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f472810f380 con 0x7f472810b0e0 2024-05-03T22:29:24.038 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.966+0000 7f4727400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472810b0e0 0x7f472819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:24.038 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.967+0000 7f4727400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472810b0e0 0x7f472819ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59460/0 (socket says 172.21.15.44:59460) 2024-05-03T22:29:24.038 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.967+0000 7f4727400700 1 -- 172.21.15.44:0/3054669588 learned_addr learned my addr 172.21.15.44:0/3054669588 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:24.038 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.967+0000 7f4727400700 1 -- 172.21.15.44:0/3054669588 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472819f470 con 0x7f472810b0e0 2024-05-03T22:29:24.038 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.967+0000 7f4727400700 1 --2- 172.21.15.44:0/3054669588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472810b0e0 0x7f472819ef30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4718011670 tx=0x7f4718011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:24.038 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.968+0000 7f471fe00700 1 -- 172.21.15.44:0/3054669588 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47180038b0 con 0x7f472810b0e0 2024-05-03T22:29:24.038 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.968+0000 7f471fe00700 1 -- 172.21.15.44:0/3054669588 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f471801a430 con 0x7f472810b0e0 2024-05-03T22:29:24.038 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.968+0000 7f472ca00700 1 -- 172.21.15.44:0/3054669588 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f472819f700 con 0x7f472810b0e0 2024-05-03T22:29:24.038 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.968+0000 7f471fe00700 1 -- 172.21.15.44:0/3054669588 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47180195a0 con 0x7f472810b0e0 2024-05-03T22:29:24.038 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.968+0000 7f472ca00700 1 -- 172.21.15.44:0/3054669588 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47281a23f0 con 0x7f472810b0e0 2024-05-03T22:29:24.038 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.969+0000 7f472ca00700 1 -- 172.21.15.44:0/3054669588 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f472810f500 con 0x7f472810b0e0 2024-05-03T22:29:24.038 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.969+0000 7f471fe00700 1 -- 172.21.15.44:0/3054669588 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f471801aa50 con 0x7f472810b0e0 2024-05-03T22:29:24.038 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.969+0000 7f471fe00700 1 --2- 172.21.15.44:0/3054669588 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f470c03e3d0 0x7f470c040890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:24.038 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.970+0000 7f471fe00700 1 -- 172.21.15.44:0/3054669588 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4718053830 con 0x7f472810b0e0 2024-05-03T22:29:24.039 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.970+0000 7f4726a00700 1 --2- 172.21.15.44:0/3054669588 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f470c03e3d0 0x7f470c040890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:24.039 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.971+0000 7f4726a00700 1 --2- 172.21.15.44:0/3054669588 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f470c03e3d0 0x7f470c040890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4714006fd0 tx=0x7f4714006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:24.039 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:22.975+0000 7f471fe00700 1 -- 172.21.15.44:0/3054669588 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4718008040 con 0x7f472810b0e0 2024-05-03T22:29:24.039 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:23.275+0000 7f472ca00700 1 -- 172.21.15.44:0/3054669588 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f47281a25c0 con 0x7f472810b0e0 2024-05-03T22:29:24.039 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:23.329+0000 7f471fe00700 1 -- 172.21.15.44:0/3054669588 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f471800b3e0 con 0x7f472810b0e0 2024-05-03T22:29:24.039 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:23.333+0000 7f471fe00700 1 -- 172.21.15.44:0/3054669588 <== mon.0 v2:172.21.15.44:3300/0 8 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f4718055cf0 con 0x7f472810b0e0 2024-05-03T22:29:24.039 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:23.334+0000 7f472ca00700 1 -- 172.21.15.44:0/3054669588 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f470c03e3d0 msgr2=0x7f470c040890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:24.039 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:23.334+0000 7f472ca00700 1 --2- 172.21.15.44:0/3054669588 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f470c03e3d0 0x7f470c040890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4714006fd0 tx=0x7f4714006e40 comp rx=0 tx=0).stop 2024-05-03T22:29:24.039 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:23.334+0000 7f472ca00700 1 -- 172.21.15.44:0/3054669588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472810b0e0 msgr2=0x7f472819ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:24.039 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:23.334+0000 7f472ca00700 1 --2- 172.21.15.44:0/3054669588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472810b0e0 0x7f472819ef30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4718011670 tx=0x7f4718011c00 comp rx=0 tx=0).stop 2024-05-03T22:29:24.039 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:23.335+0000 7f472ca00700 1 -- 172.21.15.44:0/3054669588 shutdown_connections 2024-05-03T22:29:24.039 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:23.335+0000 7f472ca00700 1 --2- 172.21.15.44:0/3054669588 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f470c03e3d0 0x7f470c040890 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:24.039 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:23.335+0000 7f472ca00700 1 --2- 172.21.15.44:0/3054669588 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f472810b0e0 0x7f472819ef30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:24.039 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:23.335+0000 7f472ca00700 1 -- 172.21.15.44:0/3054669588 >> 172.21.15.44:0/3054669588 conn(0x7f472807e2f0 msgr2=0x7f4728108de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:24.040 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:23.335+0000 7f472ca00700 1 -- 172.21.15.44:0/3054669588 shutdown_connections 2024-05-03T22:29:24.040 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:23.335+0000 7f472ca00700 1 -- 172.21.15.44:0/3054669588 wait complete. 2024-05-03T22:29:24.189 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:23 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:23.900+0000 7fe4f5f6f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:29:24.189 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:24 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:24.040+0000 7fe4f5f6f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-03T22:29:24.462 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:24 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3054669588' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-03T22:29:24.462 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:24 smithi044 ceph-mon[28604]: mgrmap e5: x(active, since 5s) 2024-05-03T22:29:24.751 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:24 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:24.460+0000 7fe4f5f6f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-03T22:29:24.752 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:24 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:24.578+0000 7fe4f5f6f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-03T22:29:25.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:25 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1914957641' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-03T22:29:25.593 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-05-03T22:29:25.593 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-03T22:29:25.593 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-03T22:29:25.594 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-03T22:29:25.594 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-03T22:29:25.594 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-05-03T22:29:25.594 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.617+0000 7f0bf4e00700 1 Processor -- start 2024-05-03T22:29:25.594 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.618+0000 7f0bf4e00700 1 -- start start 2024-05-03T22:29:25.594 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.618+0000 7f0bf4e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf0109a30 0x7f0bf010be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:25.594 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.618+0000 7f0bf4e00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf007ce30 con 0x7f0bf0109a30 2024-05-03T22:29:25.594 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.618+0000 7f0bede00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf0109a30 0x7f0bf010be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:25.594 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.619+0000 7f0bede00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf0109a30 0x7f0bf010be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59472/0 (socket says 172.21.15.44:59472) 2024-05-03T22:29:25.594 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.619+0000 7f0bede00700 1 -- 172.21.15.44:0/482121789 learned_addr learned my addr 172.21.15.44:0/482121789 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:25.594 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.619+0000 7f0bede00700 1 -- 172.21.15.44:0/482121789 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf010c360 con 0x7f0bf0109a30 2024-05-03T22:29:25.594 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.619+0000 7f0bede00700 1 --2- 172.21.15.44:0/482121789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf0109a30 0x7f0bf010be20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0be00098a0 tx=0x7f0be0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32b482e70756dea server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:25.594 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.620+0000 7f0beca00700 1 -- 172.21.15.44:0/482121789 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be0004160 con 0x7f0bf0109a30 2024-05-03T22:29:25.595 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.620+0000 7f0beca00700 1 -- 172.21.15.44:0/482121789 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0be0004300 con 0x7f0bf0109a30 2024-05-03T22:29:25.595 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.620+0000 7f0beca00700 1 -- 172.21.15.44:0/482121789 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be0011b30 con 0x7f0bf0109a30 2024-05-03T22:29:25.595 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.620+0000 7f0bf4e00700 1 -- 172.21.15.44:0/482121789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf0109a30 msgr2=0x7f0bf010be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:25.595 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.620+0000 7f0bf4e00700 1 --2- 172.21.15.44:0/482121789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf0109a30 0x7f0bf010be20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0be00098a0 tx=0x7f0be0009bb0 comp rx=0 tx=0).stop 2024-05-03T22:29:25.595 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.621+0000 7f0bf4e00700 1 -- 172.21.15.44:0/482121789 shutdown_connections 2024-05-03T22:29:25.595 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.621+0000 7f0bf4e00700 1 --2- 172.21.15.44:0/482121789 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf0109a30 0x7f0bf010be20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:25.595 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.621+0000 7f0bf4e00700 1 -- 172.21.15.44:0/482121789 >> 172.21.15.44:0/482121789 conn(0x7f0bf01033e0 msgr2=0x7f0bf0105840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:25.595 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.621+0000 7f0bf4e00700 1 -- 172.21.15.44:0/482121789 shutdown_connections 2024-05-03T22:29:25.595 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.621+0000 7f0bf4e00700 1 -- 172.21.15.44:0/482121789 wait complete. 2024-05-03T22:29:25.595 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.622+0000 7f0bf4e00700 1 Processor -- start 2024-05-03T22:29:25.595 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.622+0000 7f0bf4e00700 1 -- start start 2024-05-03T22:29:25.595 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.623+0000 7f0bf4e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf0109a30 0x7f0bf019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:25.595 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.623+0000 7f0bf4e00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf010d2c0 con 0x7f0bf0109a30 2024-05-03T22:29:25.595 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.623+0000 7f0bede00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf0109a30 0x7f0bf019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:25.596 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.623+0000 7f0bede00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf0109a30 0x7f0bf019cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59474/0 (socket says 172.21.15.44:59474) 2024-05-03T22:29:25.596 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.623+0000 7f0bede00700 1 -- 172.21.15.44:0/1914957641 learned_addr learned my addr 172.21.15.44:0/1914957641 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:25.596 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.623+0000 7f0bede00700 1 -- 172.21.15.44:0/1914957641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf019d400 con 0x7f0bf0109a30 2024-05-03T22:29:25.596 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.624+0000 7f0bede00700 1 --2- 172.21.15.44:0/1914957641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf0109a30 0x7f0bf019cec0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0be0011b50 tx=0x7f0be0011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:25.596 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.624+0000 7f0be6a00700 1 -- 172.21.15.44:0/1914957641 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be0003aa0 con 0x7f0bf0109a30 2024-05-03T22:29:25.596 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.624+0000 7f0be6a00700 1 -- 172.21.15.44:0/1914957641 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0be0020070 con 0x7f0bf0109a30 2024-05-03T22:29:25.596 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.624+0000 7f0be6a00700 1 -- 172.21.15.44:0/1914957641 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0be0019550 con 0x7f0bf0109a30 2024-05-03T22:29:25.596 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.624+0000 7f0bf4e00700 1 -- 172.21.15.44:0/1914957641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf019d690 con 0x7f0bf0109a30 2024-05-03T22:29:25.596 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.624+0000 7f0bf4e00700 1 -- 172.21.15.44:0/1914957641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf01a0380 con 0x7f0bf0109a30 2024-05-03T22:29:25.596 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.625+0000 7f0bf4e00700 1 -- 172.21.15.44:0/1914957641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bf0064b00 con 0x7f0bf0109a30 2024-05-03T22:29:25.596 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.625+0000 7f0be6a00700 1 -- 172.21.15.44:0/1914957641 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f0be001a430 con 0x7f0bf0109a30 2024-05-03T22:29:25.596 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.626+0000 7f0be6a00700 1 --2- 172.21.15.44:0/1914957641 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f0bd403e4c0 0x7f0bd4040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:25.596 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.626+0000 7f0be6a00700 1 -- 172.21.15.44:0/1914957641 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0be0053990 con 0x7f0bf0109a30 2024-05-03T22:29:25.596 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.626+0000 7f0bed400700 1 -- 172.21.15.44:0/1914957641 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f0bd403e4c0 msgr2=0x7f0bd4040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/950841500 2024-05-03T22:29:25.597 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.626+0000 7f0bed400700 1 --2- 172.21.15.44:0/1914957641 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f0bd403e4c0 0x7f0bd4040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-03T22:29:25.597 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.631+0000 7f0be6a00700 1 -- 172.21.15.44:0/1914957641 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0be000e260 con 0x7f0bf0109a30 2024-05-03T22:29:25.597 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.827+0000 7f0bed400700 1 -- 172.21.15.44:0/1914957641 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f0bd403e4c0 msgr2=0x7f0bd4040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/950841500 2024-05-03T22:29:25.597 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.827+0000 7f0bed400700 1 --2- 172.21.15.44:0/1914957641 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f0bd403e4c0 0x7f0bd4040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-03T22:29:25.597 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.927+0000 7f0bf4e00700 1 -- 172.21.15.44:0/1914957641 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f0bf01a0550 con 0x7f0bf0109a30 2024-05-03T22:29:25.597 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.928+0000 7f0be6a00700 1 -- 172.21.15.44:0/1914957641 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f0bf01a0550 con 0x7f0bf0109a30 2024-05-03T22:29:25.597 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.931+0000 7f0bf4e00700 1 -- 172.21.15.44:0/1914957641 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f0bd403e4c0 msgr2=0x7f0bd4040980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-03T22:29:25.597 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.931+0000 7f0bf4e00700 1 --2- 172.21.15.44:0/1914957641 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f0bd403e4c0 0x7f0bd4040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:25.597 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.931+0000 7f0bf4e00700 1 -- 172.21.15.44:0/1914957641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf0109a30 msgr2=0x7f0bf019cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:25.597 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.931+0000 7f0bf4e00700 1 --2- 172.21.15.44:0/1914957641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf0109a30 0x7f0bf019cec0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0be0011b50 tx=0x7f0be0011c30 comp rx=0 tx=0).stop 2024-05-03T22:29:25.597 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.931+0000 7f0bf4e00700 1 -- 172.21.15.44:0/1914957641 shutdown_connections 2024-05-03T22:29:25.597 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.931+0000 7f0bf4e00700 1 --2- 172.21.15.44:0/1914957641 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f0bd403e4c0 0x7f0bd4040980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:25.597 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.931+0000 7f0bf4e00700 1 --2- 172.21.15.44:0/1914957641 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf0109a30 0x7f0bf019cec0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:25.597 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.931+0000 7f0bf4e00700 1 -- 172.21.15.44:0/1914957641 >> 172.21.15.44:0/1914957641 conn(0x7f0bf01033e0 msgr2=0x7f0bf0103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:25.597 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.931+0000 7f0bf4e00700 1 -- 172.21.15.44:0/1914957641 shutdown_connections 2024-05-03T22:29:25.598 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:24.931+0000 7f0bf4e00700 1 -- 172.21.15.44:0/1914957641 wait complete. 2024-05-03T22:29:25.598 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for the mgr to restart... 2024-05-03T22:29:25.598 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mgr epoch 5... 2024-05-03T22:29:26.429 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:26 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:26.191+0000 7fe4f5f6f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-03T22:29:26.429 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:26 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:26.426+0000 7fe4f5f6f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-03T22:29:26.716 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:26 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:26.646+0000 7fe4f5f6f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-03T22:29:27.427 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:27 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:27.041+0000 7fe4f5f6f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-03T22:29:27.427 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:27 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:27.168+0000 7fe4f5f6f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-03T22:29:27.688 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:27 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:27.424+0000 7fe4f5f6f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-03T22:29:27.688 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:27 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:27.685+0000 7fe4f5f6f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:29:28.798 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:28 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:28.501+0000 7fe4f5f6f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-03T22:29:28.798 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:28 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:28.796+0000 7fe4f5f6f200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-03T22:29:29.751 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:29 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:29.369+0000 7fe4f5f6f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-03T22:29:29.751 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:29 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:29.500+0000 7fe4f5f6f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-03T22:29:30.251 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:29 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:29.974+0000 7fe4f5f6f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-03T22:29:30.751 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:30 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:30.444+0000 7fe4f5f6f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-03T22:29:30.752 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:30 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:30.572+0000 7fe4f5f6f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-03T22:29:31.251 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:30 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:30.905+0000 7fe4f5f6f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-03T22:29:31.252 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:31 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:31.089+0000 7fe4f5f6f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-03T22:29:31.751 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:31 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:31.469+0000 7fe4f5f6f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-03T22:29:31.751 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:31 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:31.625+0000 7fe4f5f6f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-03T22:29:32.251 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:31 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:31.751+0000 7fe4f5f6f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-03T22:29:32.751 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:32 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:32.542+0000 7fe4f5f6f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-03T22:29:33.251 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:32 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:32.841+0000 7fe4f5f6f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-03T22:29:33.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:32 smithi044 ceph-mon[28604]: Active manager daemon x restarted 2024-05-03T22:29:33.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:32 smithi044 ceph-mon[28604]: Activating manager daemon x 2024-05-03T22:29:33.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:32 smithi044 ceph-mon[28604]: osdmap e2: 0 total, 0 up, 0 in 2024-05-03T22:29:33.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:32 smithi044 ceph-mon[28604]: mgrmap e6: x(active, starting, since 0.0104984s) 2024-05-03T22:29:33.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:32 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:29:33.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:32 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-03T22:29:33.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:32 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-03T22:29:33.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:32 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-03T22:29:33.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:32 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-03T22:29:33.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:32 smithi044 ceph-mon[28604]: Manager daemon x is now available 2024-05-03T22:29:34.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:33 smithi044 ceph-mon[28604]: Found migration_current of "None". Setting to last migration. 2024-05-03T22:29:34.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:33 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' 2024-05-03T22:29:34.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:33 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' 2024-05-03T22:29:34.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:33 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:29:34.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:33 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:29:34.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:33 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-03T22:29:34.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:33 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-03T22:29:34.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:33 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' 2024-05-03T22:29:34.253 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:33 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' 2024-05-03T22:29:34.253 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:33 smithi044 ceph-mon[28604]: mgrmap e7: x(active, since 1.01826s) 2024-05-03T22:29:34.614 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-05-03T22:29:34.614 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-03T22:29:34.614 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-03T22:29:34.615 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-05-03T22:29:34.615 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.103+0000 7f9921000700 1 Processor -- start 2024-05-03T22:29:34.615 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.103+0000 7f9921000700 1 -- start start 2024-05-03T22:29:34.615 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.103+0000 7f9921000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991c07ee40 0x7f991c07d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:34.615 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.103+0000 7f9921000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f991c07d870 con 0x7f991c07ee40 2024-05-03T22:29:34.615 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.104+0000 7f9919e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991c07ee40 0x7f991c07d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:34.616 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.104+0000 7f9919e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991c07ee40 0x7f991c07d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59486/0 (socket says 172.21.15.44:59486) 2024-05-03T22:29:34.616 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.104+0000 7f9919e00700 1 -- 172.21.15.44:0/1581336592 learned_addr learned my addr 172.21.15.44:0/1581336592 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:34.616 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.104+0000 7f9919e00700 1 -- 172.21.15.44:0/1581336592 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f991c07d9f0 con 0x7f991c07ee40 2024-05-03T22:29:34.616 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.105+0000 7f9919e00700 1 --2- 172.21.15.44:0/1581336592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991c07ee40 0x7f991c07d2a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f990c0098a0 tx=0x7f990c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b237422c4ad8aa5c server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:34.616 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.105+0000 7f9918a00700 1 -- 172.21.15.44:0/1581336592 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f990c004160 con 0x7f991c07ee40 2024-05-03T22:29:34.617 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.105+0000 7f9918a00700 1 -- 172.21.15.44:0/1581336592 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f990c004300 con 0x7f991c07ee40 2024-05-03T22:29:34.617 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.105+0000 7f9918a00700 1 -- 172.21.15.44:0/1581336592 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f990c011b30 con 0x7f991c07ee40 2024-05-03T22:29:34.617 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.106+0000 7f9921000700 1 -- 172.21.15.44:0/1581336592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991c07ee40 msgr2=0x7f991c07d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:34.617 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.106+0000 7f9921000700 1 --2- 172.21.15.44:0/1581336592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991c07ee40 0x7f991c07d2a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f990c0098a0 tx=0x7f990c009bb0 comp rx=0 tx=0).stop 2024-05-03T22:29:34.617 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.106+0000 7f9921000700 1 -- 172.21.15.44:0/1581336592 shutdown_connections 2024-05-03T22:29:34.617 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.106+0000 7f9921000700 1 --2- 172.21.15.44:0/1581336592 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991c07ee40 0x7f991c07d2a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:34.618 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.106+0000 7f9921000700 1 -- 172.21.15.44:0/1581336592 >> 172.21.15.44:0/1581336592 conn(0x7f991c1044e0 msgr2=0x7f991c106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:34.618 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.106+0000 7f9921000700 1 -- 172.21.15.44:0/1581336592 shutdown_connections 2024-05-03T22:29:34.618 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.106+0000 7f9921000700 1 -- 172.21.15.44:0/1581336592 wait complete. 2024-05-03T22:29:34.618 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.107+0000 7f9921000700 1 Processor -- start 2024-05-03T22:29:34.618 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.108+0000 7f9921000700 1 -- start start 2024-05-03T22:29:34.619 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.108+0000 7f9921000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991c07ee40 0x7f991c19f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:34.619 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.108+0000 7f9921000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f991c10f490 con 0x7f991c07ee40 2024-05-03T22:29:34.619 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.108+0000 7f9919e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991c07ee40 0x7f991c19f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:34.619 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.108+0000 7f9919e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991c07ee40 0x7f991c19f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59500/0 (socket says 172.21.15.44:59500) 2024-05-03T22:29:34.619 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.108+0000 7f9919e00700 1 -- 172.21.15.44:0/1113430109 learned_addr learned my addr 172.21.15.44:0/1113430109 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:34.620 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.109+0000 7f9919e00700 1 -- 172.21.15.44:0/1113430109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f991c19f5d0 con 0x7f991c07ee40 2024-05-03T22:29:34.620 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.109+0000 7f9919e00700 1 --2- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991c07ee40 0x7f991c19f090 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f990c011b50 tx=0x7f990c011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:34.620 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.109+0000 7f9912a00700 1 -- 172.21.15.44:0/1113430109 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f990c003aa0 con 0x7f991c07ee40 2024-05-03T22:29:34.620 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.109+0000 7f9912a00700 1 -- 172.21.15.44:0/1113430109 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f990c020070 con 0x7f991c07ee40 2024-05-03T22:29:34.620 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.109+0000 7f9921000700 1 -- 172.21.15.44:0/1113430109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f991c19f860 con 0x7f991c07ee40 2024-05-03T22:29:34.620 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.109+0000 7f9912a00700 1 -- 172.21.15.44:0/1113430109 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f990c019550 con 0x7f991c07ee40 2024-05-03T22:29:34.621 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.110+0000 7f9921000700 1 -- 172.21.15.44:0/1113430109 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f991c1a2550 con 0x7f991c07ee40 2024-05-03T22:29:34.621 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.111+0000 7f9912a00700 1 -- 172.21.15.44:0/1113430109 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f990c01aa00 con 0x7f991c07ee40 2024-05-03T22:29:34.621 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.111+0000 7f9912a00700 1 --2- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f990003e4c0 0x7f9900040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:34.621 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.111+0000 7f9912a00700 1 -- 172.21.15.44:0/1113430109 --> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9900041090 con 0x7f990003e4c0 2024-05-03T22:29:34.621 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.111+0000 7f9912a00700 1 -- 172.21.15.44:0/1113430109 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f990c053980 con 0x7f991c07ee40 2024-05-03T22:29:34.622 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.112+0000 7f9919400700 1 -- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f990003e4c0 msgr2=0x7f9900040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/950841500 2024-05-03T22:29:34.622 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.112+0000 7f9919400700 1 --2- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f990003e4c0 0x7f9900040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-03T22:29:34.622 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.313+0000 7f9919400700 1 -- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f990003e4c0 msgr2=0x7f9900040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/950841500 2024-05-03T22:29:34.622 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.313+0000 7f9919400700 1 --2- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f990003e4c0 0x7f9900040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-03T22:29:34.622 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.714+0000 7f9919400700 1 -- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f990003e4c0 msgr2=0x7f9900040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/950841500 2024-05-03T22:29:34.623 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:26.714+0000 7f9919400700 1 --2- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f990003e4c0 0x7f9900040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-03T22:29:34.623 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:27.515+0000 7f9919400700 1 -- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f990003e4c0 msgr2=0x7f9900040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/950841500 2024-05-03T22:29:34.623 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:27.515+0000 7f9919400700 1 --2- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f990003e4c0 0x7f9900040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-03T22:29:34.623 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:29.117+0000 7f9919400700 1 -- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f990003e4c0 msgr2=0x7f9900040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/950841500 2024-05-03T22:29:34.623 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:29.117+0000 7f9919400700 1 --2- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f990003e4c0 0x7f9900040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-03T22:29:34.623 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:32.321+0000 7f9919400700 1 -- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f990003e4c0 msgr2=0x7f9900040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/950841500 2024-05-03T22:29:34.624 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:32.321+0000 7f9919400700 1 --2- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f990003e4c0 0x7f9900040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-03T22:29:34.624 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:32.853+0000 7f9912a00700 1 -- 172.21.15.44:0/1113430109 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mgrmap(e 6) ==== 49989+0+0 (secure 0 0 0) 0x7f990c02a060 con 0x7f991c07ee40 2024-05-03T22:29:34.624 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:32.854+0000 7f9912a00700 1 -- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f990003e4c0 msgr2=0x7f9900040980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-03T22:29:34.624 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:32.854+0000 7f9912a00700 1 --2- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f990003e4c0 0x7f9900040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:34.624 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:33.858+0000 7f9912a00700 1 -- 172.21.15.44:0/1113430109 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mgrmap(e 7) ==== 50116+0+0 (secure 0 0 0) 0x7f990c0551e0 con 0x7f991c07ee40 2024-05-03T22:29:34.624 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:33.858+0000 7f9912a00700 1 --2- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f9900041e00 0x7f99000441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:34.625 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:33.859+0000 7f9912a00700 1 -- 172.21.15.44:0/1113430109 --> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f990c01bec0 con 0x7f9900041e00 2024-05-03T22:29:34.625 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:33.860+0000 7f9919400700 1 --2- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f9900041e00 0x7f99000441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:34.625 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:33.865+0000 7f9919400700 1 --2- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f9900041e00 0x7f99000441f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9908003a10 tx=0x7f99080092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:34.625 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:33.867+0000 7f9912a00700 1 -- 172.21.15.44:0/1113430109 <== mgr.14120 v2:172.21.15.44:6800/1309719283 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f990c01bec0 con 0x7f9900041e00 2024-05-03T22:29:34.625 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:33.877+0000 7f9921000700 1 -- 172.21.15.44:0/1113430109 --> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f991c064b00 con 0x7f9900041e00 2024-05-03T22:29:34.625 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:33.878+0000 7f9912a00700 1 -- 172.21.15.44:0/1113430109 <== mgr.14120 v2:172.21.15.44:6800/1309719283 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f991c064b00 con 0x7f9900041e00 2024-05-03T22:29:34.626 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:33.878+0000 7f9921000700 1 -- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f9900041e00 msgr2=0x7f99000441f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:34.626 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:33.878+0000 7f9921000700 1 --2- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f9900041e00 0x7f99000441f0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9908003a10 tx=0x7f99080092b0 comp rx=0 tx=0).stop 2024-05-03T22:29:34.626 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:33.878+0000 7f9921000700 1 -- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991c07ee40 msgr2=0x7f991c19f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:34.626 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:33.878+0000 7f9921000700 1 --2- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991c07ee40 0x7f991c19f090 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f990c011b50 tx=0x7f990c011c30 comp rx=0 tx=0).stop 2024-05-03T22:29:34.626 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:33.879+0000 7f9921000700 1 -- 172.21.15.44:0/1113430109 shutdown_connections 2024-05-03T22:29:34.626 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:33.879+0000 7f9921000700 1 --2- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f9900041e00 0x7f99000441f0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:34.627 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:33.879+0000 7f9921000700 1 --2- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991c07ee40 0x7f991c19f090 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:34.627 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:33.879+0000 7f9921000700 1 --2- 172.21.15.44:0/1113430109 >> [v2:172.21.15.44:6800/950841500,v1:172.21.15.44:6801/950841500] conn(0x7f990003e4c0 0x7f9900040980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:34.627 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:33.879+0000 7f9921000700 1 -- 172.21.15.44:0/1113430109 >> 172.21.15.44:0/1113430109 conn(0x7f991c1044e0 msgr2=0x7f991c105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:34.627 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:33.879+0000 7f9921000700 1 -- 172.21.15.44:0/1113430109 shutdown_connections 2024-05-03T22:29:34.627 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:33.879+0000 7f9921000700 1 -- 172.21.15.44:0/1113430109 wait complete. 2024-05-03T22:29:34.627 INFO:teuthology.orchestra.run.smithi044.stdout:mgr epoch 5 is available 2024-05-03T22:29:34.627 INFO:teuthology.orchestra.run.smithi044.stdout:Setting orchestrator backend to cephadm... 2024-05-03T22:29:35.199 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:34 smithi044 ceph-mon[28604]: [03/May/2024:22:29:33] ENGINE Bus STARTING 2024-05-03T22:29:35.199 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:34 smithi044 ceph-mon[28604]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-03T22:29:35.199 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:34 smithi044 ceph-mon[28604]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-03T22:29:35.199 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:34 smithi044 ceph-mon[28604]: [03/May/2024:22:29:33] ENGINE Serving on https://172.21.15.44:7150 2024-05-03T22:29:35.200 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:34 smithi044 ceph-mon[28604]: [03/May/2024:22:29:33] ENGINE Serving on http://172.21.15.44:8765 2024-05-03T22:29:35.200 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:34 smithi044 ceph-mon[28604]: [03/May/2024:22:29:33] ENGINE Bus STARTED 2024-05-03T22:29:35.200 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:34 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:29:36.203 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:35 smithi044 ceph-mon[28604]: mgrmap e8: x(active, since 2s) 2024-05-03T22:29:36.203 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:35 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' 2024-05-03T22:29:36.203 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:35 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:29:36.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.228+0000 7fe42b200700 1 Processor -- start 2024-05-03T22:29:36.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.228+0000 7fe42b200700 1 -- start start 2024-05-03T22:29:36.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.229+0000 7fe42b200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe42410b130 0x7fe42410b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:36.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.229+0000 7fe42b200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe42410bb20 con 0x7fe42410b130 2024-05-03T22:29:36.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.229+0000 7fe423e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe42410b130 0x7fe42410b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:36.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.229+0000 7fe423e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe42410b130 0x7fe42410b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47722/0 (socket says 172.21.15.44:47722) 2024-05-03T22:29:36.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.229+0000 7fe423e00700 1 -- 172.21.15.44:0/907503151 learned_addr learned my addr 172.21.15.44:0/907503151 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:36.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.230+0000 7fe423e00700 1 -- 172.21.15.44:0/907503151 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42410c300 con 0x7fe42410b130 2024-05-03T22:29:36.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.230+0000 7fe423e00700 1 --2- 172.21.15.44:0/907503151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe42410b130 0x7fe42410b550 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe4140098a0 tx=0x7fe414009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821c38ad0d2b3a03 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:36.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.231+0000 7fe422a00700 1 -- 172.21.15.44:0/907503151 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe414004160 con 0x7fe42410b130 2024-05-03T22:29:36.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.231+0000 7fe422a00700 1 -- 172.21.15.44:0/907503151 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe414004300 con 0x7fe42410b130 2024-05-03T22:29:36.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.231+0000 7fe422a00700 1 -- 172.21.15.44:0/907503151 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe414011b30 con 0x7fe42410b130 2024-05-03T22:29:36.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.231+0000 7fe42b200700 1 -- 172.21.15.44:0/907503151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe42410b130 msgr2=0x7fe42410b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:36.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.231+0000 7fe42b200700 1 --2- 172.21.15.44:0/907503151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe42410b130 0x7fe42410b550 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe4140098a0 tx=0x7fe414009bb0 comp rx=0 tx=0).stop 2024-05-03T22:29:36.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.231+0000 7fe42b200700 1 -- 172.21.15.44:0/907503151 shutdown_connections 2024-05-03T22:29:36.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.231+0000 7fe42b200700 1 --2- 172.21.15.44:0/907503151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe42410b130 0x7fe42410b550 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:36.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.231+0000 7fe42b200700 1 -- 172.21.15.44:0/907503151 >> 172.21.15.44:0/907503151 conn(0x7fe42407e4b0 msgr2=0x7fe42407e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:36.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.232+0000 7fe42b200700 1 -- 172.21.15.44:0/907503151 shutdown_connections 2024-05-03T22:29:36.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.232+0000 7fe42b200700 1 -- 172.21.15.44:0/907503151 wait complete. 2024-05-03T22:29:36.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.233+0000 7fe42b200700 1 Processor -- start 2024-05-03T22:29:36.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.233+0000 7fe42b200700 1 -- start start 2024-05-03T22:29:36.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.233+0000 7fe42b200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe42410b130 0x7fe42419f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:36.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.233+0000 7fe42b200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe42410f6b0 con 0x7fe42410b130 2024-05-03T22:29:36.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.234+0000 7fe423e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe42410b130 0x7fe42419f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:36.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.234+0000 7fe423e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe42410b130 0x7fe42419f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47728/0 (socket says 172.21.15.44:47728) 2024-05-03T22:29:36.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.234+0000 7fe423e00700 1 -- 172.21.15.44:0/2107741677 learned_addr learned my addr 172.21.15.44:0/2107741677 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:36.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.234+0000 7fe423e00700 1 -- 172.21.15.44:0/2107741677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42419f600 con 0x7fe42410b130 2024-05-03T22:29:36.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.234+0000 7fe423e00700 1 --2- 172.21.15.44:0/2107741677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe42410b130 0x7fe42419f0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe414011670 tx=0x7fe414011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:36.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.235+0000 7fe420c00700 1 -- 172.21.15.44:0/2107741677 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4140038b0 con 0x7fe42410b130 2024-05-03T22:29:36.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.235+0000 7fe420c00700 1 -- 172.21.15.44:0/2107741677 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe41401a430 con 0x7fe42410b130 2024-05-03T22:29:36.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.235+0000 7fe420c00700 1 -- 172.21.15.44:0/2107741677 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4140195a0 con 0x7fe42410b130 2024-05-03T22:29:36.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.235+0000 7fe42b200700 1 -- 172.21.15.44:0/2107741677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42419f890 con 0x7fe42410b130 2024-05-03T22:29:36.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.235+0000 7fe42b200700 1 -- 172.21.15.44:0/2107741677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4241a2580 con 0x7fe42410b130 2024-05-03T22:29:36.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.236+0000 7fe420c00700 1 -- 172.21.15.44:0/2107741677 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fe414003a50 con 0x7fe42410b130 2024-05-03T22:29:36.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.236+0000 7fe42b200700 1 -- 172.21.15.44:0/2107741677 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe424064b00 con 0x7fe42410b130 2024-05-03T22:29:36.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.236+0000 7fe420c00700 1 --2- 172.21.15.44:0/2107741677 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fe40803e470 0x7fe408040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:36.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.236+0000 7fe420c00700 1 -- 172.21.15.44:0/2107741677 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe4140538d0 con 0x7fe42410b130 2024-05-03T22:29:36.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.237+0000 7fe423400700 1 --2- 172.21.15.44:0/2107741677 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fe40803e470 0x7fe408040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:36.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.237+0000 7fe423400700 1 --2- 172.21.15.44:0/2107741677 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fe40803e470 0x7fe408040930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe410006fd0 tx=0x7fe410006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:36.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.242+0000 7fe420c00700 1 -- 172.21.15.44:0/2107741677 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe414021e80 con 0x7fe42410b130 2024-05-03T22:29:36.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.495+0000 7fe42b200700 1 -- 172.21.15.44:0/2107741677 --> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fe424109550 con 0x7fe40803e470 2024-05-03T22:29:36.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.507+0000 7fe420c00700 1 -- 172.21.15.44:0/2107741677 <== mgr.14120 v2:172.21.15.44:6800/1309719283 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe424109550 con 0x7fe40803e470 2024-05-03T22:29:36.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.511+0000 7fe42b200700 1 -- 172.21.15.44:0/2107741677 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fe40803e470 msgr2=0x7fe408040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:36.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.511+0000 7fe42b200700 1 --2- 172.21.15.44:0/2107741677 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fe40803e470 0x7fe408040930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe410006fd0 tx=0x7fe410006e40 comp rx=0 tx=0).stop 2024-05-03T22:29:36.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.511+0000 7fe42b200700 1 -- 172.21.15.44:0/2107741677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe42410b130 msgr2=0x7fe42419f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:36.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.511+0000 7fe42b200700 1 --2- 172.21.15.44:0/2107741677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe42410b130 0x7fe42419f0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe414011670 tx=0x7fe414011c00 comp rx=0 tx=0).stop 2024-05-03T22:29:36.224 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.511+0000 7fe42b200700 1 -- 172.21.15.44:0/2107741677 shutdown_connections 2024-05-03T22:29:36.224 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.511+0000 7fe42b200700 1 --2- 172.21.15.44:0/2107741677 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fe40803e470 0x7fe408040930 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:36.224 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.511+0000 7fe42b200700 1 --2- 172.21.15.44:0/2107741677 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe42410b130 0x7fe42419f0c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:36.224 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.511+0000 7fe42b200700 1 -- 172.21.15.44:0/2107741677 >> 172.21.15.44:0/2107741677 conn(0x7fe42407e4b0 msgr2=0x7fe424108e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:36.224 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.512+0000 7fe42b200700 1 -- 172.21.15.44:0/2107741677 shutdown_connections 2024-05-03T22:29:36.224 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:35.512+0000 7fe42b200700 1 -- 172.21.15.44:0/2107741677 wait complete. 2024-05-03T22:29:37.062 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:36 smithi044 ceph-mon[28604]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:29:37.750 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-03T22:29:37.750 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.808+0000 7fa69de00700 1 Processor -- start 2024-05-03T22:29:37.756 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.808+0000 7fa69de00700 1 -- start start 2024-05-03T22:29:37.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.809+0000 7fa69de00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa698107620 0x7fa698107a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:37.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.809+0000 7fa69de00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa69807cdf0 con 0x7fa698107620 2024-05-03T22:29:37.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.809+0000 7fa69ca00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa698107620 0x7fa698107a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:37.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.809+0000 7fa69ca00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa698107620 0x7fa698107a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47730/0 (socket says 172.21.15.44:47730) 2024-05-03T22:29:37.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.810+0000 7fa69ca00700 1 -- 172.21.15.44:0/2384483241 learned_addr learned my addr 172.21.15.44:0/2384483241 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:37.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.810+0000 7fa69ca00700 1 -- 172.21.15.44:0/2384483241 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa698107f80 con 0x7fa698107620 2024-05-03T22:29:37.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.810+0000 7fa69ca00700 1 --2- 172.21.15.44:0/2384483241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa698107620 0x7fa698107a40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa68c009e80 tx=0x7fa68c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176d79584abdb6c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:37.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.811+0000 7fa697400700 1 -- 172.21.15.44:0/2384483241 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa68c017070 con 0x7fa698107620 2024-05-03T22:29:37.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.811+0000 7fa697400700 1 -- 172.21.15.44:0/2384483241 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa68c00b8c0 con 0x7fa698107620 2024-05-03T22:29:37.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.811+0000 7fa697400700 1 -- 172.21.15.44:0/2384483241 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa68c0045a0 con 0x7fa698107620 2024-05-03T22:29:37.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.811+0000 7fa69de00700 1 -- 172.21.15.44:0/2384483241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa698107620 msgr2=0x7fa698107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:37.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.811+0000 7fa69de00700 1 --2- 172.21.15.44:0/2384483241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa698107620 0x7fa698107a40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa68c009e80 tx=0x7fa68c00b330 comp rx=0 tx=0).stop 2024-05-03T22:29:37.757 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.811+0000 7fa69de00700 1 -- 172.21.15.44:0/2384483241 shutdown_connections 2024-05-03T22:29:37.758 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.811+0000 7fa69de00700 1 --2- 172.21.15.44:0/2384483241 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa698107620 0x7fa698107a40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:37.758 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.811+0000 7fa69de00700 1 -- 172.21.15.44:0/2384483241 >> 172.21.15.44:0/2384483241 conn(0x7fa6981031e0 msgr2=0x7fa698105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:37.758 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.811+0000 7fa69de00700 1 -- 172.21.15.44:0/2384483241 shutdown_connections 2024-05-03T22:29:37.758 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.812+0000 7fa69de00700 1 -- 172.21.15.44:0/2384483241 wait complete. 2024-05-03T22:29:37.758 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.812+0000 7fa69de00700 1 Processor -- start 2024-05-03T22:29:37.758 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.813+0000 7fa69de00700 1 -- start start 2024-05-03T22:29:37.758 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.813+0000 7fa69de00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa698107620 0x7fa69819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:37.758 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.813+0000 7fa69de00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa698108fa0 con 0x7fa698107620 2024-05-03T22:29:37.758 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.813+0000 7fa69ca00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa698107620 0x7fa69819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:37.758 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.813+0000 7fa69ca00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa698107620 0x7fa69819eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47738/0 (socket says 172.21.15.44:47738) 2024-05-03T22:29:37.758 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.813+0000 7fa69ca00700 1 -- 172.21.15.44:0/1062525322 learned_addr learned my addr 172.21.15.44:0/1062525322 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:37.758 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.814+0000 7fa69ca00700 1 -- 172.21.15.44:0/1062525322 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69819f400 con 0x7fa698107620 2024-05-03T22:29:37.758 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.814+0000 7fa69ca00700 1 --2- 172.21.15.44:0/1062525322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa698107620 0x7fa69819eec0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00d010 tx=0x7fa68c003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:37.759 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.814+0000 7fa695600700 1 -- 172.21.15.44:0/1062525322 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa68c021020 con 0x7fa698107620 2024-05-03T22:29:37.759 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.814+0000 7fa695600700 1 -- 172.21.15.44:0/1062525322 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa68c0048a0 con 0x7fa698107620 2024-05-03T22:29:37.759 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.814+0000 7fa695600700 1 -- 172.21.15.44:0/1062525322 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa68c017040 con 0x7fa698107620 2024-05-03T22:29:37.759 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.814+0000 7fa69de00700 1 -- 172.21.15.44:0/1062525322 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa69819f690 con 0x7fa698107620 2024-05-03T22:29:37.759 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.815+0000 7fa69de00700 1 -- 172.21.15.44:0/1062525322 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6981a2380 con 0x7fa698107620 2024-05-03T22:29:37.759 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.816+0000 7fa695600700 1 -- 172.21.15.44:0/1062525322 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fa68c024020 con 0x7fa698107620 2024-05-03T22:29:37.759 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.816+0000 7fa69de00700 1 -- 172.21.15.44:0/1062525322 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa698064b00 con 0x7fa698107620 2024-05-03T22:29:37.759 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.816+0000 7fa695600700 1 --2- 172.21.15.44:0/1062525322 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fa68003e4c0 0x7fa680040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:37.759 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.816+0000 7fa695600700 1 -- 172.21.15.44:0/1062525322 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa68c00f050 con 0x7fa698107620 2024-05-03T22:29:37.759 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.817+0000 7fa697e00700 1 --2- 172.21.15.44:0/1062525322 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fa68003e4c0 0x7fa680040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:37.759 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.817+0000 7fa697e00700 1 --2- 172.21.15.44:0/1062525322 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fa68003e4c0 0x7fa680040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa684006fd0 tx=0x7fa684006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:37.759 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:36.823+0000 7fa695600700 1 -- 172.21.15.44:0/1062525322 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa68c02b020 con 0x7fa698107620 2024-05-03T22:29:37.759 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:37.060+0000 7fa69de00700 1 -- 172.21.15.44:0/1062525322 --> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fa69802e8f0 con 0x7fa68003e4c0 2024-05-03T22:29:37.759 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:37.062+0000 7fa695600700 1 -- 172.21.15.44:0/1062525322 <== mgr.14120 v2:172.21.15.44:6800/1309719283 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fa69802e8f0 con 0x7fa68003e4c0 2024-05-03T22:29:37.760 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:37.066+0000 7fa69de00700 1 -- 172.21.15.44:0/1062525322 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fa68003e4c0 msgr2=0x7fa680040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:37.760 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:37.066+0000 7fa69de00700 1 --2- 172.21.15.44:0/1062525322 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fa68003e4c0 0x7fa680040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa684006fd0 tx=0x7fa684006e40 comp rx=0 tx=0).stop 2024-05-03T22:29:37.760 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:37.066+0000 7fa69de00700 1 -- 172.21.15.44:0/1062525322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa698107620 msgr2=0x7fa69819eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:37.760 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:37.066+0000 7fa69de00700 1 --2- 172.21.15.44:0/1062525322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa698107620 0x7fa69819eec0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00d010 tx=0x7fa68c003d00 comp rx=0 tx=0).stop 2024-05-03T22:29:37.760 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:37.066+0000 7fa69de00700 1 -- 172.21.15.44:0/1062525322 shutdown_connections 2024-05-03T22:29:37.760 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:37.066+0000 7fa69de00700 1 --2- 172.21.15.44:0/1062525322 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fa68003e4c0 0x7fa680040980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:37.760 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:37.066+0000 7fa69de00700 1 --2- 172.21.15.44:0/1062525322 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa698107620 0x7fa69819eec0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:37.760 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:37.066+0000 7fa69de00700 1 -- 172.21.15.44:0/1062525322 >> 172.21.15.44:0/1062525322 conn(0x7fa6981031e0 msgr2=0x7fa698195ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:37.761 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:37.067+0000 7fa69de00700 1 -- 172.21.15.44:0/1062525322 shutdown_connections 2024-05-03T22:29:37.761 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:37.067+0000 7fa69de00700 1 -- 172.21.15.44:0/1062525322 wait complete. 2024-05-03T22:29:37.761 INFO:teuthology.orchestra.run.smithi044.stdout:Generating ssh key... 2024-05-03T22:29:38.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:37 smithi044 ceph-mon[28604]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:29:39.253 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: Generating public/private rsa key pair. 2024-05-03T22:29:39.253 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: Your identification has been saved in /tmp/tmp75pck7ir/key. 2024-05-03T22:29:39.253 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: Your public key has been saved in /tmp/tmp75pck7ir/key.pub. 2024-05-03T22:29:39.253 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: The key fingerprint is: 2024-05-03T22:29:39.253 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: SHA256:UXKGiHh48O7+pj/7fEb19iPCUbxg16q7JcabYdU1yrw ceph-5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:29:39.253 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: The key's randomart image is: 2024-05-03T22:29:39.253 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: +---[RSA 3072]----+ 2024-05-03T22:29:39.253 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: | .+ . ...+ | 2024-05-03T22:29:39.253 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: | o.+ . .= | 2024-05-03T22:29:39.253 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: | o. . . ...| 2024-05-03T22:29:39.253 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: | . . o++o.o| 2024-05-03T22:29:39.254 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: | . S ..+*o. | 2024-05-03T22:29:39.254 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: | . o..o+ | 2024-05-03T22:29:39.254 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: | . ..*oE . | 2024-05-03T22:29:39.254 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: | . o. =+*. ..| 2024-05-03T22:29:39.254 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: | o=++oo =+ . .| 2024-05-03T22:29:39.254 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: +----[SHA256]-----+ 2024-05-03T22:29:39.684 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.417+0000 7f2aa1200700 1 Processor -- start 2024-05-03T22:29:39.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.417+0000 7f2aa1200700 1 -- start start 2024-05-03T22:29:39.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.417+0000 7f2aa1200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a9c108d40 0x7f2a9c109160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:39.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.417+0000 7f2aa1200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c109730 con 0x7f2a9c108d40 2024-05-03T22:29:39.685 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.418+0000 7f2a9b400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a9c108d40 0x7f2a9c109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.418+0000 7f2a9b400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a9c108d40 0x7f2a9c109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47740/0 (socket says 172.21.15.44:47740) 2024-05-03T22:29:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.418+0000 7f2a9b400700 1 -- 172.21.15.44:0/3770371475 learned_addr learned my addr 172.21.15.44:0/3770371475 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.418+0000 7f2a9b400700 1 -- 172.21.15.44:0/3770371475 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9c109f40 con 0x7f2a9c108d40 2024-05-03T22:29:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.419+0000 7f2a9b400700 1 --2- 172.21.15.44:0/3770371475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a9c108d40 0x7f2a9c109160 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c0098a0 tx=0x7f2a8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d322f553ebadf3a server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.419+0000 7f2a9a000700 1 -- 172.21.15.44:0/3770371475 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a8c004160 con 0x7f2a9c108d40 2024-05-03T22:29:39.686 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.419+0000 7f2a9a000700 1 -- 172.21.15.44:0/3770371475 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a8c004300 con 0x7f2a9c108d40 2024-05-03T22:29:39.687 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.419+0000 7f2a9a000700 1 -- 172.21.15.44:0/3770371475 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a8c011b30 con 0x7f2a9c108d40 2024-05-03T22:29:39.687 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.420+0000 7f2aa1200700 1 -- 172.21.15.44:0/3770371475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a9c108d40 msgr2=0x7f2a9c109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:39.687 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.420+0000 7f2aa1200700 1 --2- 172.21.15.44:0/3770371475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a9c108d40 0x7f2a9c109160 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c0098a0 tx=0x7f2a8c009bb0 comp rx=0 tx=0).stop 2024-05-03T22:29:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.420+0000 7f2aa1200700 1 -- 172.21.15.44:0/3770371475 shutdown_connections 2024-05-03T22:29:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.420+0000 7f2aa1200700 1 --2- 172.21.15.44:0/3770371475 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a9c108d40 0x7f2a9c109160 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.420+0000 7f2aa1200700 1 -- 172.21.15.44:0/3770371475 >> 172.21.15.44:0/3770371475 conn(0x7f2a9c104300 msgr2=0x7f2a9c106720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.420+0000 7f2aa1200700 1 -- 172.21.15.44:0/3770371475 shutdown_connections 2024-05-03T22:29:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.420+0000 7f2aa1200700 1 -- 172.21.15.44:0/3770371475 wait complete. 2024-05-03T22:29:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.421+0000 7f2aa1200700 1 Processor -- start 2024-05-03T22:29:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.421+0000 7f2aa1200700 1 -- start start 2024-05-03T22:29:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.422+0000 7f2aa1200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a9c108d40 0x7f2a9c19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.422+0000 7f2aa1200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9c10d2f0 con 0x7f2a9c108d40 2024-05-03T22:29:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.422+0000 7f2a9b400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a9c108d40 0x7f2a9c19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:39.689 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.422+0000 7f2a9b400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a9c108d40 0x7f2a9c19ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47742/0 (socket says 172.21.15.44:47742) 2024-05-03T22:29:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.422+0000 7f2a9b400700 1 -- 172.21.15.44:0/156020087 learned_addr learned my addr 172.21.15.44:0/156020087 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.423+0000 7f2a9b400700 1 -- 172.21.15.44:0/156020087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a9c19f470 con 0x7f2a9c108d40 2024-05-03T22:29:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.423+0000 7f2a9b400700 1 --2- 172.21.15.44:0/156020087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a9c108d40 0x7f2a9c19ef30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c011840 tx=0x7f2a8c011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.423+0000 7f2a93e00700 1 -- 172.21.15.44:0/156020087 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a8c003aa0 con 0x7f2a9c108d40 2024-05-03T22:29:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.423+0000 7f2a93e00700 1 -- 172.21.15.44:0/156020087 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a8c003c40 con 0x7f2a9c108d40 2024-05-03T22:29:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.423+0000 7f2a93e00700 1 -- 172.21.15.44:0/156020087 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2a8c0247f0 con 0x7f2a9c108d40 2024-05-03T22:29:39.690 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.423+0000 7f2aa1200700 1 -- 172.21.15.44:0/156020087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a9c19f700 con 0x7f2a9c108d40 2024-05-03T22:29:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.424+0000 7f2aa1200700 1 -- 172.21.15.44:0/156020087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a9c1a23f0 con 0x7f2a9c108d40 2024-05-03T22:29:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.425+0000 7f2aa1200700 1 -- 172.21.15.44:0/156020087 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a9c064b00 con 0x7f2a9c108d40 2024-05-03T22:29:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.425+0000 7f2a93e00700 1 -- 172.21.15.44:0/156020087 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f2a8c022020 con 0x7f2a9c108d40 2024-05-03T22:29:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.425+0000 7f2a93e00700 1 --2- 172.21.15.44:0/156020087 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f2a8003e4c0 0x7f2a80040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:39.692 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.425+0000 7f2a93e00700 1 -- 172.21.15.44:0/156020087 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2a8c053530 con 0x7f2a9c108d40 2024-05-03T22:29:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.426+0000 7f2a9aa00700 1 --2- 172.21.15.44:0/156020087 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f2a8003e4c0 0x7f2a80040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.426+0000 7f2a9aa00700 1 --2- 172.21.15.44:0/156020087 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f2a8003e4c0 0x7f2a80040980 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2a88006fd0 tx=0x7f2a88006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.435+0000 7f2a93e00700 1 -- 172.21.15.44:0/156020087 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f2a8c00b3e0 con 0x7f2a9c108d40 2024-05-03T22:29:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:38.663+0000 7f2aa1200700 1 -- 172.21.15.44:0/156020087 --> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f2a9c105600 con 0x7f2a8003e4c0 2024-05-03T22:29:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:39.009+0000 7f2a93e00700 1 -- 172.21.15.44:0/156020087 <== mgr.14120 v2:172.21.15.44:6800/1309719283 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2a9c105600 con 0x7f2a8003e4c0 2024-05-03T22:29:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:39.011+0000 7f2aa1200700 1 -- 172.21.15.44:0/156020087 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f2a8003e4c0 msgr2=0x7f2a80040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:39.011+0000 7f2aa1200700 1 --2- 172.21.15.44:0/156020087 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f2a8003e4c0 0x7f2a80040980 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2a88006fd0 tx=0x7f2a88006e40 comp rx=0 tx=0).stop 2024-05-03T22:29:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:39.012+0000 7f2aa1200700 1 -- 172.21.15.44:0/156020087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a9c108d40 msgr2=0x7f2a9c19ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:39.012+0000 7f2aa1200700 1 --2- 172.21.15.44:0/156020087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a9c108d40 0x7f2a9c19ef30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c011840 tx=0x7f2a8c011c00 comp rx=0 tx=0).stop 2024-05-03T22:29:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:39.012+0000 7f2aa1200700 1 -- 172.21.15.44:0/156020087 shutdown_connections 2024-05-03T22:29:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:39.012+0000 7f2aa1200700 1 --2- 172.21.15.44:0/156020087 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f2a8003e4c0 0x7f2a80040980 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:39.012+0000 7f2aa1200700 1 --2- 172.21.15.44:0/156020087 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2a9c108d40 0x7f2a9c19ef30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:39.012+0000 7f2aa1200700 1 -- 172.21.15.44:0/156020087 >> 172.21.15.44:0/156020087 conn(0x7f2a9c104300 msgr2=0x7f2a9c104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:39.012+0000 7f2aa1200700 1 -- 172.21.15.44:0/156020087 shutdown_connections 2024-05-03T22:29:39.693 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:39.012+0000 7f2aa1200700 1 -- 172.21.15.44:0/156020087 wait complete. 2024-05-03T22:29:40.334 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:40 smithi044 ceph-mon[28604]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:29:40.334 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:40 smithi044 ceph-mon[28604]: Generating ssh key... 2024-05-03T22:29:40.334 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:40 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' 2024-05-03T22:29:40.334 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:40 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' 2024-05-03T22:29:41.274 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDhFzLyy/5IjrQlL7TdLa676+LppGMb9I9CJBuitHx//+vevCjPcqM3p0Vq+jk286aLgQ0sZwnVUBLcm+Ou/ugN9EDTJ7bfhDYgX7rBecNZ0m7BpbF/sEcWMSeRA35aSyUsH2ydZS4GeZLVWaRIgf5SFbOIjKcC+PVUk9ewJuCRSyuFsbBCXy+ewTIe5jN7UKhIVukpz9DnaWAanp7Lq6clkvnwn4VbBhCxjnr9MH+8bX7Vuh+chw8f/urbWl/MiqTnI/neqR/hboXN8X1gX1NgmR2K5BnGLCksDZ/XzMTF/1cbpBLSGqYGYFfN2LjMSD5sDJv6YWdXDYeuIIwjjJDLSIBRmuH71vOsUGZyhqjJUrYVNBp/HUf4mhjFqe5Pgdt6MF39G69G07GiGk/q96u3Fq1W9r+nrddW0/+PaQWhIj1ZIDsWnILz5OrreDpQTK3zI+XJFdVCvRbFdkBODZ+SDS67wTKv/myIwa6a/JNb/9Vy1fwkUVCVSL70BBObkYM= ceph-5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:29:41.274 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.331+0000 7f4896800700 1 Processor -- start 2024-05-03T22:29:41.274 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.332+0000 7f4896800700 1 -- start start 2024-05-03T22:29:41.281 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.332+0000 7f4896800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f489007ee60 0x7f489007d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:41.281 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.332+0000 7f4896800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f489007d890 con 0x7f489007ee60 2024-05-03T22:29:41.281 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.333+0000 7f488f400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f489007ee60 0x7f489007d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:41.281 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.333+0000 7f488f400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f489007ee60 0x7f489007d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35084/0 (socket says 172.21.15.44:35084) 2024-05-03T22:29:41.281 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.333+0000 7f488f400700 1 -- 172.21.15.44:0/2191334771 learned_addr learned my addr 172.21.15.44:0/2191334771 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:41.281 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.333+0000 7f488f400700 1 -- 172.21.15.44:0/2191334771 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489007da10 con 0x7f489007ee60 2024-05-03T22:29:41.281 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.334+0000 7f488f400700 1 --2- 172.21.15.44:0/2191334771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f489007ee60 0x7f489007d2c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4880009e80 tx=0x7f488000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589486219b934ba4 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:41.281 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.334+0000 7f488ea00700 1 -- 172.21.15.44:0/2191334771 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4880017070 con 0x7f489007ee60 2024-05-03T22:29:41.281 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.334+0000 7f488ea00700 1 -- 172.21.15.44:0/2191334771 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f488000b8c0 con 0x7f489007ee60 2024-05-03T22:29:41.281 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.334+0000 7f488ea00700 1 -- 172.21.15.44:0/2191334771 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48800045a0 con 0x7f489007ee60 2024-05-03T22:29:41.281 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.335+0000 7f4896800700 1 -- 172.21.15.44:0/2191334771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f489007ee60 msgr2=0x7f489007d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:41.281 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.335+0000 7f4896800700 1 --2- 172.21.15.44:0/2191334771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f489007ee60 0x7f489007d2c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4880009e80 tx=0x7f488000b330 comp rx=0 tx=0).stop 2024-05-03T22:29:41.282 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.335+0000 7f4896800700 1 -- 172.21.15.44:0/2191334771 shutdown_connections 2024-05-03T22:29:41.282 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.335+0000 7f4896800700 1 --2- 172.21.15.44:0/2191334771 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f489007ee60 0x7f489007d2c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:41.282 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.335+0000 7f4896800700 1 -- 172.21.15.44:0/2191334771 >> 172.21.15.44:0/2191334771 conn(0x7f48901044a0 msgr2=0x7f48901068e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:41.282 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.335+0000 7f4896800700 1 -- 172.21.15.44:0/2191334771 shutdown_connections 2024-05-03T22:29:41.282 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.335+0000 7f4896800700 1 -- 172.21.15.44:0/2191334771 wait complete. 2024-05-03T22:29:41.282 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.336+0000 7f4896800700 1 Processor -- start 2024-05-03T22:29:41.282 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.336+0000 7f4896800700 1 -- start start 2024-05-03T22:29:41.282 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.336+0000 7f4896800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f489007ee60 0x7f489019f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:41.282 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.337+0000 7f4896800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f489010f4d0 con 0x7f489007ee60 2024-05-03T22:29:41.282 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.337+0000 7f488f400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f489007ee60 0x7f489019f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:41.282 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.337+0000 7f488f400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f489007ee60 0x7f489019f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35094/0 (socket says 172.21.15.44:35094) 2024-05-03T22:29:41.282 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.337+0000 7f488f400700 1 -- 172.21.15.44:0/836223905 learned_addr learned my addr 172.21.15.44:0/836223905 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:41.282 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.337+0000 7f488f400700 1 -- 172.21.15.44:0/836223905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489019f550 con 0x7f489007ee60 2024-05-03T22:29:41.282 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.338+0000 7f488f400700 1 --2- 172.21.15.44:0/836223905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f489007ee60 0x7f489019f010 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f488000d010 tx=0x7f4880003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:41.283 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.338+0000 7f488cc00700 1 -- 172.21.15.44:0/836223905 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4880021020 con 0x7f489007ee60 2024-05-03T22:29:41.283 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.338+0000 7f488cc00700 1 -- 172.21.15.44:0/836223905 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48800048a0 con 0x7f489007ee60 2024-05-03T22:29:41.283 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.338+0000 7f4896800700 1 -- 172.21.15.44:0/836223905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f489019f7e0 con 0x7f489007ee60 2024-05-03T22:29:41.283 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.338+0000 7f488cc00700 1 -- 172.21.15.44:0/836223905 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4880017040 con 0x7f489007ee60 2024-05-03T22:29:41.283 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.338+0000 7f4896800700 1 -- 172.21.15.44:0/836223905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48901a24d0 con 0x7f489007ee60 2024-05-03T22:29:41.283 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.339+0000 7f488cc00700 1 -- 172.21.15.44:0/836223905 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f4880024020 con 0x7f489007ee60 2024-05-03T22:29:41.283 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.339+0000 7f4896800700 1 -- 172.21.15.44:0/836223905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4890064b00 con 0x7f489007ee60 2024-05-03T22:29:41.283 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.340+0000 7f488cc00700 1 --2- 172.21.15.44:0/836223905 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f487403e4c0 0x7f4874040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:41.283 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.340+0000 7f488cc00700 1 -- 172.21.15.44:0/836223905 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f488000f050 con 0x7f489007ee60 2024-05-03T22:29:41.283 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.340+0000 7f4886a00700 1 --2- 172.21.15.44:0/836223905 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f487403e4c0 0x7f4874040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:41.283 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.341+0000 7f4886a00700 1 --2- 172.21.15.44:0/836223905 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f487403e4c0 0x7f4874040980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4878006fd0 tx=0x7f4878006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:41.283 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.345+0000 7f488cc00700 1 -- 172.21.15.44:0/836223905 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f488002b020 con 0x7f489007ee60 2024-05-03T22:29:41.283 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.593+0000 7f4896800700 1 -- 172.21.15.44:0/836223905 --> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f4890105700 con 0x7f487403e4c0 2024-05-03T22:29:41.283 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.594+0000 7f488cc00700 1 -- 172.21.15.44:0/836223905 <== mgr.14120 v2:172.21.15.44:6800/1309719283 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f4890105700 con 0x7f487403e4c0 2024-05-03T22:29:41.284 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.597+0000 7f4896800700 1 -- 172.21.15.44:0/836223905 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f487403e4c0 msgr2=0x7f4874040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:41.284 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.597+0000 7f4896800700 1 --2- 172.21.15.44:0/836223905 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f487403e4c0 0x7f4874040980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4878006fd0 tx=0x7f4878006e40 comp rx=0 tx=0).stop 2024-05-03T22:29:41.284 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.597+0000 7f4896800700 1 -- 172.21.15.44:0/836223905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f489007ee60 msgr2=0x7f489019f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:41.284 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.597+0000 7f4896800700 1 --2- 172.21.15.44:0/836223905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f489007ee60 0x7f489019f010 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f488000d010 tx=0x7f4880003d00 comp rx=0 tx=0).stop 2024-05-03T22:29:41.284 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.597+0000 7f4896800700 1 -- 172.21.15.44:0/836223905 shutdown_connections 2024-05-03T22:29:41.284 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.597+0000 7f4896800700 1 --2- 172.21.15.44:0/836223905 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f487403e4c0 0x7f4874040980 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:41.285 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.597+0000 7f4896800700 1 --2- 172.21.15.44:0/836223905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f489007ee60 0x7f489019f010 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:41.285 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.597+0000 7f4896800700 1 -- 172.21.15.44:0/836223905 >> 172.21.15.44:0/836223905 conn(0x7f48901044a0 msgr2=0x7f4890104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:41.285 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.598+0000 7f4896800700 1 -- 172.21.15.44:0/836223905 shutdown_connections 2024-05-03T22:29:41.285 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:40.598+0000 7f4896800700 1 -- 172.21.15.44:0/836223905 wait complete. 2024-05-03T22:29:41.285 INFO:teuthology.orchestra.run.smithi044.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-03T22:29:41.285 INFO:teuthology.orchestra.run.smithi044.stdout:Adding key to root@localhost authorized_keys... 2024-05-03T22:29:41.285 INFO:teuthology.orchestra.run.smithi044.stdout:Adding host smithi044... 2024-05-03T22:29:41.840 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:41 smithi044 ceph-mon[28604]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:29:42.842 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:42 smithi044 ceph-mon[28604]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi044", "addr": "172.21.15.44", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:29:43.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:43 smithi044 ceph-mon[28604]: Deploying cephadm binary to smithi044 2024-05-03T22:29:49.192 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout Added host 'smithi044' with addr '172.21.15.44' 2024-05-03T22:29:49.193 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.896+0000 7fd212200700 1 Processor -- start 2024-05-03T22:29:49.193 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.896+0000 7fd212200700 1 -- start start 2024-05-03T22:29:49.193 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.897+0000 7fd212200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c10afa0 0x7fd20c10b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:49.193 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.897+0000 7fd212200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c10b990 con 0x7fd20c10afa0 2024-05-03T22:29:49.193 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.897+0000 7fd210e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c10afa0 0x7fd20c10b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:49.193 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.897+0000 7fd210e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c10afa0 0x7fd20c10b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35108/0 (socket says 172.21.15.44:35108) 2024-05-03T22:29:49.193 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.897+0000 7fd210e00700 1 -- 172.21.15.44:0/2131684108 learned_addr learned my addr 172.21.15.44:0/2131684108 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:49.193 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.898+0000 7fd210e00700 1 -- 172.21.15.44:0/2131684108 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20c10c1a0 con 0x7fd20c10afa0 2024-05-03T22:29:49.193 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.898+0000 7fd210e00700 1 --2- 172.21.15.44:0/2131684108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c10afa0 0x7fd20c10b3c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd2000098a0 tx=0x7fd200009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9e76a99c8a19cf server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:49.193 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.899+0000 7fd20b400700 1 -- 172.21.15.44:0/2131684108 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd200004160 con 0x7fd20c10afa0 2024-05-03T22:29:49.193 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.899+0000 7fd20b400700 1 -- 172.21.15.44:0/2131684108 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd200004300 con 0x7fd20c10afa0 2024-05-03T22:29:49.193 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.899+0000 7fd20b400700 1 -- 172.21.15.44:0/2131684108 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd200011b30 con 0x7fd20c10afa0 2024-05-03T22:29:49.194 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.900+0000 7fd212200700 1 -- 172.21.15.44:0/2131684108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c10afa0 msgr2=0x7fd20c10b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:49.194 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.900+0000 7fd212200700 1 --2- 172.21.15.44:0/2131684108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c10afa0 0x7fd20c10b3c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd2000098a0 tx=0x7fd200009bb0 comp rx=0 tx=0).stop 2024-05-03T22:29:49.194 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.900+0000 7fd212200700 1 -- 172.21.15.44:0/2131684108 shutdown_connections 2024-05-03T22:29:49.194 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.900+0000 7fd212200700 1 --2- 172.21.15.44:0/2131684108 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c10afa0 0x7fd20c10b3c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:49.194 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.900+0000 7fd212200700 1 -- 172.21.15.44:0/2131684108 >> 172.21.15.44:0/2131684108 conn(0x7fd20c07e380 msgr2=0x7fd20c07e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:49.194 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.900+0000 7fd212200700 1 -- 172.21.15.44:0/2131684108 shutdown_connections 2024-05-03T22:29:49.194 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.900+0000 7fd212200700 1 -- 172.21.15.44:0/2131684108 wait complete. 2024-05-03T22:29:49.194 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.901+0000 7fd212200700 1 Processor -- start 2024-05-03T22:29:49.194 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.902+0000 7fd212200700 1 -- start start 2024-05-03T22:29:49.194 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.902+0000 7fd212200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c10afa0 0x7fd20c19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:49.194 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.902+0000 7fd212200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c10f550 con 0x7fd20c10afa0 2024-05-03T22:29:49.194 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.902+0000 7fd210e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c10afa0 0x7fd20c19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:49.195 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.903+0000 7fd210e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c10afa0 0x7fd20c19ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35124/0 (socket says 172.21.15.44:35124) 2024-05-03T22:29:49.195 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.903+0000 7fd210e00700 1 -- 172.21.15.44:0/3671638861 learned_addr learned my addr 172.21.15.44:0/3671638861 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:49.195 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.903+0000 7fd210e00700 1 -- 172.21.15.44:0/3671638861 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20c19f4a0 con 0x7fd20c10afa0 2024-05-03T22:29:49.195 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.903+0000 7fd210e00700 1 --2- 172.21.15.44:0/3671638861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c10afa0 0x7fd20c19ef60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd200011840 tx=0x7fd200011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:49.195 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.904+0000 7fd209600700 1 -- 172.21.15.44:0/3671638861 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd200003aa0 con 0x7fd20c10afa0 2024-05-03T22:29:49.195 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.904+0000 7fd209600700 1 -- 172.21.15.44:0/3671638861 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd200003c40 con 0x7fd20c10afa0 2024-05-03T22:29:49.195 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.904+0000 7fd209600700 1 -- 172.21.15.44:0/3671638861 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd2000247f0 con 0x7fd20c10afa0 2024-05-03T22:29:49.195 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.904+0000 7fd212200700 1 -- 172.21.15.44:0/3671638861 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20c19f730 con 0x7fd20c10afa0 2024-05-03T22:29:49.195 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.904+0000 7fd212200700 1 -- 172.21.15.44:0/3671638861 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd20c1a2420 con 0x7fd20c10afa0 2024-05-03T22:29:49.195 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.905+0000 7fd212200700 1 -- 172.21.15.44:0/3671638861 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd20c064b00 con 0x7fd20c10afa0 2024-05-03T22:29:49.195 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.905+0000 7fd209600700 1 -- 172.21.15.44:0/3671638861 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fd200022020 con 0x7fd20c10afa0 2024-05-03T22:29:49.195 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.906+0000 7fd209600700 1 --2- 172.21.15.44:0/3671638861 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fd1f403e4c0 0x7fd1f4040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:49.195 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.906+0000 7fd209600700 1 -- 172.21.15.44:0/3671638861 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd2000535f0 con 0x7fd20c10afa0 2024-05-03T22:29:49.196 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.906+0000 7fd20be00700 1 --2- 172.21.15.44:0/3671638861 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fd1f403e4c0 0x7fd1f4040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:49.196 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.907+0000 7fd20be00700 1 --2- 172.21.15.44:0/3671638861 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fd1f403e4c0 0x7fd1f4040980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc006fd0 tx=0x7fd1fc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:49.196 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:41.914+0000 7fd209600700 1 -- 172.21.15.44:0/3671638861 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd20000b3e0 con 0x7fd20c10afa0 2024-05-03T22:29:49.196 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:42.155+0000 7fd212200700 1 -- 172.21.15.44:0/3671638861 --> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi044", "addr": "172.21.15.44", "target": ["mon-mgr", ""]}) -- 0x7fd20c108c80 con 0x7fd1f403e4c0 2024-05-03T22:29:49.196 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:48.486+0000 7fd209600700 1 -- 172.21.15.44:0/3671638861 <== mgr.14120 v2:172.21.15.44:6800/1309719283 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fd20c108c80 con 0x7fd1f403e4c0 2024-05-03T22:29:49.196 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:48.491+0000 7fd212200700 1 -- 172.21.15.44:0/3671638861 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fd1f403e4c0 msgr2=0x7fd1f4040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:49.196 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:48.491+0000 7fd212200700 1 --2- 172.21.15.44:0/3671638861 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fd1f403e4c0 0x7fd1f4040980 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc006fd0 tx=0x7fd1fc006e40 comp rx=0 tx=0).stop 2024-05-03T22:29:49.196 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:48.491+0000 7fd212200700 1 -- 172.21.15.44:0/3671638861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c10afa0 msgr2=0x7fd20c19ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:49.196 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:48.491+0000 7fd212200700 1 --2- 172.21.15.44:0/3671638861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c10afa0 0x7fd20c19ef60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd200011840 tx=0x7fd200011c00 comp rx=0 tx=0).stop 2024-05-03T22:29:49.196 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:48.491+0000 7fd212200700 1 -- 172.21.15.44:0/3671638861 shutdown_connections 2024-05-03T22:29:49.196 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:48.491+0000 7fd212200700 1 --2- 172.21.15.44:0/3671638861 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fd1f403e4c0 0x7fd1f4040980 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:49.196 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:48.491+0000 7fd212200700 1 --2- 172.21.15.44:0/3671638861 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd20c10afa0 0x7fd20c19ef60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:49.196 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:48.491+0000 7fd212200700 1 -- 172.21.15.44:0/3671638861 >> 172.21.15.44:0/3671638861 conn(0x7fd20c07e380 msgr2=0x7fd20c108570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:49.197 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:48.491+0000 7fd212200700 1 -- 172.21.15.44:0/3671638861 shutdown_connections 2024-05-03T22:29:49.197 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:48.491+0000 7fd212200700 1 -- 172.21.15.44:0/3671638861 wait complete. 2024-05-03T22:29:49.197 INFO:teuthology.orchestra.run.smithi044.stdout:Deploying unmanaged mon service... 2024-05-03T22:29:49.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:49 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' 2024-05-03T22:29:49.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:49 smithi044 ceph-mon[28604]: Added host smithi044 2024-05-03T22:29:49.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:49 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:29:50.807 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-03T22:29:50.808 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.841+0000 7f62b7200700 1 Processor -- start 2024-05-03T22:29:50.808 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.842+0000 7f62b7200700 1 -- start start 2024-05-03T22:29:50.808 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.842+0000 7f62b7200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62b0108f20 0x7f62b0109340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:50.808 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.842+0000 7f62b7200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f62b0109880 con 0x7f62b0108f20 2024-05-03T22:29:50.808 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.843+0000 7f62afe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62b0108f20 0x7f62b0109340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:50.811 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.843+0000 7f62afe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62b0108f20 0x7f62b0109340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58994/0 (socket says 172.21.15.44:58994) 2024-05-03T22:29:50.812 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.843+0000 7f62afe00700 1 -- 172.21.15.44:0/1604798913 learned_addr learned my addr 172.21.15.44:0/1604798913 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:50.812 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.843+0000 7f62afe00700 1 -- 172.21.15.44:0/1604798913 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b010a080 con 0x7f62b0108f20 2024-05-03T22:29:50.812 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.844+0000 7f62afe00700 1 --2- 172.21.15.44:0/1604798913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62b0108f20 0x7f62b0109340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f62a00098a0 tx=0x7f62a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6bde599ff8befc server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:50.812 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.844+0000 7f62aea00700 1 -- 172.21.15.44:0/1604798913 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62a0004160 con 0x7f62b0108f20 2024-05-03T22:29:50.812 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.844+0000 7f62aea00700 1 -- 172.21.15.44:0/1604798913 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62a0004300 con 0x7f62b0108f20 2024-05-03T22:29:50.812 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.844+0000 7f62aea00700 1 -- 172.21.15.44:0/1604798913 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62a0011b30 con 0x7f62b0108f20 2024-05-03T22:29:50.812 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.845+0000 7f62b7200700 1 -- 172.21.15.44:0/1604798913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62b0108f20 msgr2=0x7f62b0109340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:50.812 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.845+0000 7f62b7200700 1 --2- 172.21.15.44:0/1604798913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62b0108f20 0x7f62b0109340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f62a00098a0 tx=0x7f62a0009bb0 comp rx=0 tx=0).stop 2024-05-03T22:29:50.812 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.845+0000 7f62b7200700 1 -- 172.21.15.44:0/1604798913 shutdown_connections 2024-05-03T22:29:50.812 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.845+0000 7f62b7200700 1 --2- 172.21.15.44:0/1604798913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62b0108f20 0x7f62b0109340 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:50.812 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.845+0000 7f62b7200700 1 -- 172.21.15.44:0/1604798913 >> 172.21.15.44:0/1604798913 conn(0x7f62b01044e0 msgr2=0x7f62b0106900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:50.812 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.845+0000 7f62b7200700 1 -- 172.21.15.44:0/1604798913 shutdown_connections 2024-05-03T22:29:50.812 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.845+0000 7f62b7200700 1 -- 172.21.15.44:0/1604798913 wait complete. 2024-05-03T22:29:50.813 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.846+0000 7f62b7200700 1 Processor -- start 2024-05-03T22:29:50.813 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.846+0000 7f62b7200700 1 -- start start 2024-05-03T22:29:50.813 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.847+0000 7f62b7200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62b0108f20 0x7f62b019f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:50.813 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.847+0000 7f62b7200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f62b010d340 con 0x7f62b0108f20 2024-05-03T22:29:50.813 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.847+0000 7f62afe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62b0108f20 0x7f62b019f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:50.813 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.847+0000 7f62afe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62b0108f20 0x7f62b019f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59002/0 (socket says 172.21.15.44:59002) 2024-05-03T22:29:50.813 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.847+0000 7f62afe00700 1 -- 172.21.15.44:0/3111248832 learned_addr learned my addr 172.21.15.44:0/3111248832 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:50.813 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.847+0000 7f62afe00700 1 -- 172.21.15.44:0/3111248832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b019f5b0 con 0x7f62b0108f20 2024-05-03T22:29:50.813 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.848+0000 7f62afe00700 1 --2- 172.21.15.44:0/3111248832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62b0108f20 0x7f62b019f070 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62a0011b50 tx=0x7f62a0011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:50.813 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.848+0000 7f62acc00700 1 -- 172.21.15.44:0/3111248832 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62a0003aa0 con 0x7f62b0108f20 2024-05-03T22:29:50.813 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.848+0000 7f62acc00700 1 -- 172.21.15.44:0/3111248832 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62a0020070 con 0x7f62b0108f20 2024-05-03T22:29:50.813 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.848+0000 7f62b7200700 1 -- 172.21.15.44:0/3111248832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62b019f840 con 0x7f62b0108f20 2024-05-03T22:29:50.813 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.848+0000 7f62acc00700 1 -- 172.21.15.44:0/3111248832 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f62a0019550 con 0x7f62b0108f20 2024-05-03T22:29:50.813 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.848+0000 7f62b7200700 1 -- 172.21.15.44:0/3111248832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62b01a2530 con 0x7f62b0108f20 2024-05-03T22:29:50.814 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.849+0000 7f62b7200700 1 -- 172.21.15.44:0/3111248832 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62b010d4c0 con 0x7f62b0108f20 2024-05-03T22:29:50.814 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.849+0000 7f62acc00700 1 -- 172.21.15.44:0/3111248832 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f62a001aa00 con 0x7f62b0108f20 2024-05-03T22:29:50.814 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.850+0000 7f62acc00700 1 --2- 172.21.15.44:0/3111248832 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f629403e4c0 0x7f6294040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:50.814 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.850+0000 7f62acc00700 1 -- 172.21.15.44:0/3111248832 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f62a0053a40 con 0x7f62b0108f20 2024-05-03T22:29:50.815 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.850+0000 7f62af400700 1 --2- 172.21.15.44:0/3111248832 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f629403e4c0 0x7f6294040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:50.816 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.851+0000 7f62af400700 1 --2- 172.21.15.44:0/3111248832 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f629403e4c0 0x7f6294040980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f629c006fd0 tx=0x7f629c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:50.816 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:49.856+0000 7f62acc00700 1 -- 172.21.15.44:0/3111248832 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f62a000e260 con 0x7f62b0108f20 2024-05-03T22:29:50.816 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:50.115+0000 7f62b7200700 1 -- 172.21.15.44:0/3111248832 --> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f62b01056f0 con 0x7f629403e4c0 2024-05-03T22:29:50.816 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:50.124+0000 7f62acc00700 1 -- 172.21.15.44:0/3111248832 <== mgr.14120 v2:172.21.15.44:6800/1309719283 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f62b01056f0 con 0x7f629403e4c0 2024-05-03T22:29:50.816 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:50.128+0000 7f62b7200700 1 -- 172.21.15.44:0/3111248832 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f629403e4c0 msgr2=0x7f6294040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:50.816 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:50.128+0000 7f62b7200700 1 --2- 172.21.15.44:0/3111248832 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f629403e4c0 0x7f6294040980 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f629c006fd0 tx=0x7f629c006e40 comp rx=0 tx=0).stop 2024-05-03T22:29:50.816 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:50.128+0000 7f62b7200700 1 -- 172.21.15.44:0/3111248832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62b0108f20 msgr2=0x7f62b019f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:50.816 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:50.128+0000 7f62b7200700 1 --2- 172.21.15.44:0/3111248832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62b0108f20 0x7f62b019f070 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62a0011b50 tx=0x7f62a0011c30 comp rx=0 tx=0).stop 2024-05-03T22:29:50.816 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:50.128+0000 7f62b7200700 1 -- 172.21.15.44:0/3111248832 shutdown_connections 2024-05-03T22:29:50.816 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:50.128+0000 7f62b7200700 1 --2- 172.21.15.44:0/3111248832 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f629403e4c0 0x7f6294040980 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:50.816 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:50.128+0000 7f62b7200700 1 --2- 172.21.15.44:0/3111248832 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f62b0108f20 0x7f62b019f070 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:50.816 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:50.128+0000 7f62b7200700 1 -- 172.21.15.44:0/3111248832 >> 172.21.15.44:0/3111248832 conn(0x7f62b01044e0 msgr2=0x7f62b0104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:50.816 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:50.128+0000 7f62b7200700 1 -- 172.21.15.44:0/3111248832 shutdown_connections 2024-05-03T22:29:50.817 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:50.128+0000 7f62b7200700 1 -- 172.21.15.44:0/3111248832 wait complete. 2024-05-03T22:29:50.817 INFO:teuthology.orchestra.run.smithi044.stdout:Deploying unmanaged mgr service... 2024-05-03T22:29:51.348 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:51 smithi044 ceph-mon[28604]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:29:51.348 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:51 smithi044 ceph-mon[28604]: Saving service mon spec with placement count:5 2024-05-03T22:29:51.348 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:51 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' 2024-05-03T22:29:53.351 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:53 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' 2024-05-03T22:29:53.351 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:53 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' 2024-05-03T22:29:53.365 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-03T22:29:53.366 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.395+0000 7fe24a200700 1 Processor -- start 2024-05-03T22:29:53.366 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.395+0000 7fe24a200700 1 -- start start 2024-05-03T22:29:53.366 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.395+0000 7fe24a200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2441099d0 0x7fe24410bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:53.366 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.395+0000 7fe24a200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe24407ce90 con 0x7fe2441099d0 2024-05-03T22:29:53.366 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.396+0000 7fe243400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2441099d0 0x7fe24410bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:53.366 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.396+0000 7fe243400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2441099d0 0x7fe24410bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59004/0 (socket says 172.21.15.44:59004) 2024-05-03T22:29:53.366 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.396+0000 7fe243400700 1 -- 172.21.15.44:0/160495512 learned_addr learned my addr 172.21.15.44:0/160495512 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:53.366 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.396+0000 7fe243400700 1 -- 172.21.15.44:0/160495512 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24410c300 con 0x7fe2441099d0 2024-05-03T22:29:53.366 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.397+0000 7fe243400700 1 --2- 172.21.15.44:0/160495512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2441099d0 0x7fe24410bdc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe2340098a0 tx=0x7fe234009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d723a6756fdb26 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:53.366 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.397+0000 7fe242000700 1 -- 172.21.15.44:0/160495512 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe234004160 con 0x7fe2441099d0 2024-05-03T22:29:53.366 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.397+0000 7fe242000700 1 -- 172.21.15.44:0/160495512 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fe234004300 con 0x7fe2441099d0 2024-05-03T22:29:53.367 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.397+0000 7fe242000700 1 -- 172.21.15.44:0/160495512 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe234011af0 con 0x7fe2441099d0 2024-05-03T22:29:53.367 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.398+0000 7fe24a200700 1 -- 172.21.15.44:0/160495512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2441099d0 msgr2=0x7fe24410bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:53.367 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.398+0000 7fe24a200700 1 --2- 172.21.15.44:0/160495512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2441099d0 0x7fe24410bdc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe2340098a0 tx=0x7fe234009bb0 comp rx=0 tx=0).stop 2024-05-03T22:29:53.367 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.398+0000 7fe24a200700 1 -- 172.21.15.44:0/160495512 shutdown_connections 2024-05-03T22:29:53.367 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.398+0000 7fe24a200700 1 --2- 172.21.15.44:0/160495512 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2441099d0 0x7fe24410bdc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:53.367 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.398+0000 7fe24a200700 1 -- 172.21.15.44:0/160495512 >> 172.21.15.44:0/160495512 conn(0x7fe2441033e0 msgr2=0x7fe244105840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:53.367 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.398+0000 7fe24a200700 1 -- 172.21.15.44:0/160495512 shutdown_connections 2024-05-03T22:29:53.367 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.398+0000 7fe24a200700 1 -- 172.21.15.44:0/160495512 wait complete. 2024-05-03T22:29:53.367 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.399+0000 7fe24a200700 1 Processor -- start 2024-05-03T22:29:53.367 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.400+0000 7fe24a200700 1 -- start start 2024-05-03T22:29:53.367 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.400+0000 7fe24a200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2441099d0 0x7fe24419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:53.368 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.400+0000 7fe24a200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe24410d370 con 0x7fe2441099d0 2024-05-03T22:29:53.368 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.400+0000 7fe243400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2441099d0 0x7fe24419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:53.368 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.400+0000 7fe243400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2441099d0 0x7fe24419cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59010/0 (socket says 172.21.15.44:59010) 2024-05-03T22:29:53.368 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.400+0000 7fe243400700 1 -- 172.21.15.44:0/3758926438 learned_addr learned my addr 172.21.15.44:0/3758926438 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:53.368 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.401+0000 7fe243400700 1 -- 172.21.15.44:0/3758926438 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24419d420 con 0x7fe2441099d0 2024-05-03T22:29:53.368 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.401+0000 7fe243400700 1 --2- 172.21.15.44:0/3758926438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2441099d0 0x7fe24419cee0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe234011ac0 tx=0x7fe234011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:53.368 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.401+0000 7fe23be00700 1 -- 172.21.15.44:0/3758926438 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe234003b20 con 0x7fe2441099d0 2024-05-03T22:29:53.368 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.401+0000 7fe23be00700 1 -- 172.21.15.44:0/3758926438 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fe23401a900 con 0x7fe2441099d0 2024-05-03T22:29:53.368 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.401+0000 7fe23be00700 1 -- 172.21.15.44:0/3758926438 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2340248e0 con 0x7fe2441099d0 2024-05-03T22:29:53.368 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.402+0000 7fe24a200700 1 -- 172.21.15.44:0/3758926438 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe24419d6b0 con 0x7fe2441099d0 2024-05-03T22:29:53.368 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.402+0000 7fe24a200700 1 -- 172.21.15.44:0/3758926438 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2441a03a0 con 0x7fe2441099d0 2024-05-03T22:29:53.369 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.403+0000 7fe24a200700 1 -- 172.21.15.44:0/3758926438 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe244064b00 con 0x7fe2441099d0 2024-05-03T22:29:53.369 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.403+0000 7fe23be00700 1 -- 172.21.15.44:0/3758926438 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fe234022020 con 0x7fe2441099d0 2024-05-03T22:29:53.369 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.404+0000 7fe23be00700 1 --2- 172.21.15.44:0/3758926438 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fe22803e4c0 0x7fe228040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:53.369 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.404+0000 7fe23be00700 1 -- 172.21.15.44:0/3758926438 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe2340538e0 con 0x7fe2441099d0 2024-05-03T22:29:53.369 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.404+0000 7fe242a00700 1 --2- 172.21.15.44:0/3758926438 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fe22803e4c0 0x7fe228040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:53.369 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.405+0000 7fe242a00700 1 --2- 172.21.15.44:0/3758926438 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fe22803e4c0 0x7fe228040980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe230006fd0 tx=0x7fe230006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:53.369 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.410+0000 7fe23be00700 1 -- 172.21.15.44:0/3758926438 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe2340212c0 con 0x7fe2441099d0 2024-05-03T22:29:53.369 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.664+0000 7fe24a200700 1 -- 172.21.15.44:0/3758926438 --> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fe2441046a0 con 0x7fe22803e4c0 2024-05-03T22:29:53.369 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.675+0000 7fe23be00700 1 -- 172.21.15.44:0/3758926438 <== mgr.14120 v2:172.21.15.44:6800/1309719283 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe2441046a0 con 0x7fe22803e4c0 2024-05-03T22:29:53.369 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.678+0000 7fe24a200700 1 -- 172.21.15.44:0/3758926438 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fe22803e4c0 msgr2=0x7fe228040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:53.369 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.678+0000 7fe24a200700 1 --2- 172.21.15.44:0/3758926438 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fe22803e4c0 0x7fe228040980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe230006fd0 tx=0x7fe230006e40 comp rx=0 tx=0).stop 2024-05-03T22:29:53.370 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.678+0000 7fe24a200700 1 -- 172.21.15.44:0/3758926438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2441099d0 msgr2=0x7fe24419cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:53.370 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.678+0000 7fe24a200700 1 --2- 172.21.15.44:0/3758926438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2441099d0 0x7fe24419cee0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe234011ac0 tx=0x7fe234011ba0 comp rx=0 tx=0).stop 2024-05-03T22:29:53.370 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.679+0000 7fe24a200700 1 -- 172.21.15.44:0/3758926438 shutdown_connections 2024-05-03T22:29:53.370 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.679+0000 7fe24a200700 1 --2- 172.21.15.44:0/3758926438 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fe22803e4c0 0x7fe228040980 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:53.370 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.679+0000 7fe24a200700 1 --2- 172.21.15.44:0/3758926438 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe2441099d0 0x7fe24419cee0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:53.370 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.679+0000 7fe24a200700 1 -- 172.21.15.44:0/3758926438 >> 172.21.15.44:0/3758926438 conn(0x7fe2441033e0 msgr2=0x7fe244103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:53.370 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.679+0000 7fe24a200700 1 -- 172.21.15.44:0/3758926438 shutdown_connections 2024-05-03T22:29:53.370 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:52.679+0000 7fe24a200700 1 -- 172.21.15.44:0/3758926438 wait complete. 2024-05-03T22:29:54.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:54 smithi044 ceph-mon[28604]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:29:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:54 smithi044 ceph-mon[28604]: Saving service mgr spec with placement count:2 2024-05-03T22:29:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:54 smithi044 ceph-mon[28604]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:29:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:54 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' 2024-05-03T22:29:55.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.970+0000 7f3555000700 1 Processor -- start 2024-05-03T22:29:55.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.970+0000 7f3555000700 1 -- start start 2024-05-03T22:29:55.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.970+0000 7f3555000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f355010b130 0x7f355010b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:55.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.970+0000 7f3555000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f355010bb20 con 0x7f355010b130 2024-05-03T22:29:55.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.971+0000 7f354de00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f355010b130 0x7f355010b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:55.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.971+0000 7f354de00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f355010b130 0x7f355010b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59026/0 (socket says 172.21.15.44:59026) 2024-05-03T22:29:55.130 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.971+0000 7f354de00700 1 -- 172.21.15.44:0/2047567726 learned_addr learned my addr 172.21.15.44:0/2047567726 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:55.131 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.971+0000 7f354de00700 1 -- 172.21.15.44:0/2047567726 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355010c330 con 0x7f355010b130 2024-05-03T22:29:55.131 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.972+0000 7f354de00700 1 --2- 172.21.15.44:0/2047567726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f355010b130 0x7f355010b550 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f35400098a0 tx=0x7f3540009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566f80100ac493e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:55.131 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.972+0000 7f354ca00700 1 -- 172.21.15.44:0/2047567726 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3540004160 con 0x7f355010b130 2024-05-03T22:29:55.131 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.972+0000 7f354ca00700 1 -- 172.21.15.44:0/2047567726 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f3540004300 con 0x7f355010b130 2024-05-03T22:29:55.131 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.972+0000 7f354ca00700 1 -- 172.21.15.44:0/2047567726 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3540011af0 con 0x7f355010b130 2024-05-03T22:29:55.131 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.973+0000 7f3555000700 1 -- 172.21.15.44:0/2047567726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f355010b130 msgr2=0x7f355010b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:55.131 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.973+0000 7f3555000700 1 --2- 172.21.15.44:0/2047567726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f355010b130 0x7f355010b550 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f35400098a0 tx=0x7f3540009bb0 comp rx=0 tx=0).stop 2024-05-03T22:29:55.131 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.973+0000 7f3555000700 1 -- 172.21.15.44:0/2047567726 shutdown_connections 2024-05-03T22:29:55.131 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.973+0000 7f3555000700 1 --2- 172.21.15.44:0/2047567726 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f355010b130 0x7f355010b550 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:55.131 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.973+0000 7f3555000700 1 -- 172.21.15.44:0/2047567726 >> 172.21.15.44:0/2047567726 conn(0x7f355007e520 msgr2=0x7f355007e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:55.131 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.973+0000 7f3555000700 1 -- 172.21.15.44:0/2047567726 shutdown_connections 2024-05-03T22:29:55.131 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.973+0000 7f3555000700 1 -- 172.21.15.44:0/2047567726 wait complete. 2024-05-03T22:29:55.131 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.974+0000 7f3555000700 1 Processor -- start 2024-05-03T22:29:55.131 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.974+0000 7f3555000700 1 -- start start 2024-05-03T22:29:55.131 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.975+0000 7f3555000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f355010b130 0x7f355019f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:55.132 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.975+0000 7f3555000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f355010f6e0 con 0x7f355010b130 2024-05-03T22:29:55.132 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.975+0000 7f354de00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f355010b130 0x7f355019f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:55.132 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.975+0000 7f354de00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f355010b130 0x7f355019f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59040/0 (socket says 172.21.15.44:59040) 2024-05-03T22:29:55.132 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.975+0000 7f354de00700 1 -- 172.21.15.44:0/3837015508 learned_addr learned my addr 172.21.15.44:0/3837015508 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:55.132 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.975+0000 7f354de00700 1 -- 172.21.15.44:0/3837015508 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355019f670 con 0x7f355010b130 2024-05-03T22:29:55.132 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.976+0000 7f354de00700 1 --2- 172.21.15.44:0/3837015508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f355010b130 0x7f355019f130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3540000c00 tx=0x7f3540011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:55.132 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.976+0000 7f3546a00700 1 -- 172.21.15.44:0/3837015508 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3540003b20 con 0x7f355010b130 2024-05-03T22:29:55.132 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.976+0000 7f3555000700 1 -- 172.21.15.44:0/3837015508 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f355019f900 con 0x7f355010b130 2024-05-03T22:29:55.132 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.976+0000 7f3546a00700 1 -- 172.21.15.44:0/3837015508 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f354001a900 con 0x7f355010b130 2024-05-03T22:29:55.132 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.976+0000 7f3546a00700 1 -- 172.21.15.44:0/3837015508 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35400249c0 con 0x7f355010b130 2024-05-03T22:29:55.132 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.976+0000 7f3555000700 1 -- 172.21.15.44:0/3837015508 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35501a25f0 con 0x7f355010b130 2024-05-03T22:29:55.132 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.978+0000 7f3546a00700 1 -- 172.21.15.44:0/3837015508 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f3540022020 con 0x7f355010b130 2024-05-03T22:29:55.132 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.978+0000 7f3555000700 1 -- 172.21.15.44:0/3837015508 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3550064b00 con 0x7f355010b130 2024-05-03T22:29:55.133 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.978+0000 7f3546a00700 1 --2- 172.21.15.44:0/3837015508 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f353403e4c0 0x7f3534040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:55.133 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.978+0000 7f3546a00700 1 -- 172.21.15.44:0/3837015508 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f3540053780 con 0x7f355010b130 2024-05-03T22:29:55.133 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.978+0000 7f354d400700 1 --2- 172.21.15.44:0/3837015508 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f353403e4c0 0x7f3534040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:55.133 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.979+0000 7f354d400700 1 --2- 172.21.15.44:0/3837015508 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f353403e4c0 0x7f3534040980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f353c006fd0 tx=0x7f353c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:55.133 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:53.984+0000 7f3546a00700 1 -- 172.21.15.44:0/3837015508 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f354001aab0 con 0x7f355010b130 2024-05-03T22:29:55.133 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:54.250+0000 7f3555000700 1 -- 172.21.15.44:0/3837015508 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f35501a2c30 con 0x7f355010b130 2024-05-03T22:29:55.133 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:54.255+0000 7f3546a00700 1 -- 172.21.15.44:0/3837015508 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f3540018a40 con 0x7f355010b130 2024-05-03T22:29:55.133 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:54.259+0000 7f3555000700 1 -- 172.21.15.44:0/3837015508 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f353403e4c0 msgr2=0x7f3534040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:55.133 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:54.259+0000 7f3555000700 1 --2- 172.21.15.44:0/3837015508 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f353403e4c0 0x7f3534040980 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f353c006fd0 tx=0x7f353c006e40 comp rx=0 tx=0).stop 2024-05-03T22:29:55.133 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:54.259+0000 7f3555000700 1 -- 172.21.15.44:0/3837015508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f355010b130 msgr2=0x7f355019f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:55.133 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:54.259+0000 7f3555000700 1 --2- 172.21.15.44:0/3837015508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f355010b130 0x7f355019f130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3540000c00 tx=0x7f3540011b70 comp rx=0 tx=0).stop 2024-05-03T22:29:55.133 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:54.259+0000 7f3555000700 1 -- 172.21.15.44:0/3837015508 shutdown_connections 2024-05-03T22:29:55.133 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:54.259+0000 7f3555000700 1 --2- 172.21.15.44:0/3837015508 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f353403e4c0 0x7f3534040980 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:55.133 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:54.259+0000 7f3555000700 1 --2- 172.21.15.44:0/3837015508 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f355010b130 0x7f355019f130 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:55.133 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:54.259+0000 7f3555000700 1 -- 172.21.15.44:0/3837015508 >> 172.21.15.44:0/3837015508 conn(0x7f355007e520 msgr2=0x7f3550108e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:55.134 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:54.260+0000 7f3555000700 1 -- 172.21.15.44:0/3837015508 shutdown_connections 2024-05-03T22:29:55.134 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:54.260+0000 7f3555000700 1 -- 172.21.15.44:0/3837015508 wait complete. 2024-05-03T22:29:55.394 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:55 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3837015508' entity='client.admin' 2024-05-03T22:29:56.658 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:56 smithi044 ceph-mon[28604]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:29:56.658 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:56 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' 2024-05-03T22:29:57.108 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.067+0000 7f4e59c00700 1 Processor -- start 2024-05-03T22:29:57.108 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.067+0000 7f4e59c00700 1 -- start start 2024-05-03T22:29:57.108 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.068+0000 7f4e59c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e54107e00 0x7f4e54108220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:57.108 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.068+0000 7f4e59c00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4e54108760 con 0x7f4e54107e00 2024-05-03T22:29:57.108 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.068+0000 7f4e52a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e54107e00 0x7f4e54108220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:57.108 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.068+0000 7f4e52a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e54107e00 0x7f4e54108220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59054/0 (socket says 172.21.15.44:59054) 2024-05-03T22:29:57.109 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.068+0000 7f4e52a00700 1 -- 172.21.15.44:0/3029023019 learned_addr learned my addr 172.21.15.44:0/3029023019 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:57.109 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.069+0000 7f4e52a00700 1 -- 172.21.15.44:0/3029023019 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e54108f60 con 0x7f4e54107e00 2024-05-03T22:29:57.109 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.069+0000 7f4e52a00700 1 --2- 172.21.15.44:0/3029023019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e54107e00 0x7f4e54108220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400bb40 tx=0x7f4e4400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11fce5799cbc261 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:57.109 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.069+0000 7f4e51600700 1 -- 172.21.15.44:0/3029023019 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e4400dbe0 con 0x7f4e54107e00 2024-05-03T22:29:57.109 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.069+0000 7f4e51600700 1 -- 172.21.15.44:0/3029023019 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f4e44004500 con 0x7f4e54107e00 2024-05-03T22:29:57.109 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.069+0000 7f4e51600700 1 -- 172.21.15.44:0/3029023019 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e44010470 con 0x7f4e54107e00 2024-05-03T22:29:57.109 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.070+0000 7f4e59c00700 1 -- 172.21.15.44:0/3029023019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e54107e00 msgr2=0x7f4e54108220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:57.109 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.070+0000 7f4e59c00700 1 --2- 172.21.15.44:0/3029023019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e54107e00 0x7f4e54108220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400bb40 tx=0x7f4e4400be50 comp rx=0 tx=0).stop 2024-05-03T22:29:57.109 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.070+0000 7f4e59c00700 1 -- 172.21.15.44:0/3029023019 shutdown_connections 2024-05-03T22:29:57.109 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.070+0000 7f4e59c00700 1 --2- 172.21.15.44:0/3029023019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e54107e00 0x7f4e54108220 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:57.109 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.070+0000 7f4e59c00700 1 -- 172.21.15.44:0/3029023019 >> 172.21.15.44:0/3029023019 conn(0x7f4e54103380 msgr2=0x7f4e541057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:57.109 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.070+0000 7f4e59c00700 1 -- 172.21.15.44:0/3029023019 shutdown_connections 2024-05-03T22:29:57.109 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.070+0000 7f4e59c00700 1 -- 172.21.15.44:0/3029023019 wait complete. 2024-05-03T22:29:57.109 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.071+0000 7f4e59c00700 1 Processor -- start 2024-05-03T22:29:57.110 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.072+0000 7f4e59c00700 1 -- start start 2024-05-03T22:29:57.110 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.072+0000 7f4e59c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e54107e00 0x7f4e5419ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:57.110 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.072+0000 7f4e59c00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5407c840 con 0x7f4e54107e00 2024-05-03T22:29:57.110 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.072+0000 7f4e52a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e54107e00 0x7f4e5419ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:57.110 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.072+0000 7f4e52a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e54107e00 0x7f4e5419ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59070/0 (socket says 172.21.15.44:59070) 2024-05-03T22:29:57.110 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.072+0000 7f4e52a00700 1 -- 172.21.15.44:0/397812680 learned_addr learned my addr 172.21.15.44:0/397812680 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:29:57.110 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.073+0000 7f4e52a00700 1 -- 172.21.15.44:0/397812680 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e5419b1d0 con 0x7f4e54107e00 2024-05-03T22:29:57.110 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.073+0000 7f4e52a00700 1 --2- 172.21.15.44:0/397812680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e54107e00 0x7f4e5419ac90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400b340 tx=0x7f4e4400ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:57.110 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.073+0000 7f4e4b400700 1 -- 172.21.15.44:0/397812680 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e44027070 con 0x7f4e54107e00 2024-05-03T22:29:57.110 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.073+0000 7f4e59c00700 1 -- 172.21.15.44:0/397812680 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e5419b460 con 0x7f4e54107e00 2024-05-03T22:29:57.110 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.073+0000 7f4e4b400700 1 -- 172.21.15.44:0/397812680 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f4e44004340 con 0x7f4e54107e00 2024-05-03T22:29:57.110 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.073+0000 7f4e4b400700 1 -- 172.21.15.44:0/397812680 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e44022a90 con 0x7f4e54107e00 2024-05-03T22:29:57.110 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.074+0000 7f4e59c00700 1 -- 172.21.15.44:0/397812680 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e5419e150 con 0x7f4e54107e00 2024-05-03T22:29:57.110 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.075+0000 7f4e59c00700 1 -- 172.21.15.44:0/397812680 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e54064b00 con 0x7f4e54107e00 2024-05-03T22:29:57.111 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.075+0000 7f4e4b400700 1 -- 172.21.15.44:0/397812680 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f4e4402a070 con 0x7f4e54107e00 2024-05-03T22:29:57.111 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.076+0000 7f4e4b400700 1 --2- 172.21.15.44:0/397812680 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f4e3803e4c0 0x7f4e38040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:29:57.111 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.076+0000 7f4e4b400700 1 -- 172.21.15.44:0/397812680 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4e4401f070 con 0x7f4e54107e00 2024-05-03T22:29:57.111 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.076+0000 7f4e52000700 1 --2- 172.21.15.44:0/397812680 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f4e3803e4c0 0x7f4e38040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:29:57.111 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.077+0000 7f4e52000700 1 --2- 172.21.15.44:0/397812680 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f4e3803e4c0 0x7f4e38040980 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4e40006fd0 tx=0x7f4e40006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:29:57.111 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.081+0000 7f4e4b400700 1 -- 172.21.15.44:0/397812680 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4e4405c080 con 0x7f4e54107e00 2024-05-03T22:29:57.111 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.322+0000 7f4e59c00700 1 -- 172.21.15.44:0/397812680 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f4e54194150 con 0x7f4e54107e00 2024-05-03T22:29:57.111 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.326+0000 7f4e4b400700 1 -- 172.21.15.44:0/397812680 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f4e54194150 con 0x7f4e54107e00 2024-05-03T22:29:57.111 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.329+0000 7f4e59c00700 1 -- 172.21.15.44:0/397812680 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f4e3803e4c0 msgr2=0x7f4e38040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:57.111 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.329+0000 7f4e59c00700 1 --2- 172.21.15.44:0/397812680 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f4e3803e4c0 0x7f4e38040980 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4e40006fd0 tx=0x7f4e40006e40 comp rx=0 tx=0).stop 2024-05-03T22:29:57.111 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.329+0000 7f4e59c00700 1 -- 172.21.15.44:0/397812680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e54107e00 msgr2=0x7f4e5419ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:29:57.111 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.329+0000 7f4e59c00700 1 --2- 172.21.15.44:0/397812680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e54107e00 0x7f4e5419ac90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4e4400b340 tx=0x7f4e4400ded0 comp rx=0 tx=0).stop 2024-05-03T22:29:57.111 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.329+0000 7f4e59c00700 1 -- 172.21.15.44:0/397812680 shutdown_connections 2024-05-03T22:29:57.112 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.330+0000 7f4e59c00700 1 --2- 172.21.15.44:0/397812680 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f4e3803e4c0 0x7f4e38040980 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:57.112 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.330+0000 7f4e59c00700 1 --2- 172.21.15.44:0/397812680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4e54107e00 0x7f4e5419ac90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:29:57.112 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.330+0000 7f4e59c00700 1 -- 172.21.15.44:0/397812680 >> 172.21.15.44:0/397812680 conn(0x7f4e54103380 msgr2=0x7f4e54191210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:29:57.112 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.330+0000 7f4e59c00700 1 -- 172.21.15.44:0/397812680 shutdown_connections 2024-05-03T22:29:57.112 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:56.330+0000 7f4e59c00700 1 -- 172.21.15.44:0/397812680 wait complete. 2024-05-03T22:29:57.112 INFO:teuthology.orchestra.run.smithi044.stdout:Enabling the dashboard module... 2024-05-03T22:29:57.408 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:57 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/397812680' entity='client.admin' 2024-05-03T22:29:58.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:58 smithi044 ceph-mon[28604]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:29:58.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:58 smithi044 ceph-mon[28604]: from='mgr.14120 172.21.15.44:0/1656287351' entity='mgr.x' 2024-05-03T22:29:58.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:29:58 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3742328840' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-03T22:29:59.252 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:59 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: ignoring --setuser ceph since I am not root 2024-05-03T22:29:59.252 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:59 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: ignoring --setgroup ceph since I am not root 2024-05-03T22:29:59.635 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:59 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:59.357+0000 7f0342806200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-03T22:29:59.982 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:59 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:59.632+0000 7f0342806200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:29:59.982 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:29:59 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:29:59.769+0000 7f0342806200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-03T22:30:00.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:00 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3742328840' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-03T22:30:00.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:00 smithi044 ceph-mon[28604]: mgrmap e9: x(active, since 26s) 2024-05-03T22:30:00.252 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:00 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:00.184+0000 7f0342806200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-03T22:30:00.641 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:00 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:00.308+0000 7f0342806200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-03T22:30:00.659 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.725+0000 7fcca9c00700 1 Processor -- start 2024-05-03T22:30:00.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.725+0000 7fcca9c00700 1 -- start start 2024-05-03T22:30:00.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.725+0000 7fcca9c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcca4107e30 0x7fcca4108250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:00.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.725+0000 7fcca9c00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcca4108790 con 0x7fcca4107e30 2024-05-03T22:30:00.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.726+0000 7fcca2a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcca4107e30 0x7fcca4108250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:00.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.726+0000 7fcca2a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcca4107e30 0x7fcca4108250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59072/0 (socket says 172.21.15.44:59072) 2024-05-03T22:30:00.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.726+0000 7fcca2a00700 1 -- 172.21.15.44:0/1446285422 learned_addr learned my addr 172.21.15.44:0/1446285422 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:00.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.726+0000 7fcca2a00700 1 -- 172.21.15.44:0/1446285422 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca4108f90 con 0x7fcca4107e30 2024-05-03T22:30:00.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.727+0000 7fcca2a00700 1 --2- 172.21.15.44:0/1446285422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcca4107e30 0x7fcca4108250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcc940098a0 tx=0x7fcc94009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420047513896eb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:00.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.727+0000 7fcca1600700 1 -- 172.21.15.44:0/1446285422 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc94004160 con 0x7fcca4107e30 2024-05-03T22:30:00.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.727+0000 7fcca1600700 1 -- 172.21.15.44:0/1446285422 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fcc94004300 con 0x7fcca4107e30 2024-05-03T22:30:00.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.727+0000 7fcca1600700 1 -- 172.21.15.44:0/1446285422 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc94011af0 con 0x7fcca4107e30 2024-05-03T22:30:00.660 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.728+0000 7fcca9c00700 1 -- 172.21.15.44:0/1446285422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcca4107e30 msgr2=0x7fcca4108250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:00.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.728+0000 7fcca9c00700 1 --2- 172.21.15.44:0/1446285422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcca4107e30 0x7fcca4108250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcc940098a0 tx=0x7fcc94009bb0 comp rx=0 tx=0).stop 2024-05-03T22:30:00.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.728+0000 7fcca9c00700 1 -- 172.21.15.44:0/1446285422 shutdown_connections 2024-05-03T22:30:00.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.728+0000 7fcca9c00700 1 --2- 172.21.15.44:0/1446285422 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcca4107e30 0x7fcca4108250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:00.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.728+0000 7fcca9c00700 1 -- 172.21.15.44:0/1446285422 >> 172.21.15.44:0/1446285422 conn(0x7fcca41033f0 msgr2=0x7fcca4105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:00.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.728+0000 7fcca9c00700 1 -- 172.21.15.44:0/1446285422 shutdown_connections 2024-05-03T22:30:00.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.728+0000 7fcca9c00700 1 -- 172.21.15.44:0/1446285422 wait complete. 2024-05-03T22:30:00.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.729+0000 7fcca9c00700 1 Processor -- start 2024-05-03T22:30:00.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.729+0000 7fcca9c00700 1 -- start start 2024-05-03T22:30:00.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.730+0000 7fcca9c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcca4107e30 0x7fcca419f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:00.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.730+0000 7fcca9c00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcca410c3d0 con 0x7fcca4107e30 2024-05-03T22:30:00.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.730+0000 7fcca2a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcca4107e30 0x7fcca419f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:00.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.730+0000 7fcca2a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcca4107e30 0x7fcca419f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59080/0 (socket says 172.21.15.44:59080) 2024-05-03T22:30:00.661 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.730+0000 7fcca2a00700 1 -- 172.21.15.44:0/3742328840 learned_addr learned my addr 172.21.15.44:0/3742328840 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:00.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.730+0000 7fcca2a00700 1 -- 172.21.15.44:0/3742328840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca419f680 con 0x7fcca4107e30 2024-05-03T22:30:00.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.731+0000 7fcca2a00700 1 --2- 172.21.15.44:0/3742328840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcca4107e30 0x7fcca419f140 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcc94011670 tx=0x7fcc94011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:00.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.731+0000 7fcc9b400700 1 -- 172.21.15.44:0/3742328840 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc940038b0 con 0x7fcca4107e30 2024-05-03T22:30:00.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.731+0000 7fcc9b400700 1 -- 172.21.15.44:0/3742328840 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fcc94003a50 con 0x7fcca4107e30 2024-05-03T22:30:00.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.731+0000 7fcc9b400700 1 -- 172.21.15.44:0/3742328840 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcc9401a5c0 con 0x7fcca4107e30 2024-05-03T22:30:00.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.731+0000 7fcca9c00700 1 -- 172.21.15.44:0/3742328840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca419f910 con 0x7fcca4107e30 2024-05-03T22:30:00.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.731+0000 7fcca9c00700 1 -- 172.21.15.44:0/3742328840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca41a25b0 con 0x7fcca4107e30 2024-05-03T22:30:00.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.732+0000 7fcca9c00700 1 -- 172.21.15.44:0/3742328840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca410c550 con 0x7fcca4107e30 2024-05-03T22:30:00.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.733+0000 7fcc9b400700 1 -- 172.21.15.44:0/3742328840 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fcc94024430 con 0x7fcca4107e30 2024-05-03T22:30:00.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.733+0000 7fcc9b400700 1 --2- 172.21.15.44:0/3742328840 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fcc8803e420 0x7fcc880408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:00.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.733+0000 7fcc9b400700 1 -- 172.21.15.44:0/3742328840 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcc940539e0 con 0x7fcca4107e30 2024-05-03T22:30:00.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.734+0000 7fcca2000700 1 --2- 172.21.15.44:0/3742328840 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fcc8803e420 0x7fcc880408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:00.662 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.734+0000 7fcca2000700 1 --2- 172.21.15.44:0/3742328840 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fcc8803e420 0x7fcc880408e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcc90006fd0 tx=0x7fcc90006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:00.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:57.739+0000 7fcc9b400700 1 -- 172.21.15.44:0/3742328840 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fcc94019c70 con 0x7fcca4107e30 2024-05-03T22:30:00.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:58.051+0000 7fcca9c00700 1 -- 172.21.15.44:0/3742328840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fcca402e750 con 0x7fcca4107e30 2024-05-03T22:30:00.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:59.019+0000 7fcc9b400700 1 -- 172.21.15.44:0/3742328840 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fcc9400fdd0 con 0x7fcca4107e30 2024-05-03T22:30:00.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:59.024+0000 7fcc9b400700 1 -- 172.21.15.44:0/3742328840 <== mon.0 v2:172.21.15.44:3300/0 8 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7fcc94018a40 con 0x7fcca4107e30 2024-05-03T22:30:00.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:59.026+0000 7fcca9c00700 1 -- 172.21.15.44:0/3742328840 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fcc8803e420 msgr2=0x7fcc880408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:00.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:59.026+0000 7fcca9c00700 1 --2- 172.21.15.44:0/3742328840 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fcc8803e420 0x7fcc880408e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcc90006fd0 tx=0x7fcc90006e40 comp rx=0 tx=0).stop 2024-05-03T22:30:00.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:59.026+0000 7fcca9c00700 1 -- 172.21.15.44:0/3742328840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcca4107e30 msgr2=0x7fcca419f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:00.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:59.026+0000 7fcca9c00700 1 --2- 172.21.15.44:0/3742328840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcca4107e30 0x7fcca419f140 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcc94011670 tx=0x7fcc94011940 comp rx=0 tx=0).stop 2024-05-03T22:30:00.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:59.026+0000 7fcca9c00700 1 -- 172.21.15.44:0/3742328840 shutdown_connections 2024-05-03T22:30:00.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:59.026+0000 7fcca9c00700 1 --2- 172.21.15.44:0/3742328840 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7fcc8803e420 0x7fcc880408e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:00.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:59.026+0000 7fcca9c00700 1 --2- 172.21.15.44:0/3742328840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcca4107e30 0x7fcca419f140 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:00.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:59.026+0000 7fcca9c00700 1 -- 172.21.15.44:0/3742328840 >> 172.21.15.44:0/3742328840 conn(0x7fcca41033f0 msgr2=0x7fcca41042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:00.663 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:59.026+0000 7fcca9c00700 1 -- 172.21.15.44:0/3742328840 shutdown_connections 2024-05-03T22:30:00.664 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:29:59.026+0000 7fcca9c00700 1 -- 172.21.15.44:0/3742328840 wait complete. 2024-05-03T22:30:01.868 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:01 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/837322376' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-03T22:30:02.163 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:01 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:01.943+0000 7f0342806200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-03T22:30:02.172 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-05-03T22:30:02.179 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-03T22:30:02.179 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-03T22:30:02.179 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-03T22:30:02.179 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-03T22:30:02.179 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-05-03T22:30:02.179 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.192+0000 7f730be00700 1 Processor -- start 2024-05-03T22:30:02.179 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.192+0000 7f730be00700 1 -- start start 2024-05-03T22:30:02.179 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.193+0000 7f730be00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730c10b130 0x7f730c10b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:02.179 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.193+0000 7f730be00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f730c10ba90 con 0x7f730c10b130 2024-05-03T22:30:02.179 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.193+0000 7f730aa00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730c10b130 0x7f730c10b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:02.180 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.193+0000 7f730aa00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730c10b130 0x7f730c10b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45554/0 (socket says 172.21.15.44:45554) 2024-05-03T22:30:02.180 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.193+0000 7f730aa00700 1 -- 172.21.15.44:0/180983729 learned_addr learned my addr 172.21.15.44:0/180983729 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:02.180 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.194+0000 7f730aa00700 1 -- 172.21.15.44:0/180983729 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c10c080 con 0x7f730c10b130 2024-05-03T22:30:02.180 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.194+0000 7f730aa00700 1 --2- 172.21.15.44:0/180983729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730c10b130 0x7f730c10b550 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0098a0 tx=0x7f72fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9277b0d39617b96b server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:02.180 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.194+0000 7f7309600700 1 -- 172.21.15.44:0/180983729 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72fc004160 con 0x7f730c10b130 2024-05-03T22:30:02.180 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.195+0000 7f7309600700 1 -- 172.21.15.44:0/180983729 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f72fc004300 con 0x7f730c10b130 2024-05-03T22:30:02.180 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.195+0000 7f7309600700 1 -- 172.21.15.44:0/180983729 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72fc011af0 con 0x7f730c10b130 2024-05-03T22:30:02.180 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.195+0000 7f730be00700 1 -- 172.21.15.44:0/180983729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730c10b130 msgr2=0x7f730c10b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:02.180 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.195+0000 7f730be00700 1 --2- 172.21.15.44:0/180983729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730c10b130 0x7f730c10b550 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0098a0 tx=0x7f72fc009bb0 comp rx=0 tx=0).stop 2024-05-03T22:30:02.180 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.195+0000 7f730be00700 1 -- 172.21.15.44:0/180983729 shutdown_connections 2024-05-03T22:30:02.180 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.195+0000 7f730be00700 1 --2- 172.21.15.44:0/180983729 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730c10b130 0x7f730c10b550 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:02.180 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.195+0000 7f730be00700 1 -- 172.21.15.44:0/180983729 >> 172.21.15.44:0/180983729 conn(0x7f730c07e410 msgr2=0x7f730c07e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:02.181 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.196+0000 7f730be00700 1 -- 172.21.15.44:0/180983729 shutdown_connections 2024-05-03T22:30:02.181 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.196+0000 7f730be00700 1 -- 172.21.15.44:0/180983729 wait complete. 2024-05-03T22:30:02.181 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.197+0000 7f730be00700 1 Processor -- start 2024-05-03T22:30:02.181 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.197+0000 7f730be00700 1 -- start start 2024-05-03T22:30:02.181 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.197+0000 7f730be00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730c10b130 0x7f730c19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:02.181 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.197+0000 7f730be00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f730c10f4c0 con 0x7f730c10b130 2024-05-03T22:30:02.181 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.198+0000 7f730aa00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730c10b130 0x7f730c19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:02.181 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.198+0000 7f730aa00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730c10b130 0x7f730c19ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45556/0 (socket says 172.21.15.44:45556) 2024-05-03T22:30:02.181 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.198+0000 7f730aa00700 1 -- 172.21.15.44:0/837322376 learned_addr learned my addr 172.21.15.44:0/837322376 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:02.181 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.198+0000 7f730aa00700 1 -- 172.21.15.44:0/837322376 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c19f3b0 con 0x7f730c10b130 2024-05-03T22:30:02.181 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.198+0000 7f730aa00700 1 --2- 172.21.15.44:0/837322376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730c10b130 0x7f730c19ee70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0117b0 tx=0x7f72fc011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:02.181 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.199+0000 7f7303400700 1 -- 172.21.15.44:0/837322376 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72fc003ba0 con 0x7f730c10b130 2024-05-03T22:30:02.181 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.199+0000 7f7303400700 1 -- 172.21.15.44:0/837322376 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f72fc01a900 con 0x7f730c10b130 2024-05-03T22:30:02.181 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.199+0000 7f7303400700 1 -- 172.21.15.44:0/837322376 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72fc024950 con 0x7f730c10b130 2024-05-03T22:30:02.182 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.199+0000 7f730be00700 1 -- 172.21.15.44:0/837322376 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730c19f640 con 0x7f730c10b130 2024-05-03T22:30:02.182 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.199+0000 7f730be00700 1 -- 172.21.15.44:0/837322376 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730c1a2330 con 0x7f730c10b130 2024-05-03T22:30:02.182 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.200+0000 7f7303400700 1 -- 172.21.15.44:0/837322376 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f72fc022020 con 0x7f730c10b130 2024-05-03T22:30:02.182 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.200+0000 7f730be00700 1 -- 172.21.15.44:0/837322376 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f730c10f640 con 0x7f730c10b130 2024-05-03T22:30:02.182 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.201+0000 7f7303400700 1 --2- 172.21.15.44:0/837322376 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f72f003e520 0x7f72f00409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:02.182 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.201+0000 7f7303400700 1 -- 172.21.15.44:0/837322376 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f72fc053fe0 con 0x7f730c10b130 2024-05-03T22:30:02.182 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.201+0000 7f730a000700 1 -- 172.21.15.44:0/837322376 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f72f003e520 msgr2=0x7f72f00409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1309719283 2024-05-03T22:30:02.182 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.201+0000 7f730a000700 1 --2- 172.21.15.44:0/837322376 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f72f003e520 0x7f72f00409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-03T22:30:02.182 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.206+0000 7f7303400700 1 -- 172.21.15.44:0/837322376 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f72fc01ab60 con 0x7f730c10b130 2024-05-03T22:30:02.182 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.402+0000 7f730a000700 1 -- 172.21.15.44:0/837322376 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f72f003e520 msgr2=0x7f72f00409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1309719283 2024-05-03T22:30:02.182 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.402+0000 7f730a000700 1 --2- 172.21.15.44:0/837322376 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f72f003e520 0x7f72f00409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-03T22:30:02.182 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.503+0000 7f730be00700 1 -- 172.21.15.44:0/837322376 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f730c1a28e0 con 0x7f730c10b130 2024-05-03T22:30:02.182 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.503+0000 7f7303400700 1 -- 172.21.15.44:0/837322376 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f72fc053930 con 0x7f730c10b130 2024-05-03T22:30:02.183 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.508+0000 7f730be00700 1 -- 172.21.15.44:0/837322376 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f72f003e520 msgr2=0x7f72f00409e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-03T22:30:02.183 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.508+0000 7f730be00700 1 --2- 172.21.15.44:0/837322376 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f72f003e520 0x7f72f00409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:02.183 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.508+0000 7f730be00700 1 -- 172.21.15.44:0/837322376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730c10b130 msgr2=0x7f730c19ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:02.183 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.508+0000 7f730be00700 1 --2- 172.21.15.44:0/837322376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730c10b130 0x7f730c19ee70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0117b0 tx=0x7f72fc011b70 comp rx=0 tx=0).stop 2024-05-03T22:30:02.183 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.508+0000 7f730be00700 1 -- 172.21.15.44:0/837322376 shutdown_connections 2024-05-03T22:30:02.183 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.508+0000 7f730be00700 1 --2- 172.21.15.44:0/837322376 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7f72f003e520 0x7f72f00409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:02.183 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.508+0000 7f730be00700 1 --2- 172.21.15.44:0/837322376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f730c10b130 0x7f730c19ee70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:02.183 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.508+0000 7f730be00700 1 -- 172.21.15.44:0/837322376 >> 172.21.15.44:0/837322376 conn(0x7f730c07e410 msgr2=0x7f730c108dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:02.183 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.508+0000 7f730be00700 1 -- 172.21.15.44:0/837322376 shutdown_connections 2024-05-03T22:30:02.183 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:01.508+0000 7f730be00700 1 -- 172.21.15.44:0/837322376 wait complete. 2024-05-03T22:30:02.183 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for the mgr to restart... 2024-05-03T22:30:02.183 INFO:teuthology.orchestra.run.smithi044.stdout:Waiting for mgr epoch 9... 2024-05-03T22:30:02.434 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:02 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:02.185+0000 7f0342806200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-03T22:30:02.435 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:02 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:02.431+0000 7f0342806200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-03T22:30:02.976 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:02 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:02.844+0000 7f0342806200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-03T22:30:03.236 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:02 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:02.973+0000 7f0342806200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-03T22:30:03.237 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:03 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:03.233+0000 7f0342806200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-03T22:30:03.751 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:03 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:03.497+0000 7f0342806200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:30:04.501 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:04 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:04.321+0000 7f0342806200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-03T22:30:05.001 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:04 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:04.620+0000 7f0342806200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-03T22:30:05.501 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:05 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:05.205+0000 7f0342806200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-03T22:30:05.502 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:05 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:05.340+0000 7f0342806200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-03T22:30:06.251 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:05 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:05.819+0000 7f0342806200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-03T22:30:06.621 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:06 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:06.300+0000 7f0342806200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-03T22:30:06.622 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:06 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:06.434+0000 7f0342806200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-03T22:30:06.935 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:06 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:06.784+0000 7f0342806200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-03T22:30:07.251 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:06 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:06.972+0000 7f0342806200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-03T22:30:07.656 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:07 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:07.359+0000 7f0342806200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-03T22:30:07.656 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:07 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:07.520+0000 7f0342806200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-03T22:30:07.656 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:07 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:07.652+0000 7f0342806200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-03T22:30:08.752 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:08 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:08.457+0000 7f0342806200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-03T22:30:09.251 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:30:08 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:30:08.762+0000 7f0342806200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-03T22:30:09.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:08 smithi044 ceph-mon[28604]: Active manager daemon x restarted 2024-05-03T22:30:09.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:08 smithi044 ceph-mon[28604]: Activating manager daemon x 2024-05-03T22:30:09.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:08 smithi044 ceph-mon[28604]: osdmap e3: 0 total, 0 up, 0 in 2024-05-03T22:30:09.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:08 smithi044 ceph-mon[28604]: mgrmap e10: x(active, starting, since 0.00763817s) 2024-05-03T22:30:09.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:08 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:30:09.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:08 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-03T22:30:09.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:08 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-03T22:30:09.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:08 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-03T22:30:09.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:08 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-03T22:30:09.253 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:08 smithi044 ceph-mon[28604]: Manager daemon x is now available 2024-05-03T22:30:10.113 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:09 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:30:10.114 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:09 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-03T22:30:10.114 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:09 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-03T22:30:10.114 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:09 smithi044 ceph-mon[28604]: mgrmap e11: x(active, since 1.01524s) 2024-05-03T22:30:10.630 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout { 2024-05-03T22:30:10.630 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-03T22:30:10.630 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-03T22:30:10.640 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout } 2024-05-03T22:30:10.640 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.797+0000 7feed8000700 1 Processor -- start 2024-05-03T22:30:10.640 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.797+0000 7feed8000700 1 -- start start 2024-05-03T22:30:10.640 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.798+0000 7feed8000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed01077b0 0x7feed0107bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:10.640 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.798+0000 7feed8000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feed0108110 con 0x7feed01077b0 2024-05-03T22:30:10.640 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.798+0000 7feed5600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed01077b0 0x7feed0107bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:10.640 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.798+0000 7feed5600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed01077b0 0x7feed0107bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45564/0 (socket says 172.21.15.44:45564) 2024-05-03T22:30:10.640 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.798+0000 7feed5600700 1 -- 172.21.15.44:0/4173624622 learned_addr learned my addr 172.21.15.44:0/4173624622 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:10.640 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.799+0000 7feed5600700 1 -- 172.21.15.44:0/4173624622 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed0108290 con 0x7feed01077b0 2024-05-03T22:30:10.641 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.799+0000 7feed5600700 1 --2- 172.21.15.44:0/4173624622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed01077b0 0x7feed0107bd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feec40098a0 tx=0x7feec4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec81cc23c8fef17e server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:10.641 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.799+0000 7feecfe00700 1 -- 172.21.15.44:0/4173624622 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feec4004160 con 0x7feed01077b0 2024-05-03T22:30:10.641 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.799+0000 7feecfe00700 1 -- 172.21.15.44:0/4173624622 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7feec4004300 con 0x7feed01077b0 2024-05-03T22:30:10.641 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.799+0000 7feecfe00700 1 -- 172.21.15.44:0/4173624622 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feec4011af0 con 0x7feed01077b0 2024-05-03T22:30:10.641 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.800+0000 7feed8000700 1 -- 172.21.15.44:0/4173624622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed01077b0 msgr2=0x7feed0107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:10.641 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.800+0000 7feed8000700 1 --2- 172.21.15.44:0/4173624622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed01077b0 0x7feed0107bd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feec40098a0 tx=0x7feec4009bb0 comp rx=0 tx=0).stop 2024-05-03T22:30:10.641 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.800+0000 7feed8000700 1 -- 172.21.15.44:0/4173624622 shutdown_connections 2024-05-03T22:30:10.641 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.800+0000 7feed8000700 1 --2- 172.21.15.44:0/4173624622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed01077b0 0x7feed0107bd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:10.641 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.800+0000 7feed8000700 1 -- 172.21.15.44:0/4173624622 >> 172.21.15.44:0/4173624622 conn(0x7feed01033d0 msgr2=0x7feed0105830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:10.641 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.800+0000 7feed8000700 1 -- 172.21.15.44:0/4173624622 shutdown_connections 2024-05-03T22:30:10.641 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.800+0000 7feed8000700 1 -- 172.21.15.44:0/4173624622 wait complete. 2024-05-03T22:30:10.641 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.802+0000 7feed8000700 1 Processor -- start 2024-05-03T22:30:10.642 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.802+0000 7feed8000700 1 -- start start 2024-05-03T22:30:10.642 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.802+0000 7feed8000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed01077b0 0x7feed019f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:10.642 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.802+0000 7feed8000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feed0109360 con 0x7feed01077b0 2024-05-03T22:30:10.642 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.803+0000 7feed5600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed01077b0 0x7feed019f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:10.642 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.803+0000 7feed5600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed01077b0 0x7feed019f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45580/0 (socket says 172.21.15.44:45580) 2024-05-03T22:30:10.642 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.803+0000 7feed5600700 1 -- 172.21.15.44:0/1966612318 learned_addr learned my addr 172.21.15.44:0/1966612318 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:10.642 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.803+0000 7feed5600700 1 -- 172.21.15.44:0/1966612318 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed019f6a0 con 0x7feed01077b0 2024-05-03T22:30:10.642 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.803+0000 7feed5600700 1 --2- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed01077b0 0x7feed019f160 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feec40117b0 tx=0x7feec4011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:10.642 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.804+0000 7feece000700 1 -- 172.21.15.44:0/1966612318 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feec40039e0 con 0x7feed01077b0 2024-05-03T22:30:10.642 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.804+0000 7feece000700 1 -- 172.21.15.44:0/1966612318 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7feec4003b80 con 0x7feed01077b0 2024-05-03T22:30:10.642 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.804+0000 7feed8000700 1 -- 172.21.15.44:0/1966612318 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed019f930 con 0x7feed01077b0 2024-05-03T22:30:10.642 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.804+0000 7feece000700 1 -- 172.21.15.44:0/1966612318 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feec4024760 con 0x7feed01077b0 2024-05-03T22:30:10.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.804+0000 7feed8000700 1 -- 172.21.15.44:0/1966612318 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed01a2620 con 0x7feed01077b0 2024-05-03T22:30:10.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.805+0000 7feece000700 1 -- 172.21.15.44:0/1966612318 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7feec4022020 con 0x7feed01077b0 2024-05-03T22:30:10.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.806+0000 7feece000700 1 --2- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7feeb803e4d0 0x7feeb8040990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:10.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.806+0000 7feece000700 1 -- 172.21.15.44:0/1966612318 --> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7feeb80410a0 con 0x7feeb803e4d0 2024-05-03T22:30:10.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.806+0000 7feece000700 1 -- 172.21.15.44:0/1966612318 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7feec4053740 con 0x7feed01077b0 2024-05-03T22:30:10.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.806+0000 7feed4c00700 1 -- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7feeb803e4d0 msgr2=0x7feeb8040990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1309719283 2024-05-03T22:30:10.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:02.806+0000 7feed4c00700 1 --2- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7feeb803e4d0 0x7feeb8040990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-03T22:30:10.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:03.007+0000 7feed4c00700 1 -- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7feeb803e4d0 msgr2=0x7feeb8040990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1309719283 2024-05-03T22:30:10.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:03.007+0000 7feed4c00700 1 --2- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7feeb803e4d0 0x7feeb8040990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-03T22:30:10.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:03.408+0000 7feed4c00700 1 -- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7feeb803e4d0 msgr2=0x7feeb8040990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1309719283 2024-05-03T22:30:10.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:03.408+0000 7feed4c00700 1 --2- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7feeb803e4d0 0x7feeb8040990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-03T22:30:10.643 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:04.209+0000 7feed4c00700 1 -- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7feeb803e4d0 msgr2=0x7feeb8040990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1309719283 2024-05-03T22:30:10.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:04.209+0000 7feed4c00700 1 --2- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7feeb803e4d0 0x7feeb8040990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-03T22:30:10.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:05.811+0000 7feed4c00700 1 -- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7feeb803e4d0 msgr2=0x7feeb8040990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.44:6800/1309719283 2024-05-03T22:30:10.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:05.811+0000 7feed4c00700 1 --2- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7feeb803e4d0 0x7feeb8040990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-03T22:30:10.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:08.773+0000 7feece000700 1 -- 172.21.15.44:0/1966612318 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mgrmap(e 10) ==== 50002+0+0 (secure 0 0 0) 0x7feec404d070 con 0x7feed01077b0 2024-05-03T22:30:10.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:08.773+0000 7feece000700 1 -- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7feeb803e4d0 msgr2=0x7feeb8040990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-03T22:30:10.644 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:08.773+0000 7feece000700 1 --2- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7feeb803e4d0 0x7feeb8040990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:10.645 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:09.777+0000 7feece000700 1 -- 172.21.15.44:0/1966612318 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mgrmap(e 11) ==== 50129+0+0 (secure 0 0 0) 0x7feec4055260 con 0x7feed01077b0 2024-05-03T22:30:10.645 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:09.777+0000 7feece000700 1 --2- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7feeb8041f50 0x7feeb8044340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:10.645 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:09.777+0000 7feece000700 1 -- 172.21.15.44:0/1966612318 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7feec4029e50 con 0x7feeb8041f50 2024-05-03T22:30:10.645 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:09.781+0000 7feed4c00700 1 --2- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7feeb8041f50 0x7feeb8044340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:10.645 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:09.784+0000 7feed4c00700 1 --2- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7feeb8041f50 0x7feeb8044340 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7feebc003a10 tx=0x7feebc009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:10.645 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:09.785+0000 7feece000700 1 -- 172.21.15.44:0/1966612318 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7feec4029e50 con 0x7feeb8041f50 2024-05-03T22:30:10.646 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:09.798+0000 7feed8000700 1 -- 172.21.15.44:0/1966612318 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7feed019fe10 con 0x7feeb8041f50 2024-05-03T22:30:10.646 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:09.798+0000 7feece000700 1 -- 172.21.15.44:0/1966612318 <== mgr.14152 v2:172.21.15.44:6800/1796677758 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7feed019fe10 con 0x7feeb8041f50 2024-05-03T22:30:10.646 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:09.799+0000 7feed8000700 1 -- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7feeb8041f50 msgr2=0x7feeb8044340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:10.646 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:09.799+0000 7feed8000700 1 --2- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7feeb8041f50 0x7feeb8044340 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7feebc003a10 tx=0x7feebc009270 comp rx=0 tx=0).stop 2024-05-03T22:30:10.646 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:09.799+0000 7feed8000700 1 -- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed01077b0 msgr2=0x7feed019f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:10.646 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:09.799+0000 7feed8000700 1 --2- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed01077b0 0x7feed019f160 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feec40117b0 tx=0x7feec4011940 comp rx=0 tx=0).stop 2024-05-03T22:30:10.646 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:09.799+0000 7feed8000700 1 -- 172.21.15.44:0/1966612318 shutdown_connections 2024-05-03T22:30:10.646 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:09.799+0000 7feed8000700 1 --2- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7feeb8041f50 0x7feeb8044340 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:10.646 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:09.799+0000 7feed8000700 1 --2- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feed01077b0 0x7feed019f160 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:10.646 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:09.799+0000 7feed8000700 1 --2- 172.21.15.44:0/1966612318 >> [v2:172.21.15.44:6800/1309719283,v1:172.21.15.44:6801/1309719283] conn(0x7feeb803e4d0 0x7feeb8040990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:10.646 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:09.799+0000 7feed8000700 1 -- 172.21.15.44:0/1966612318 >> 172.21.15.44:0/1966612318 conn(0x7feed01033d0 msgr2=0x7feed0195e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:10.646 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:09.799+0000 7feed8000700 1 -- 172.21.15.44:0/1966612318 shutdown_connections 2024-05-03T22:30:10.646 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:09.799+0000 7feed8000700 1 -- 172.21.15.44:0/1966612318 wait complete. 2024-05-03T22:30:10.647 INFO:teuthology.orchestra.run.smithi044.stdout:mgr epoch 9 is available 2024-05-03T22:30:10.647 INFO:teuthology.orchestra.run.smithi044.stdout:Generating a dashboard self-signed certificate... 2024-05-03T22:30:11.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:10 smithi044 ceph-mon[28604]: [03/May/2024:22:30:09] ENGINE Bus STARTING 2024-05-03T22:30:11.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:10 smithi044 ceph-mon[28604]: [03/May/2024:22:30:09] ENGINE Serving on https://172.21.15.44:7150 2024-05-03T22:30:11.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:10 smithi044 ceph-mon[28604]: [03/May/2024:22:30:09] ENGINE Serving on http://172.21.15.44:8765 2024-05-03T22:30:11.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:10 smithi044 ceph-mon[28604]: [03/May/2024:22:30:09] ENGINE Bus STARTED 2024-05-03T22:30:11.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:10 smithi044 ceph-mon[28604]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-03T22:30:11.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:10 smithi044 ceph-mon[28604]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-03T22:30:11.884 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:11 smithi044 ceph-mon[28604]: mgrmap e12: x(active, since 2s) 2024-05-03T22:30:11.884 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:11 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:12.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-03T22:30:12.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.624+0000 7f66c9a00700 1 Processor -- start 2024-05-03T22:30:12.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.624+0000 7f66c9a00700 1 -- start start 2024-05-03T22:30:12.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.625+0000 7f66c9a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66c407ee40 0x7f66c407d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:12.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.625+0000 7f66c9a00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f66c407d870 con 0x7f66c407ee40 2024-05-03T22:30:12.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.626+0000 7f66c2a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66c407ee40 0x7f66c407d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:12.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.626+0000 7f66c2a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66c407ee40 0x7f66c407d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51042/0 (socket says 172.21.15.44:51042) 2024-05-03T22:30:12.764 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.626+0000 7f66c2a00700 1 -- 172.21.15.44:0/762457700 learned_addr learned my addr 172.21.15.44:0/762457700 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:12.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.626+0000 7f66c2a00700 1 -- 172.21.15.44:0/762457700 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c407d9f0 con 0x7f66c407ee40 2024-05-03T22:30:12.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.627+0000 7f66c2a00700 1 --2- 172.21.15.44:0/762457700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66c407ee40 0x7f66c407d2a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f66b40098a0 tx=0x7f66b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9dd58d8de757528 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:12.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.627+0000 7f66c1600700 1 -- 172.21.15.44:0/762457700 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66b4004160 con 0x7f66c407ee40 2024-05-03T22:30:12.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.627+0000 7f66c1600700 1 -- 172.21.15.44:0/762457700 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f66b4004300 con 0x7f66c407ee40 2024-05-03T22:30:12.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.627+0000 7f66c1600700 1 -- 172.21.15.44:0/762457700 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66b4011af0 con 0x7f66c407ee40 2024-05-03T22:30:12.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.628+0000 7f66c9a00700 1 -- 172.21.15.44:0/762457700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66c407ee40 msgr2=0x7f66c407d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:12.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.628+0000 7f66c9a00700 1 --2- 172.21.15.44:0/762457700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66c407ee40 0x7f66c407d2a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f66b40098a0 tx=0x7f66b4009bb0 comp rx=0 tx=0).stop 2024-05-03T22:30:12.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.628+0000 7f66c9a00700 1 -- 172.21.15.44:0/762457700 shutdown_connections 2024-05-03T22:30:12.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.628+0000 7f66c9a00700 1 --2- 172.21.15.44:0/762457700 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66c407ee40 0x7f66c407d2a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:12.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.628+0000 7f66c9a00700 1 -- 172.21.15.44:0/762457700 >> 172.21.15.44:0/762457700 conn(0x7f66c41044a0 msgr2=0x7f66c41068e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:12.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.628+0000 7f66c9a00700 1 -- 172.21.15.44:0/762457700 shutdown_connections 2024-05-03T22:30:12.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.628+0000 7f66c9a00700 1 -- 172.21.15.44:0/762457700 wait complete. 2024-05-03T22:30:12.765 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.629+0000 7f66c9a00700 1 Processor -- start 2024-05-03T22:30:12.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.630+0000 7f66c9a00700 1 -- start start 2024-05-03T22:30:12.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.630+0000 7f66c9a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66c407ee40 0x7f66c419f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:12.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.630+0000 7f66c9a00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f66c410f540 con 0x7f66c407ee40 2024-05-03T22:30:12.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.630+0000 7f66c2a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66c407ee40 0x7f66c419f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:12.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.630+0000 7f66c2a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66c407ee40 0x7f66c419f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51044/0 (socket says 172.21.15.44:51044) 2024-05-03T22:30:12.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.630+0000 7f66c2a00700 1 -- 172.21.15.44:0/527668511 learned_addr learned my addr 172.21.15.44:0/527668511 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:12.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.631+0000 7f66c2a00700 1 -- 172.21.15.44:0/527668511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c419f610 con 0x7f66c407ee40 2024-05-03T22:30:12.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.631+0000 7f66c2a00700 1 --2- 172.21.15.44:0/527668511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66c407ee40 0x7f66c419f0d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f66b4011ac0 tx=0x7f66b4011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:12.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.631+0000 7f66bb400700 1 -- 172.21.15.44:0/527668511 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66b4003b20 con 0x7f66c407ee40 2024-05-03T22:30:12.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.631+0000 7f66bb400700 1 -- 172.21.15.44:0/527668511 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f66b401a900 con 0x7f66c407ee40 2024-05-03T22:30:12.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.631+0000 7f66c9a00700 1 -- 172.21.15.44:0/527668511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c419f8a0 con 0x7f66c407ee40 2024-05-03T22:30:12.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.631+0000 7f66bb400700 1 -- 172.21.15.44:0/527668511 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66b40248e0 con 0x7f66c407ee40 2024-05-03T22:30:12.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.632+0000 7f66c9a00700 1 -- 172.21.15.44:0/527668511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c41a2590 con 0x7f66c407ee40 2024-05-03T22:30:12.766 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.633+0000 7f66c9a00700 1 -- 172.21.15.44:0/527668511 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c4064b00 con 0x7f66c407ee40 2024-05-03T22:30:12.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.633+0000 7f66bb400700 1 -- 172.21.15.44:0/527668511 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f66b4022020 con 0x7f66c407ee40 2024-05-03T22:30:12.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.634+0000 7f66bb400700 1 --2- 172.21.15.44:0/527668511 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f66a803e4c0 0x7f66a8040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:12.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.634+0000 7f66bb400700 1 -- 172.21.15.44:0/527668511 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f66b4053b00 con 0x7f66c407ee40 2024-05-03T22:30:12.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.634+0000 7f66c2000700 1 --2- 172.21.15.44:0/527668511 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f66a803e4c0 0x7f66a8040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:12.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.635+0000 7f66c2000700 1 --2- 172.21.15.44:0/527668511 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f66a803e4c0 0x7f66a8040980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f66b0006fd0 tx=0x7f66b0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:12.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.639+0000 7f66bb400700 1 -- 172.21.15.44:0/527668511 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f66b40172b0 con 0x7f66c407ee40 2024-05-03T22:30:12.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:11.882+0000 7f66c9a00700 1 -- 172.21.15.44:0/527668511 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f66c4105800 con 0x7f66a803e4c0 2024-05-03T22:30:12.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:12.053+0000 7f66bb400700 1 -- 172.21.15.44:0/527668511 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f66c4105800 con 0x7f66a803e4c0 2024-05-03T22:30:12.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:12.057+0000 7f66c9a00700 1 -- 172.21.15.44:0/527668511 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f66a803e4c0 msgr2=0x7f66a8040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:12.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:12.057+0000 7f66c9a00700 1 --2- 172.21.15.44:0/527668511 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f66a803e4c0 0x7f66a8040980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f66b0006fd0 tx=0x7f66b0006e40 comp rx=0 tx=0).stop 2024-05-03T22:30:12.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:12.057+0000 7f66c9a00700 1 -- 172.21.15.44:0/527668511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66c407ee40 msgr2=0x7f66c419f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:12.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:12.057+0000 7f66c9a00700 1 --2- 172.21.15.44:0/527668511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66c407ee40 0x7f66c419f0d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f66b4011ac0 tx=0x7f66b4011ba0 comp rx=0 tx=0).stop 2024-05-03T22:30:12.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:12.057+0000 7f66c9a00700 1 -- 172.21.15.44:0/527668511 shutdown_connections 2024-05-03T22:30:12.767 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:12.057+0000 7f66c9a00700 1 --2- 172.21.15.44:0/527668511 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f66a803e4c0 0x7f66a8040980 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:12.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:12.057+0000 7f66c9a00700 1 --2- 172.21.15.44:0/527668511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f66c407ee40 0x7f66c419f0d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:12.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:12.057+0000 7f66c9a00700 1 -- 172.21.15.44:0/527668511 >> 172.21.15.44:0/527668511 conn(0x7f66c41044a0 msgr2=0x7f66c41050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:12.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:12.057+0000 7f66c9a00700 1 -- 172.21.15.44:0/527668511 shutdown_connections 2024-05-03T22:30:12.768 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:12.057+0000 7f66c9a00700 1 -- 172.21.15.44:0/527668511 wait complete. 2024-05-03T22:30:12.768 INFO:teuthology.orchestra.run.smithi044.stdout:Creating initial admin user... 2024-05-03T22:30:13.357 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:13 smithi044 ceph-mon[28604]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:30:13.357 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:13 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:13.357 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:13 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:14.573 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$nPapc9A51VaimhxMH..in.NdVz5nc5oKVMQcaPnCKX7yNwzOHuExG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1714775413, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-03T22:30:14.574 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.353+0000 7f9a84e00700 1 Processor -- start 2024-05-03T22:30:14.574 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.353+0000 7f9a84e00700 1 -- start start 2024-05-03T22:30:14.574 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.354+0000 7f9a84e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a80109790 0x7f9a8010bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:14.574 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.354+0000 7f9a84e00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8007ce90 con 0x7f9a80109790 2024-05-03T22:30:14.574 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.354+0000 7f9a7f400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a80109790 0x7f9a8010bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:14.574 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.354+0000 7f9a7f400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a80109790 0x7f9a8010bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51050/0 (socket says 172.21.15.44:51050) 2024-05-03T22:30:14.577 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.354+0000 7f9a7f400700 1 -- 172.21.15.44:0/29586755 learned_addr learned my addr 172.21.15.44:0/29586755 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:14.577 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.355+0000 7f9a7f400700 1 -- 172.21.15.44:0/29586755 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8010c0c0 con 0x7f9a80109790 2024-05-03T22:30:14.577 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.355+0000 7f9a7f400700 1 --2- 172.21.15.44:0/29586755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a80109790 0x7f9a8010bb80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a700098a0 tx=0x7f9a70009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652ec561ae87a2b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:14.577 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.355+0000 7f9a7e000700 1 -- 172.21.15.44:0/29586755 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a70004160 con 0x7f9a80109790 2024-05-03T22:30:14.577 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.356+0000 7f9a7e000700 1 -- 172.21.15.44:0/29586755 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f9a70004300 con 0x7f9a80109790 2024-05-03T22:30:14.577 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.356+0000 7f9a7e000700 1 -- 172.21.15.44:0/29586755 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a70011af0 con 0x7f9a80109790 2024-05-03T22:30:14.577 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.356+0000 7f9a84e00700 1 -- 172.21.15.44:0/29586755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a80109790 msgr2=0x7f9a8010bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:14.577 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.356+0000 7f9a84e00700 1 --2- 172.21.15.44:0/29586755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a80109790 0x7f9a8010bb80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9a700098a0 tx=0x7f9a70009bb0 comp rx=0 tx=0).stop 2024-05-03T22:30:14.577 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.357+0000 7f9a84e00700 1 -- 172.21.15.44:0/29586755 shutdown_connections 2024-05-03T22:30:14.577 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.357+0000 7f9a84e00700 1 --2- 172.21.15.44:0/29586755 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a80109790 0x7f9a8010bb80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:14.577 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.357+0000 7f9a84e00700 1 -- 172.21.15.44:0/29586755 >> 172.21.15.44:0/29586755 conn(0x7f9a801031e0 msgr2=0x7f9a80105600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:14.577 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.357+0000 7f9a84e00700 1 -- 172.21.15.44:0/29586755 shutdown_connections 2024-05-03T22:30:14.577 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.357+0000 7f9a84e00700 1 -- 172.21.15.44:0/29586755 wait complete. 2024-05-03T22:30:14.578 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.358+0000 7f9a84e00700 1 Processor -- start 2024-05-03T22:30:14.578 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.358+0000 7f9a84e00700 1 -- start start 2024-05-03T22:30:14.578 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.359+0000 7f9a84e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a80109790 0x7f9a80109010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:14.578 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.359+0000 7f9a84e00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8010d130 con 0x7f9a80109790 2024-05-03T22:30:14.578 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.359+0000 7f9a7f400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a80109790 0x7f9a80109010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:14.578 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.359+0000 7f9a7f400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a80109790 0x7f9a80109010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51060/0 (socket says 172.21.15.44:51060) 2024-05-03T22:30:14.578 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.359+0000 7f9a7f400700 1 -- 172.21.15.44:0/1549648515 learned_addr learned my addr 172.21.15.44:0/1549648515 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:14.578 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.359+0000 7f9a7f400700 1 -- 172.21.15.44:0/1549648515 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a80109550 con 0x7f9a80109790 2024-05-03T22:30:14.578 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.360+0000 7f9a7f400700 1 --2- 172.21.15.44:0/1549648515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a80109790 0x7f9a80109010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a70011ac0 tx=0x7f9a70011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:14.583 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.360+0000 7f9a77e00700 1 -- 172.21.15.44:0/1549648515 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a70003b20 con 0x7f9a80109790 2024-05-03T22:30:14.583 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.360+0000 7f9a77e00700 1 -- 172.21.15.44:0/1549648515 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f9a7001a900 con 0x7f9a80109790 2024-05-03T22:30:14.583 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.360+0000 7f9a77e00700 1 -- 172.21.15.44:0/1549648515 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a700248e0 con 0x7f9a80109790 2024-05-03T22:30:14.583 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.360+0000 7f9a84e00700 1 -- 172.21.15.44:0/1549648515 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a80107740 con 0x7f9a80109790 2024-05-03T22:30:14.583 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.360+0000 7f9a84e00700 1 -- 172.21.15.44:0/1549648515 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a80107c80 con 0x7f9a80109790 2024-05-03T22:30:14.583 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.361+0000 7f9a84e00700 1 -- 172.21.15.44:0/1549648515 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a80064b00 con 0x7f9a80109790 2024-05-03T22:30:14.583 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.361+0000 7f9a77e00700 1 -- 172.21.15.44:0/1549648515 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f9a70022020 con 0x7f9a80109790 2024-05-03T22:30:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.362+0000 7f9a77e00700 1 --2- 172.21.15.44:0/1549648515 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9a6403e4c0 0x7f9a64040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.362+0000 7f9a77e00700 1 -- 172.21.15.44:0/1549648515 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9a70053a30 con 0x7f9a80109790 2024-05-03T22:30:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.362+0000 7f9a7ea00700 1 --2- 172.21.15.44:0/1549648515 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9a6403e4c0 0x7f9a64040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.363+0000 7f9a7ea00700 1 --2- 172.21.15.44:0/1549648515 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9a6403e4c0 0x7f9a64040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c006fd0 tx=0x7f9a6c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.368+0000 7f9a77e00700 1 -- 172.21.15.44:0/1549648515 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f9a7000fdd0 con 0x7f9a80109790 2024-05-03T22:30:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.641+0000 7f9a84e00700 1 -- 172.21.15.44:0/1549648515 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f9a80108420 con 0x7f9a6403e4c0 2024-05-03T22:30:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.894+0000 7f9a77e00700 1 -- 172.21.15.44:0/1549648515 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f9a80108420 con 0x7f9a6403e4c0 2024-05-03T22:30:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.898+0000 7f9a84e00700 1 -- 172.21.15.44:0/1549648515 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9a6403e4c0 msgr2=0x7f9a64040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.898+0000 7f9a84e00700 1 --2- 172.21.15.44:0/1549648515 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9a6403e4c0 0x7f9a64040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c006fd0 tx=0x7f9a6c006e40 comp rx=0 tx=0).stop 2024-05-03T22:30:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.898+0000 7f9a84e00700 1 -- 172.21.15.44:0/1549648515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a80109790 msgr2=0x7f9a80109010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.898+0000 7f9a84e00700 1 --2- 172.21.15.44:0/1549648515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a80109790 0x7f9a80109010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a70011ac0 tx=0x7f9a70011ba0 comp rx=0 tx=0).stop 2024-05-03T22:30:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.899+0000 7f9a84e00700 1 -- 172.21.15.44:0/1549648515 shutdown_connections 2024-05-03T22:30:14.584 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.899+0000 7f9a84e00700 1 --2- 172.21.15.44:0/1549648515 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9a6403e4c0 0x7f9a64040980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:14.585 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.899+0000 7f9a84e00700 1 --2- 172.21.15.44:0/1549648515 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9a80109790 0x7f9a80109010 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:14.585 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.899+0000 7f9a84e00700 1 -- 172.21.15.44:0/1549648515 >> 172.21.15.44:0/1549648515 conn(0x7f9a801031e0 msgr2=0x7f9a80103dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:14.585 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.899+0000 7f9a84e00700 1 -- 172.21.15.44:0/1549648515 shutdown_connections 2024-05-03T22:30:14.585 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:13.899+0000 7f9a84e00700 1 -- 172.21.15.44:0/1549648515 wait complete. 2024-05-03T22:30:14.585 INFO:teuthology.orchestra.run.smithi044.stdout:Fetching dashboard port number... 2024-05-03T22:30:14.888 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:14 smithi044 ceph-mon[28604]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:30:14.888 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:14 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:14.888 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:14 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:15.963 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:15 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1157167372' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-03T22:30:16.310 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stdout 8443 2024-05-03T22:30:16.310 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.362+0000 7f8b67200700 1 Processor -- start 2024-05-03T22:30:16.310 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.362+0000 7f8b67200700 1 -- start start 2024-05-03T22:30:16.310 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.363+0000 7f8b67200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b6010b130 0x7f8b6010b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:16.310 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.363+0000 7f8b67200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6010bb20 con 0x7f8b6010b130 2024-05-03T22:30:16.310 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.363+0000 7f8b5fe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b6010b130 0x7f8b6010b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:16.311 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.363+0000 7f8b5fe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b6010b130 0x7f8b6010b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51066/0 (socket says 172.21.15.44:51066) 2024-05-03T22:30:16.311 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.363+0000 7f8b5fe00700 1 -- 172.21.15.44:0/3259709990 learned_addr learned my addr 172.21.15.44:0/3259709990 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:16.311 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.364+0000 7f8b5fe00700 1 -- 172.21.15.44:0/3259709990 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6010c330 con 0x7f8b6010b130 2024-05-03T22:30:16.311 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.364+0000 7f8b5fe00700 1 --2- 172.21.15.44:0/3259709990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b6010b130 0x7f8b6010b550 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8b500098a0 tx=0x7f8b50009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07c1b4685d7b819 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:16.311 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.364+0000 7f8b5ea00700 1 -- 172.21.15.44:0/3259709990 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b50004160 con 0x7f8b6010b130 2024-05-03T22:30:16.311 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.364+0000 7f8b5ea00700 1 -- 172.21.15.44:0/3259709990 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f8b50004300 con 0x7f8b6010b130 2024-05-03T22:30:16.311 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.364+0000 7f8b5ea00700 1 -- 172.21.15.44:0/3259709990 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b50011af0 con 0x7f8b6010b130 2024-05-03T22:30:16.311 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.365+0000 7f8b67200700 1 -- 172.21.15.44:0/3259709990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b6010b130 msgr2=0x7f8b6010b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:16.311 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.365+0000 7f8b67200700 1 --2- 172.21.15.44:0/3259709990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b6010b130 0x7f8b6010b550 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8b500098a0 tx=0x7f8b50009bb0 comp rx=0 tx=0).stop 2024-05-03T22:30:16.311 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.365+0000 7f8b67200700 1 -- 172.21.15.44:0/3259709990 shutdown_connections 2024-05-03T22:30:16.311 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.365+0000 7f8b67200700 1 --2- 172.21.15.44:0/3259709990 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b6010b130 0x7f8b6010b550 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:16.311 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.365+0000 7f8b67200700 1 -- 172.21.15.44:0/3259709990 >> 172.21.15.44:0/3259709990 conn(0x7f8b6007e520 msgr2=0x7f8b6007e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:16.311 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.365+0000 7f8b67200700 1 -- 172.21.15.44:0/3259709990 shutdown_connections 2024-05-03T22:30:16.311 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.366+0000 7f8b67200700 1 -- 172.21.15.44:0/3259709990 wait complete. 2024-05-03T22:30:16.312 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.367+0000 7f8b67200700 1 Processor -- start 2024-05-03T22:30:16.312 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.367+0000 7f8b67200700 1 -- start start 2024-05-03T22:30:16.312 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.367+0000 7f8b67200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b6010b130 0x7f8b6019f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:16.312 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.367+0000 7f8b67200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6010f6e0 con 0x7f8b6010b130 2024-05-03T22:30:16.312 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.368+0000 7f8b5fe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b6010b130 0x7f8b6019f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:16.312 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.368+0000 7f8b5fe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b6010b130 0x7f8b6019f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51082/0 (socket says 172.21.15.44:51082) 2024-05-03T22:30:16.312 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.368+0000 7f8b5fe00700 1 -- 172.21.15.44:0/1157167372 learned_addr learned my addr 172.21.15.44:0/1157167372 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:16.312 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.368+0000 7f8b5fe00700 1 -- 172.21.15.44:0/1157167372 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b6019f670 con 0x7f8b6010b130 2024-05-03T22:30:16.315 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.368+0000 7f8b5fe00700 1 --2- 172.21.15.44:0/1157167372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b6010b130 0x7f8b6019f130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8b50000c00 tx=0x7f8b50011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:16.315 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.369+0000 7f8b5cc00700 1 -- 172.21.15.44:0/1157167372 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b50003b20 con 0x7f8b6010b130 2024-05-03T22:30:16.315 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.369+0000 7f8b5cc00700 1 -- 172.21.15.44:0/1157167372 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f8b5001a900 con 0x7f8b6010b130 2024-05-03T22:30:16.315 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.369+0000 7f8b67200700 1 -- 172.21.15.44:0/1157167372 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6019f900 con 0x7f8b6010b130 2024-05-03T22:30:16.315 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.369+0000 7f8b5cc00700 1 -- 172.21.15.44:0/1157167372 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b500249c0 con 0x7f8b6010b130 2024-05-03T22:30:16.315 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.369+0000 7f8b67200700 1 -- 172.21.15.44:0/1157167372 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b601a25f0 con 0x7f8b6010b130 2024-05-03T22:30:16.315 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.370+0000 7f8b5cc00700 1 -- 172.21.15.44:0/1157167372 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f8b50022020 con 0x7f8b6010b130 2024-05-03T22:30:16.315 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.370+0000 7f8b67200700 1 -- 172.21.15.44:0/1157167372 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b60064b00 con 0x7f8b6010b130 2024-05-03T22:30:16.315 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.370+0000 7f8b5cc00700 1 --2- 172.21.15.44:0/1157167372 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8b4403e520 0x7f8b440409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:16.315 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.371+0000 7f8b5cc00700 1 -- 172.21.15.44:0/1157167372 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8b500538c0 con 0x7f8b6010b130 2024-05-03T22:30:16.315 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.371+0000 7f8b5f400700 1 --2- 172.21.15.44:0/1157167372 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8b4403e520 0x7f8b440409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:16.316 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.371+0000 7f8b5f400700 1 --2- 172.21.15.44:0/1157167372 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8b4403e520 0x7f8b440409e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c006fd0 tx=0x7f8b4c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:16.316 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.376+0000 7f8b5cc00700 1 -- 172.21.15.44:0/1157167372 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8b5000e260 con 0x7f8b6010b130 2024-05-03T22:30:16.316 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.614+0000 7f8b67200700 1 -- 172.21.15.44:0/1157167372 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f8b601a2ba0 con 0x7f8b6010b130 2024-05-03T22:30:16.316 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.615+0000 7f8b5cc00700 1 -- 172.21.15.44:0/1157167372 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f8b5002dc90 con 0x7f8b6010b130 2024-05-03T22:30:16.316 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.618+0000 7f8b67200700 1 -- 172.21.15.44:0/1157167372 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8b4403e520 msgr2=0x7f8b440409e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:16.316 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.618+0000 7f8b67200700 1 --2- 172.21.15.44:0/1157167372 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8b4403e520 0x7f8b440409e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c006fd0 tx=0x7f8b4c006e40 comp rx=0 tx=0).stop 2024-05-03T22:30:16.316 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.618+0000 7f8b67200700 1 -- 172.21.15.44:0/1157167372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b6010b130 msgr2=0x7f8b6019f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:16.316 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.618+0000 7f8b67200700 1 --2- 172.21.15.44:0/1157167372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b6010b130 0x7f8b6019f130 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8b50000c00 tx=0x7f8b50011b70 comp rx=0 tx=0).stop 2024-05-03T22:30:16.316 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.618+0000 7f8b67200700 1 -- 172.21.15.44:0/1157167372 shutdown_connections 2024-05-03T22:30:16.316 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.618+0000 7f8b67200700 1 --2- 172.21.15.44:0/1157167372 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8b4403e520 0x7f8b440409e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:16.316 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.618+0000 7f8b67200700 1 --2- 172.21.15.44:0/1157167372 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b6010b130 0x7f8b6019f130 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:16.316 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.618+0000 7f8b67200700 1 -- 172.21.15.44:0/1157167372 >> 172.21.15.44:0/1157167372 conn(0x7f8b6007e520 msgr2=0x7f8b60108e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:16.316 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.618+0000 7f8b67200700 1 -- 172.21.15.44:0/1157167372 shutdown_connections 2024-05-03T22:30:16.316 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:15.618+0000 7f8b67200700 1 -- 172.21.15.44:0/1157167372 wait complete. 2024-05-03T22:30:16.339 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-03T22:30:16.339 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout disabled 2024-05-03T22:30:16.358 INFO:teuthology.orchestra.run.smithi044.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-03T22:30:16.358 INFO:teuthology.orchestra.run.smithi044.stdout:systemctl: stdout inactive 2024-05-03T22:30:16.358 INFO:teuthology.orchestra.run.smithi044.stdout:firewalld.service is not enabled 2024-05-03T22:30:16.359 INFO:teuthology.orchestra.run.smithi044.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-03T22:30:16.362 INFO:teuthology.orchestra.run.smithi044.stdout:Ceph Dashboard is now available at: 2024-05-03T22:30:16.363 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:30:16.363 INFO:teuthology.orchestra.run.smithi044.stdout: URL: https://smithi044.front.sepia.ceph.com:8443/ 2024-05-03T22:30:16.363 INFO:teuthology.orchestra.run.smithi044.stdout: User: admin 2024-05-03T22:30:16.363 INFO:teuthology.orchestra.run.smithi044.stdout: Password: 5atef5oz2v 2024-05-03T22:30:16.363 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:30:16.363 INFO:teuthology.orchestra.run.smithi044.stdout:Saving cluster configuration to /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config directory 2024-05-03T22:30:16.364 INFO:teuthology.orchestra.run.smithi044.stdout:Enabling autotune for osd_memory_target 2024-05-03T22:30:17.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:16 smithi044 ceph-mon[28604]: mgrmap e13: x(active, since 6s) 2024-05-03T22:30:18.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.326+0000 7fb5b5000700 1 Processor -- start 2024-05-03T22:30:18.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.327+0000 7fb5b5000700 1 -- start start 2024-05-03T22:30:18.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.327+0000 7fb5b5000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b007eea0 0x7fb5b007d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:18.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.327+0000 7fb5b5000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b007d8d0 con 0x7fb5b007eea0 2024-05-03T22:30:18.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.328+0000 7fb5ade00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b007eea0 0x7fb5b007d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:18.220 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.328+0000 7fb5ade00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b007eea0 0x7fb5b007d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51092/0 (socket says 172.21.15.44:51092) 2024-05-03T22:30:18.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.328+0000 7fb5ade00700 1 -- 172.21.15.44:0/3904259393 learned_addr learned my addr 172.21.15.44:0/3904259393 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:18.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.328+0000 7fb5ade00700 1 -- 172.21.15.44:0/3904259393 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b007da50 con 0x7fb5b007eea0 2024-05-03T22:30:18.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.328+0000 7fb5ade00700 1 --2- 172.21.15.44:0/3904259393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b007eea0 0x7fb5b007d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00098a0 tx=0x7fb5a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8873f592c8314b5b server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:18.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.329+0000 7fb5aca00700 1 -- 172.21.15.44:0/3904259393 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5a0004160 con 0x7fb5b007eea0 2024-05-03T22:30:18.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.329+0000 7fb5aca00700 1 -- 172.21.15.44:0/3904259393 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fb5a0004300 con 0x7fb5b007eea0 2024-05-03T22:30:18.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.329+0000 7fb5aca00700 1 -- 172.21.15.44:0/3904259393 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5a0011af0 con 0x7fb5b007eea0 2024-05-03T22:30:18.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.329+0000 7fb5b5000700 1 -- 172.21.15.44:0/3904259393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b007eea0 msgr2=0x7fb5b007d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:18.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.329+0000 7fb5b5000700 1 --2- 172.21.15.44:0/3904259393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b007eea0 0x7fb5b007d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb5a00098a0 tx=0x7fb5a0009bb0 comp rx=0 tx=0).stop 2024-05-03T22:30:18.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.330+0000 7fb5b5000700 1 -- 172.21.15.44:0/3904259393 shutdown_connections 2024-05-03T22:30:18.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.330+0000 7fb5b5000700 1 --2- 172.21.15.44:0/3904259393 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b007eea0 0x7fb5b007d300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:18.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.330+0000 7fb5b5000700 1 -- 172.21.15.44:0/3904259393 >> 172.21.15.44:0/3904259393 conn(0x7fb5b01044a0 msgr2=0x7fb5b01068e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:18.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.330+0000 7fb5b5000700 1 -- 172.21.15.44:0/3904259393 shutdown_connections 2024-05-03T22:30:18.221 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.330+0000 7fb5b5000700 1 -- 172.21.15.44:0/3904259393 wait complete. 2024-05-03T22:30:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.331+0000 7fb5b5000700 1 Processor -- start 2024-05-03T22:30:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.331+0000 7fb5b5000700 1 -- start start 2024-05-03T22:30:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.331+0000 7fb5b5000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b007eea0 0x7fb5b019f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.331+0000 7fb5b5000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b010f540 con 0x7fb5b007eea0 2024-05-03T22:30:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.332+0000 7fb5ade00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b007eea0 0x7fb5b019f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.332+0000 7fb5ade00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b007eea0 0x7fb5b019f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51098/0 (socket says 172.21.15.44:51098) 2024-05-03T22:30:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.332+0000 7fb5ade00700 1 -- 172.21.15.44:0/1193820191 learned_addr learned my addr 172.21.15.44:0/1193820191 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.332+0000 7fb5ade00700 1 -- 172.21.15.44:0/1193820191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b019f620 con 0x7fb5b007eea0 2024-05-03T22:30:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.332+0000 7fb5ade00700 1 --2- 172.21.15.44:0/1193820191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b007eea0 0x7fb5b019f0e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0000c00 tx=0x7fb5a0011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.333+0000 7fb5a6a00700 1 -- 172.21.15.44:0/1193820191 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5a0003b20 con 0x7fb5b007eea0 2024-05-03T22:30:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.333+0000 7fb5a6a00700 1 -- 172.21.15.44:0/1193820191 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fb5a001a900 con 0x7fb5b007eea0 2024-05-03T22:30:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.333+0000 7fb5a6a00700 1 -- 172.21.15.44:0/1193820191 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5a00249c0 con 0x7fb5b007eea0 2024-05-03T22:30:18.222 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.333+0000 7fb5b5000700 1 -- 172.21.15.44:0/1193820191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b019f8b0 con 0x7fb5b007eea0 2024-05-03T22:30:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.333+0000 7fb5b5000700 1 -- 172.21.15.44:0/1193820191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b01a25a0 con 0x7fb5b007eea0 2024-05-03T22:30:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.334+0000 7fb5b5000700 1 -- 172.21.15.44:0/1193820191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5b0064b00 con 0x7fb5b007eea0 2024-05-03T22:30:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.334+0000 7fb5a6a00700 1 -- 172.21.15.44:0/1193820191 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fb5a0022020 con 0x7fb5b007eea0 2024-05-03T22:30:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.335+0000 7fb5a6a00700 1 --2- 172.21.15.44:0/1193820191 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb59403e5c0 0x7fb594040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.335+0000 7fb5a6a00700 1 -- 172.21.15.44:0/1193820191 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fb5a00539a0 con 0x7fb5b007eea0 2024-05-03T22:30:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.335+0000 7fb5ad400700 1 --2- 172.21.15.44:0/1193820191 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb59403e5c0 0x7fb594040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.336+0000 7fb5ad400700 1 --2- 172.21.15.44:0/1193820191 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb59403e5c0 0x7fb594040a80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb59c006fd0 tx=0x7fb59c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.341+0000 7fb5a6a00700 1 -- 172.21.15.44:0/1193820191 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb5a00212c0 con 0x7fb5b007eea0 2024-05-03T22:30:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.578+0000 7fb5b5000700 1 -- 172.21.15.44:0/1193820191 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7fb5b01a2770 con 0x7fb5b007eea0 2024-05-03T22:30:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.579+0000 7fb5a6a00700 1 -- 172.21.15.44:0/1193820191 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7fb5a001aab0 con 0x7fb5b007eea0 2024-05-03T22:30:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.582+0000 7fb5b5000700 1 -- 172.21.15.44:0/1193820191 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb59403e5c0 msgr2=0x7fb594040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.582+0000 7fb5b5000700 1 --2- 172.21.15.44:0/1193820191 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb59403e5c0 0x7fb594040a80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb59c006fd0 tx=0x7fb59c006e40 comp rx=0 tx=0).stop 2024-05-03T22:30:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.582+0000 7fb5b5000700 1 -- 172.21.15.44:0/1193820191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b007eea0 msgr2=0x7fb5b019f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:18.223 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.582+0000 7fb5b5000700 1 --2- 172.21.15.44:0/1193820191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b007eea0 0x7fb5b019f0e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0000c00 tx=0x7fb5a0011b70 comp rx=0 tx=0).stop 2024-05-03T22:30:18.224 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.582+0000 7fb5b5000700 1 -- 172.21.15.44:0/1193820191 shutdown_connections 2024-05-03T22:30:18.224 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.582+0000 7fb5b5000700 1 --2- 172.21.15.44:0/1193820191 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb59403e5c0 0x7fb594040a80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:18.224 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.582+0000 7fb5b5000700 1 --2- 172.21.15.44:0/1193820191 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb5b007eea0 0x7fb5b019f0e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:18.224 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.582+0000 7fb5b5000700 1 -- 172.21.15.44:0/1193820191 >> 172.21.15.44:0/1193820191 conn(0x7fb5b01044a0 msgr2=0x7fb5b0105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:18.224 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.583+0000 7fb5b5000700 1 -- 172.21.15.44:0/1193820191 shutdown_connections 2024-05-03T22:30:18.224 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:17.583+0000 7fb5b5000700 1 -- 172.21.15.44:0/1193820191 wait complete. 2024-05-03T22:30:19.928 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.847+0000 7f8934200700 1 Processor -- start 2024-05-03T22:30:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.847+0000 7f8934200700 1 -- start start 2024-05-03T22:30:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.847+0000 7f8934200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f892c07fed0 0x7f892c0802f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.848+0000 7f8934200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f892c0808c0 con 0x7f892c07fed0 2024-05-03T22:30:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.848+0000 7f8931800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f892c07fed0 0x7f892c0802f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.848+0000 7f8931800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f892c07fed0 0x7f892c0802f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51110/0 (socket says 172.21.15.44:51110) 2024-05-03T22:30:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.848+0000 7f8931800700 1 -- 172.21.15.44:0/3525407081 learned_addr learned my addr 172.21.15.44:0/3525407081 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.849+0000 7f8931800700 1 -- 172.21.15.44:0/3525407081 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892c081120 con 0x7f892c07fed0 2024-05-03T22:30:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.849+0000 7f8931800700 1 --2- 172.21.15.44:0/3525407081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f892c07fed0 0x7f892c0802f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8920009e80 tx=0x7f892000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f76ead6b2c2442 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.849+0000 7f892be00700 1 -- 172.21.15.44:0/3525407081 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8920017070 con 0x7f892c07fed0 2024-05-03T22:30:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.849+0000 7f892be00700 1 -- 172.21.15.44:0/3525407081 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f892000b8c0 con 0x7f892c07fed0 2024-05-03T22:30:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.849+0000 7f892be00700 1 -- 172.21.15.44:0/3525407081 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8920004500 con 0x7f892c07fed0 2024-05-03T22:30:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.850+0000 7f8934200700 1 -- 172.21.15.44:0/3525407081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f892c07fed0 msgr2=0x7f892c0802f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.850+0000 7f8934200700 1 --2- 172.21.15.44:0/3525407081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f892c07fed0 0x7f892c0802f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8920009e80 tx=0x7f892000b330 comp rx=0 tx=0).stop 2024-05-03T22:30:19.929 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.850+0000 7f8934200700 1 -- 172.21.15.44:0/3525407081 shutdown_connections 2024-05-03T22:30:19.933 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.850+0000 7f8934200700 1 --2- 172.21.15.44:0/3525407081 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f892c07fed0 0x7f892c0802f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:19.933 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.850+0000 7f8934200700 1 -- 172.21.15.44:0/3525407081 >> 172.21.15.44:0/3525407081 conn(0x7f892c07e6a0 msgr2=0x7f892c07ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:19.933 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.850+0000 7f8934200700 1 -- 172.21.15.44:0/3525407081 shutdown_connections 2024-05-03T22:30:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.851+0000 7f8934200700 1 -- 172.21.15.44:0/3525407081 wait complete. 2024-05-03T22:30:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.852+0000 7f8934200700 1 Processor -- start 2024-05-03T22:30:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.852+0000 7f8934200700 1 -- start start 2024-05-03T22:30:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.852+0000 7f8934200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f892c07fed0 0x7f892c1a3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.852+0000 7f8934200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f892c0824e0 con 0x7f892c07fed0 2024-05-03T22:30:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.852+0000 7f8931800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f892c07fed0 0x7f892c1a3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.852+0000 7f8931800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f892c07fed0 0x7f892c1a3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51116/0 (socket says 172.21.15.44:51116) 2024-05-03T22:30:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.852+0000 7f8931800700 1 -- 172.21.15.44:0/2138889544 learned_addr learned my addr 172.21.15.44:0/2138889544 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.853+0000 7f8931800700 1 -- 172.21.15.44:0/2138889544 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892c1a39a0 con 0x7f892c07fed0 2024-05-03T22:30:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.853+0000 7f8931800700 1 --2- 172.21.15.44:0/2138889544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f892c07fed0 0x7f892c1a3460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f89200072a0 tx=0x7f892000bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.854+0000 7f892a000700 1 -- 172.21.15.44:0/2138889544 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8920021020 con 0x7f892c07fed0 2024-05-03T22:30:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.854+0000 7f892a000700 1 -- 172.21.15.44:0/2138889544 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f892001d470 con 0x7f892c07fed0 2024-05-03T22:30:19.934 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.854+0000 7f892a000700 1 -- 172.21.15.44:0/2138889544 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8920017040 con 0x7f892c07fed0 2024-05-03T22:30:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.854+0000 7f8934200700 1 -- 172.21.15.44:0/2138889544 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f892c1a3c30 con 0x7f892c07fed0 2024-05-03T22:30:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.854+0000 7f8934200700 1 -- 172.21.15.44:0/2138889544 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f892c1a6920 con 0x7f892c07fed0 2024-05-03T22:30:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.855+0000 7f8934200700 1 -- 172.21.15.44:0/2138889544 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f892c064b00 con 0x7f892c07fed0 2024-05-03T22:30:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.855+0000 7f892a000700 1 -- 172.21.15.44:0/2138889544 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f8920024020 con 0x7f892c07fed0 2024-05-03T22:30:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.856+0000 7f892a000700 1 --2- 172.21.15.44:0/2138889544 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f891403e570 0x7f8914040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.856+0000 7f892a000700 1 -- 172.21.15.44:0/2138889544 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f892000f050 con 0x7f892c07fed0 2024-05-03T22:30:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.856+0000 7f8930e00700 1 --2- 172.21.15.44:0/2138889544 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f891403e570 0x7f8914040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.857+0000 7f8930e00700 1 --2- 172.21.15.44:0/2138889544 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f891403e570 0x7f8914040a30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8918006fd0 tx=0x7f8918006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:18.862+0000 7f892a000700 1 -- 172.21.15.44:0/2138889544 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f892002b020 con 0x7f892c07fed0 2024-05-03T22:30:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:19.229+0000 7f8934200700 1 -- 172.21.15.44:0/2138889544 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f892c02e850 con 0x7f892c07fed0 2024-05-03T22:30:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:19.232+0000 7f892a000700 1 -- 172.21.15.44:0/2138889544 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f892002e7f0 con 0x7f892c07fed0 2024-05-03T22:30:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:19.235+0000 7f8934200700 1 -- 172.21.15.44:0/2138889544 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f891403e570 msgr2=0x7f8914040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:19.235+0000 7f8934200700 1 --2- 172.21.15.44:0/2138889544 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f891403e570 0x7f8914040a30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8918006fd0 tx=0x7f8918006e40 comp rx=0 tx=0).stop 2024-05-03T22:30:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:19.236+0000 7f8934200700 1 -- 172.21.15.44:0/2138889544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f892c07fed0 msgr2=0x7f892c1a3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:19.935 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:19.236+0000 7f8934200700 1 --2- 172.21.15.44:0/2138889544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f892c07fed0 0x7f892c1a3460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f89200072a0 tx=0x7f892000bd50 comp rx=0 tx=0).stop 2024-05-03T22:30:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:19.236+0000 7f8934200700 1 -- 172.21.15.44:0/2138889544 shutdown_connections 2024-05-03T22:30:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:19.236+0000 7f8934200700 1 --2- 172.21.15.44:0/2138889544 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f891403e570 0x7f8914040a30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:19.236+0000 7f8934200700 1 --2- 172.21.15.44:0/2138889544 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f892c07fed0 0x7f892c1a3460 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:19.236+0000 7f8934200700 1 -- 172.21.15.44:0/2138889544 >> 172.21.15.44:0/2138889544 conn(0x7f892c07e6a0 msgr2=0x7f892c108c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:19.236+0000 7f8934200700 1 -- 172.21.15.44:0/2138889544 shutdown_connections 2024-05-03T22:30:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr 2024-05-03T22:30:19.236+0000 7f8934200700 1 -- 172.21.15.44:0/2138889544 wait complete. 2024-05-03T22:30:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-03T22:30:19.936 INFO:teuthology.orchestra.run.smithi044.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-03T22:30:19.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:30:19.937 INFO:teuthology.orchestra.run.smithi044.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-03T22:30:19.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:30:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:Or, if you are only running a single cluster on this host: 2024-05-03T22:30:19.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:30:19.937 INFO:teuthology.orchestra.run.smithi044.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-03T22:30:19.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:30:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-03T22:30:19.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:30:19.937 INFO:teuthology.orchestra.run.smithi044.stdout: ceph telemetry on 2024-05-03T22:30:19.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:30:19.937 INFO:teuthology.orchestra.run.smithi044.stdout:For more information see: 2024-05-03T22:30:19.937 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:30:19.937 INFO:teuthology.orchestra.run.smithi044.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-03T22:30:19.938 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:30:19.938 INFO:teuthology.orchestra.run.smithi044.stdout:Bootstrap complete. 2024-05-03T22:30:20.037 INFO:tasks.cephadm:Fetching config... 2024-05-03T22:30:20.037 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T22:30:20.037 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-03T22:30:20.088 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-03T22:30:20.088 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T22:30:20.088 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-03T22:30:20.133 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-03T22:30:20.133 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T22:30:20.133 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-03T22:30:20.236 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-03T22:30:20.237 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T22:30:20.237 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-03T22:30:20.333 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-03T22:30:20.334 DEBUG:teuthology.orchestra.run.smithi044:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDhFzLyy/5IjrQlL7TdLa676+LppGMb9I9CJBuitHx//+vevCjPcqM3p0Vq+jk286aLgQ0sZwnVUBLcm+Ou/ugN9EDTJ7bfhDYgX7rBecNZ0m7BpbF/sEcWMSeRA35aSyUsH2ydZS4GeZLVWaRIgf5SFbOIjKcC+PVUk9ewJuCRSyuFsbBCXy+ewTIe5jN7UKhIVukpz9DnaWAanp7Lq6clkvnwn4VbBhCxjnr9MH+8bX7Vuh+chw8f/urbWl/MiqTnI/neqR/hboXN8X1gX1NgmR2K5BnGLCksDZ/XzMTF/1cbpBLSGqYGYFfN2LjMSD5sDJv6YWdXDYeuIIwjjJDLSIBRmuH71vOsUGZyhqjJUrYVNBp/HUf4mhjFqe5Pgdt6MF39G69G07GiGk/q96u3Fq1W9r+nrddW0/+PaQWhIj1ZIDsWnILz5OrreDpQTK3zI+XJFdVCvRbFdkBODZ+SDS67wTKv/myIwa6a/JNb/9Vy1fwkUVCVSL70BBObkYM= ceph-5b0efdca-099c-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-03T22:30:20.440 INFO:teuthology.orchestra.run.smithi044.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDhFzLyy/5IjrQlL7TdLa676+LppGMb9I9CJBuitHx//+vevCjPcqM3p0Vq+jk286aLgQ0sZwnVUBLcm+Ou/ugN9EDTJ7bfhDYgX7rBecNZ0m7BpbF/sEcWMSeRA35aSyUsH2ydZS4GeZLVWaRIgf5SFbOIjKcC+PVUk9ewJuCRSyuFsbBCXy+ewTIe5jN7UKhIVukpz9DnaWAanp7Lq6clkvnwn4VbBhCxjnr9MH+8bX7Vuh+chw8f/urbWl/MiqTnI/neqR/hboXN8X1gX1NgmR2K5BnGLCksDZ/XzMTF/1cbpBLSGqYGYFfN2LjMSD5sDJv6YWdXDYeuIIwjjJDLSIBRmuH71vOsUGZyhqjJUrYVNBp/HUf4mhjFqe5Pgdt6MF39G69G07GiGk/q96u3Fq1W9r+nrddW0/+PaQWhIj1ZIDsWnILz5OrreDpQTK3zI+XJFdVCvRbFdkBODZ+SDS67wTKv/myIwa6a/JNb/9Vy1fwkUVCVSL70BBObkYM= ceph-5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:30:20.480 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:20 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2138889544' entity='client.admin' 2024-05-03T22:30:20.492 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDhFzLyy/5IjrQlL7TdLa676+LppGMb9I9CJBuitHx//+vevCjPcqM3p0Vq+jk286aLgQ0sZwnVUBLcm+Ou/ugN9EDTJ7bfhDYgX7rBecNZ0m7BpbF/sEcWMSeRA35aSyUsH2ydZS4GeZLVWaRIgf5SFbOIjKcC+PVUk9ewJuCRSyuFsbBCXy+ewTIe5jN7UKhIVukpz9DnaWAanp7Lq6clkvnwn4VbBhCxjnr9MH+8bX7Vuh+chw8f/urbWl/MiqTnI/neqR/hboXN8X1gX1NgmR2K5BnGLCksDZ/XzMTF/1cbpBLSGqYGYFfN2LjMSD5sDJv6YWdXDYeuIIwjjJDLSIBRmuH71vOsUGZyhqjJUrYVNBp/HUf4mhjFqe5Pgdt6MF39G69G07GiGk/q96u3Fq1W9r+nrddW0/+PaQWhIj1ZIDsWnILz5OrreDpQTK3zI+XJFdVCvRbFdkBODZ+SDS67wTKv/myIwa6a/JNb/9Vy1fwkUVCVSL70BBObkYM= ceph-5b0efdca-099c-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-03T22:30:20.618 INFO:teuthology.orchestra.run.smithi060.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDhFzLyy/5IjrQlL7TdLa676+LppGMb9I9CJBuitHx//+vevCjPcqM3p0Vq+jk286aLgQ0sZwnVUBLcm+Ou/ugN9EDTJ7bfhDYgX7rBecNZ0m7BpbF/sEcWMSeRA35aSyUsH2ydZS4GeZLVWaRIgf5SFbOIjKcC+PVUk9ewJuCRSyuFsbBCXy+ewTIe5jN7UKhIVukpz9DnaWAanp7Lq6clkvnwn4VbBhCxjnr9MH+8bX7Vuh+chw8f/urbWl/MiqTnI/neqR/hboXN8X1gX1NgmR2K5BnGLCksDZ/XzMTF/1cbpBLSGqYGYFfN2LjMSD5sDJv6YWdXDYeuIIwjjJDLSIBRmuH71vOsUGZyhqjJUrYVNBp/HUf4mhjFqe5Pgdt6MF39G69G07GiGk/q96u3Fq1W9r+nrddW0/+PaQWhIj1ZIDsWnILz5OrreDpQTK3zI+XJFdVCvRbFdkBODZ+SDS67wTKv/myIwa6a/JNb/9Vy1fwkUVCVSL70BBObkYM= ceph-5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:30:20.685 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDhFzLyy/5IjrQlL7TdLa676+LppGMb9I9CJBuitHx//+vevCjPcqM3p0Vq+jk286aLgQ0sZwnVUBLcm+Ou/ugN9EDTJ7bfhDYgX7rBecNZ0m7BpbF/sEcWMSeRA35aSyUsH2ydZS4GeZLVWaRIgf5SFbOIjKcC+PVUk9ewJuCRSyuFsbBCXy+ewTIe5jN7UKhIVukpz9DnaWAanp7Lq6clkvnwn4VbBhCxjnr9MH+8bX7Vuh+chw8f/urbWl/MiqTnI/neqR/hboXN8X1gX1NgmR2K5BnGLCksDZ/XzMTF/1cbpBLSGqYGYFfN2LjMSD5sDJv6YWdXDYeuIIwjjJDLSIBRmuH71vOsUGZyhqjJUrYVNBp/HUf4mhjFqe5Pgdt6MF39G69G07GiGk/q96u3Fq1W9r+nrddW0/+PaQWhIj1ZIDsWnILz5OrreDpQTK3zI+XJFdVCvRbFdkBODZ+SDS67wTKv/myIwa6a/JNb/9Vy1fwkUVCVSL70BBObkYM= ceph-5b0efdca-099c-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-03T22:30:20.804 INFO:teuthology.orchestra.run.smithi160.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDhFzLyy/5IjrQlL7TdLa676+LppGMb9I9CJBuitHx//+vevCjPcqM3p0Vq+jk286aLgQ0sZwnVUBLcm+Ou/ugN9EDTJ7bfhDYgX7rBecNZ0m7BpbF/sEcWMSeRA35aSyUsH2ydZS4GeZLVWaRIgf5SFbOIjKcC+PVUk9ewJuCRSyuFsbBCXy+ewTIe5jN7UKhIVukpz9DnaWAanp7Lq6clkvnwn4VbBhCxjnr9MH+8bX7Vuh+chw8f/urbWl/MiqTnI/neqR/hboXN8X1gX1NgmR2K5BnGLCksDZ/XzMTF/1cbpBLSGqYGYFfN2LjMSD5sDJv6YWdXDYeuIIwjjJDLSIBRmuH71vOsUGZyhqjJUrYVNBp/HUf4mhjFqe5Pgdt6MF39G69G07GiGk/q96u3Fq1W9r+nrddW0/+PaQWhIj1ZIDsWnILz5OrreDpQTK3zI+XJFdVCvRbFdkBODZ+SDS67wTKv/myIwa6a/JNb/9Vy1fwkUVCVSL70BBObkYM= ceph-5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:30:20.840 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-03T22:30:21.270 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:30:23.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.979+0000 7f29a9000700 1 -- 172.21.15.44:0/951288545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a41037f0 msgr2=0x7f29a4105be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:23.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.979+0000 7f29a9000700 1 --2- 172.21.15.44:0/951288545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a41037f0 0x7f29a4105be0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2994009910 tx=0x7f2994009c20 comp rx=0 tx=0).stop 2024-05-03T22:30:23.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.979+0000 7f29a9000700 1 -- 172.21.15.44:0/951288545 shutdown_connections 2024-05-03T22:30:23.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.979+0000 7f29a9000700 1 --2- 172.21.15.44:0/951288545 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a41037f0 0x7f29a4105be0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:23.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.979+0000 7f29a9000700 1 -- 172.21.15.44:0/951288545 >> 172.21.15.44:0/951288545 conn(0x7f29a40fd200 msgr2=0x7f29a40ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:23.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.979+0000 7f29a9000700 1 -- 172.21.15.44:0/951288545 shutdown_connections 2024-05-03T22:30:23.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.979+0000 7f29a9000700 1 -- 172.21.15.44:0/951288545 wait complete. 2024-05-03T22:30:23.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.981+0000 7f29a9000700 1 Processor -- start 2024-05-03T22:30:23.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.981+0000 7f29a9000700 1 -- start start 2024-05-03T22:30:23.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.981+0000 7f29a9000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a41037f0 0x7f29a419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:23.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.981+0000 7f29a9000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f29a4108d80 con 0x7f29a41037f0 2024-05-03T22:30:23.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.982+0000 7f29a3400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a41037f0 0x7f29a419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:23.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.982+0000 7f29a3400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a41037f0 0x7f29a419a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57740/0 (socket says 172.21.15.44:57740) 2024-05-03T22:30:23.984 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.982+0000 7f29a3400700 1 -- 172.21.15.44:0/2124110753 learned_addr learned my addr 172.21.15.44:0/2124110753 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:23.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.982+0000 7f29a3400700 1 -- 172.21.15.44:0/2124110753 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29a419aa90 con 0x7f29a41037f0 2024-05-03T22:30:23.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.982+0000 7f29a3400700 1 --2- 172.21.15.44:0/2124110753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a41037f0 0x7f29a419a550 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2994000c00 tx=0x7f2994009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:23.985 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.983+0000 7f299be00700 1 -- 172.21.15.44:0/2124110753 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2994027070 con 0x7f29a41037f0 2024-05-03T22:30:23.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.983+0000 7f299be00700 1 -- 172.21.15.44:0/2124110753 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f2994022470 con 0x7f29a41037f0 2024-05-03T22:30:23.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.983+0000 7f29a9000700 1 -- 172.21.15.44:0/2124110753 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29a419ad80 con 0x7f29a41037f0 2024-05-03T22:30:23.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.983+0000 7f299be00700 1 -- 172.21.15.44:0/2124110753 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f299400f5f0 con 0x7f29a41037f0 2024-05-03T22:30:23.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.983+0000 7f29a9000700 1 -- 172.21.15.44:0/2124110753 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29a419da10 con 0x7f29a41037f0 2024-05-03T22:30:23.986 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.984+0000 7f29a9000700 1 -- 172.21.15.44:0/2124110753 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2984005330 con 0x7f29a41037f0 2024-05-03T22:30:23.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.985+0000 7f299be00700 1 -- 172.21.15.44:0/2124110753 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f299402a070 con 0x7f29a41037f0 2024-05-03T22:30:23.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.985+0000 7f299be00700 1 --2- 172.21.15.44:0/2124110753 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f298803e510 0x7f29880409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:23.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.985+0000 7f299be00700 1 -- 172.21.15.44:0/2124110753 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f299401e030 con 0x7f29a41037f0 2024-05-03T22:30:23.987 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.986+0000 7f29a2a00700 1 --2- 172.21.15.44:0/2124110753 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f298803e510 0x7f29880409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:23.988 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.987+0000 7f29a2a00700 1 --2- 172.21.15.44:0/2124110753 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f298803e510 0x7f29880409d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2990006fd0 tx=0x7f2990006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:23.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:23.991+0000 7f299be00700 1 -- 172.21.15.44:0/2124110753 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f2994013070 con 0x7f29a41037f0 2024-05-03T22:30:24.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:24.226+0000 7f29a9000700 1 -- 172.21.15.44:0/2124110753 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f2984005620 con 0x7f29a41037f0 2024-05-03T22:30:24.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:24.231+0000 7f299be00700 1 -- 172.21.15.44:0/2124110753 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f2994031020 con 0x7f29a41037f0 2024-05-03T22:30:24.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:24.235+0000 7f29a9000700 1 -- 172.21.15.44:0/2124110753 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f298803e510 msgr2=0x7f29880409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:24.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:24.235+0000 7f29a9000700 1 --2- 172.21.15.44:0/2124110753 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f298803e510 0x7f29880409d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2990006fd0 tx=0x7f2990006e40 comp rx=0 tx=0).stop 2024-05-03T22:30:24.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:24.235+0000 7f29a9000700 1 -- 172.21.15.44:0/2124110753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a41037f0 msgr2=0x7f29a419a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:24.237 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:24.235+0000 7f29a9000700 1 --2- 172.21.15.44:0/2124110753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a41037f0 0x7f29a419a550 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2994000c00 tx=0x7f2994009f10 comp rx=0 tx=0).stop 2024-05-03T22:30:24.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:24.236+0000 7f29a9000700 1 -- 172.21.15.44:0/2124110753 shutdown_connections 2024-05-03T22:30:24.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:24.236+0000 7f29a9000700 1 --2- 172.21.15.44:0/2124110753 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f298803e510 0x7f29880409d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:24.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:24.236+0000 7f29a9000700 1 --2- 172.21.15.44:0/2124110753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f29a41037f0 0x7f29a419a550 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:24.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:24.236+0000 7f29a9000700 1 -- 172.21.15.44:0/2124110753 >> 172.21.15.44:0/2124110753 conn(0x7f29a40fd200 msgr2=0x7f29a40ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:24.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:24.236+0000 7f29a9000700 1 -- 172.21.15.44:0/2124110753 shutdown_connections 2024-05-03T22:30:24.239 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:24.236+0000 7f29a9000700 1 -- 172.21.15.44:0/2124110753 wait complete. 2024-05-03T22:30:25.038 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-03T22:30:25.038 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-03T22:30:25.489 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:30:25.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:25 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2124110753' entity='client.admin' 2024-05-03T22:30:27.887 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:27.887 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:27.887 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi044", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:30:27.887 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:27.887 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:30:27.887 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:28.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.492+0000 7f8655600700 1 -- 172.21.15.44:0/1947569531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8650104f80 msgr2=0x7f86501053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:28.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.492+0000 7f8655600700 1 --2- 172.21.15.44:0/1947569531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8650104f80 0x7f86501053a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8640009910 tx=0x7f8640009c20 comp rx=0 tx=0).stop 2024-05-03T22:30:28.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.492+0000 7f8655600700 1 -- 172.21.15.44:0/1947569531 shutdown_connections 2024-05-03T22:30:28.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.492+0000 7f8655600700 1 --2- 172.21.15.44:0/1947569531 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8650104f80 0x7f86501053a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:28.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.492+0000 7f8655600700 1 -- 172.21.15.44:0/1947569531 >> 172.21.15.44:0/1947569531 conn(0x7f8650100500 msgr2=0x7f8650102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:28.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.492+0000 7f8655600700 1 -- 172.21.15.44:0/1947569531 shutdown_connections 2024-05-03T22:30:28.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.492+0000 7f8655600700 1 -- 172.21.15.44:0/1947569531 wait complete. 2024-05-03T22:30:28.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.493+0000 7f8655600700 1 Processor -- start 2024-05-03T22:30:28.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.493+0000 7f8655600700 1 -- start start 2024-05-03T22:30:28.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.493+0000 7f8655600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8650104f80 0x7f865019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:28.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.493+0000 7f8655600700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f865010b000 con 0x7f8650104f80 2024-05-03T22:30:28.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.494+0000 7f864fe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8650104f80 0x7f865019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:28.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.494+0000 7f864fe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8650104f80 0x7f865019a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57756/0 (socket says 172.21.15.44:57756) 2024-05-03T22:30:28.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.494+0000 7f864fe00700 1 -- 172.21.15.44:0/3666775733 learned_addr learned my addr 172.21.15.44:0/3666775733 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:28.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.494+0000 7f864fe00700 1 -- 172.21.15.44:0/3666775733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865019aaf0 con 0x7f8650104f80 2024-05-03T22:30:28.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.494+0000 7f864fe00700 1 --2- 172.21.15.44:0/3666775733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8650104f80 0x7f865019a5b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8640005200 tx=0x7f8640009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:28.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.495+0000 7f864cc00700 1 -- 172.21.15.44:0/3666775733 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8640027070 con 0x7f8650104f80 2024-05-03T22:30:28.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.495+0000 7f864cc00700 1 -- 172.21.15.44:0/3666775733 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f8640022470 con 0x7f8650104f80 2024-05-03T22:30:28.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.495+0000 7f864cc00700 1 -- 172.21.15.44:0/3666775733 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f864000f5f0 con 0x7f8650104f80 2024-05-03T22:30:28.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.495+0000 7f8655600700 1 -- 172.21.15.44:0/3666775733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f865019ad80 con 0x7f8650104f80 2024-05-03T22:30:28.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.495+0000 7f8655600700 1 -- 172.21.15.44:0/3666775733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f865019da70 con 0x7f8650104f80 2024-05-03T22:30:28.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.496+0000 7f8655600700 1 -- 172.21.15.44:0/3666775733 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f865010b780 con 0x7f8650104f80 2024-05-03T22:30:28.497 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.496+0000 7f864cc00700 1 -- 172.21.15.44:0/3666775733 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f864002a070 con 0x7f8650104f80 2024-05-03T22:30:28.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.497+0000 7f864cc00700 1 --2- 172.21.15.44:0/3666775733 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f863403e510 0x7f86340409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:28.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.497+0000 7f864cc00700 1 -- 172.21.15.44:0/3666775733 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f864001e030 con 0x7f8650104f80 2024-05-03T22:30:28.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.497+0000 7f864f400700 1 --2- 172.21.15.44:0/3666775733 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f863403e510 0x7f86340409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:28.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.498+0000 7f864f400700 1 --2- 172.21.15.44:0/3666775733 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f863403e510 0x7f86340409d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f863c006fd0 tx=0x7f863c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:28.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.503+0000 7f864cc00700 1 -- 172.21.15.44:0/3666775733 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8640013070 con 0x7f8650104f80 2024-05-03T22:30:28.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.745+0000 7f8655600700 1 -- 172.21.15.44:0/3666775733 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f865002e620 con 0x7f863403e510 2024-05-03T22:30:28.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.753+0000 7f864cc00700 1 -- 172.21.15.44:0/3666775733 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f865002e620 con 0x7f863403e510 2024-05-03T22:30:28.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.756+0000 7f8655600700 1 -- 172.21.15.44:0/3666775733 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f863403e510 msgr2=0x7f86340409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.756+0000 7f8655600700 1 --2- 172.21.15.44:0/3666775733 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f863403e510 0x7f86340409d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f863c006fd0 tx=0x7f863c006e40 comp rx=0 tx=0).stop 2024-05-03T22:30:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.756+0000 7f8655600700 1 -- 172.21.15.44:0/3666775733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8650104f80 msgr2=0x7f865019a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.756+0000 7f8655600700 1 --2- 172.21.15.44:0/3666775733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8650104f80 0x7f865019a5b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8640005200 tx=0x7f8640009f10 comp rx=0 tx=0).stop 2024-05-03T22:30:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.757+0000 7f8655600700 1 -- 172.21.15.44:0/3666775733 shutdown_connections 2024-05-03T22:30:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.757+0000 7f8655600700 1 --2- 172.21.15.44:0/3666775733 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f863403e510 0x7f86340409d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.757+0000 7f8655600700 1 --2- 172.21.15.44:0/3666775733 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8650104f80 0x7f865019a5b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.757+0000 7f8655600700 1 -- 172.21.15.44:0/3666775733 >> 172.21.15.44:0/3666775733 conn(0x7f8650100500 msgr2=0x7f8650100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.757+0000 7f8655600700 1 -- 172.21.15.44:0/3666775733 shutdown_connections 2024-05-03T22:30:28.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:28.757+0000 7f8655600700 1 -- 172.21.15.44:0/3666775733 wait complete. 2024-05-03T22:30:29.446 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi060 2024-05-03T22:30:29.447 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-03T22:30:29.447 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/etc/ceph/ceph.conf 2024-05-03T22:30:29.507 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-03T22:30:29.507 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:30:29.605 INFO:tasks.cephadm:Adding host smithi060 to orchestrator... 2024-05-03T22:30:29.605 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch host add smithi060 2024-05-03T22:30:30.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:29 smithi044 ceph-mon[28604]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:30:30.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:29 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:30.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:29 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:30:30.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:29 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:30:30.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:29 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:30:30.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:29 smithi044 ceph-mon[28604]: Updating smithi044:/etc/ceph/ceph.conf 2024-05-03T22:30:30.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:29 smithi044 ceph-mon[28604]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:30:30.029 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:30:31.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:30 smithi044 ceph-mon[28604]: Updating smithi044:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:30:31.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:30 smithi044 ceph-mon[28604]: Updating smithi044:/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:30:31.920 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:31 smithi044 ceph-mon[28604]: Updating smithi044:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T22:30:31.920 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:31 smithi044 ceph-mon[28604]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:30:31.920 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:31 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:31.920 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:31 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:31.920 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:31 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:32.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.095+0000 7f8b18200700 1 -- 172.21.15.44:0/3083321598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b10075840 msgr2=0x7f8b10075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:32.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.095+0000 7f8b18200700 1 --2- 172.21.15.44:0/3083321598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b10075840 0x7f8b10075c20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009910 tx=0x7f8b04009c20 comp rx=0 tx=0).stop 2024-05-03T22:30:32.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.096+0000 7f8b18200700 1 -- 172.21.15.44:0/3083321598 shutdown_connections 2024-05-03T22:30:32.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.096+0000 7f8b18200700 1 --2- 172.21.15.44:0/3083321598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b10075840 0x7f8b10075c20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:32.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.096+0000 7f8b18200700 1 -- 172.21.15.44:0/3083321598 >> 172.21.15.44:0/3083321598 conn(0x7f8b100fe9e0 msgr2=0x7f8b10100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:32.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.096+0000 7f8b18200700 1 -- 172.21.15.44:0/3083321598 shutdown_connections 2024-05-03T22:30:32.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.096+0000 7f8b18200700 1 -- 172.21.15.44:0/3083321598 wait complete. 2024-05-03T22:30:32.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.097+0000 7f8b18200700 1 Processor -- start 2024-05-03T22:30:32.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.097+0000 7f8b18200700 1 -- start start 2024-05-03T22:30:32.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.098+0000 7f8b18200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b10075840 0x7f8b1019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:32.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.098+0000 7f8b18200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8b10113b40 con 0x7f8b10075840 2024-05-03T22:30:32.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.098+0000 7f8b15800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b10075840 0x7f8b1019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:32.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.098+0000 7f8b15800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b10075840 0x7f8b1019ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37502/0 (socket says 172.21.15.44:37502) 2024-05-03T22:30:32.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.098+0000 7f8b15800700 1 -- 172.21.15.44:0/2573667809 learned_addr learned my addr 172.21.15.44:0/2573667809 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:32.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.099+0000 7f8b15800700 1 -- 172.21.15.44:0/2573667809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1019f4b0 con 0x7f8b10075840 2024-05-03T22:30:32.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.099+0000 7f8b15800700 1 --2- 172.21.15.44:0/2573667809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b10075840 0x7f8b1019ef70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8b04006010 tx=0x7f8b040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:32.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.099+0000 7f8b0e000700 1 -- 172.21.15.44:0/2573667809 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b04026070 con 0x7f8b10075840 2024-05-03T22:30:32.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.099+0000 7f8b0e000700 1 -- 172.21.15.44:0/2573667809 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f8b040044a0 con 0x7f8b10075840 2024-05-03T22:30:32.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.099+0000 7f8b18200700 1 -- 172.21.15.44:0/2573667809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b1019f740 con 0x7f8b10075840 2024-05-03T22:30:32.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.099+0000 7f8b0e000700 1 -- 172.21.15.44:0/2573667809 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b04003a70 con 0x7f8b10075840 2024-05-03T22:30:32.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.099+0000 7f8b18200700 1 -- 172.21.15.44:0/2573667809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b1019fba0 con 0x7f8b10075840 2024-05-03T22:30:32.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.101+0000 7f8b18200700 1 -- 172.21.15.44:0/2573667809 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b10076f80 con 0x7f8b10075840 2024-05-03T22:30:32.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.101+0000 7f8b0e000700 1 -- 172.21.15.44:0/2573667809 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f8b04029070 con 0x7f8b10075840 2024-05-03T22:30:32.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.102+0000 7f8b0e000700 1 --2- 172.21.15.44:0/2573667809 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8af803e570 0x7f8af8040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:32.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.102+0000 7f8b0e000700 1 -- 172.21.15.44:0/2573667809 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8b0401e070 con 0x7f8b10075840 2024-05-03T22:30:32.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.102+0000 7f8b14e00700 1 --2- 172.21.15.44:0/2573667809 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8af803e570 0x7f8af8040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:32.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.103+0000 7f8b14e00700 1 --2- 172.21.15.44:0/2573667809 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8af803e570 0x7f8af8040a30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8afc006fd0 tx=0x7f8afc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:32.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.108+0000 7f8b0e000700 1 -- 172.21.15.44:0/2573667809 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8b04013070 con 0x7f8b10075840 2024-05-03T22:30:32.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:32.353+0000 7f8b18200700 1 -- 172.21.15.44:0/2573667809 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi060", "target": ["mon-mgr", ""]}) -- 0x7f8b101a02d0 con 0x7f8af803e570 2024-05-03T22:30:34.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:33 smithi044 ceph-mon[28604]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi060", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:30:34.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:33 smithi044 ceph-mon[28604]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:30:35.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:34 smithi044 ceph-mon[28604]: Deploying cephadm binary to smithi060 2024-05-03T22:30:36.153 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:35 smithi044 ceph-mon[28604]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:30:38.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:37 smithi044 ceph-mon[28604]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:30:38.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:38.813+0000 7f8b0e000700 1 -- 172.21.15.44:0/2573667809 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f8b101a02d0 con 0x7f8af803e570 2024-05-03T22:30:38.817 INFO:teuthology.orchestra.run.smithi044.stdout:Added host 'smithi060' with addr '172.21.15.60' 2024-05-03T22:30:38.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:38.818+0000 7f8b18200700 1 -- 172.21.15.44:0/2573667809 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8af803e570 msgr2=0x7f8af8040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:38.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:38.818+0000 7f8b18200700 1 --2- 172.21.15.44:0/2573667809 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8af803e570 0x7f8af8040a30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8afc006fd0 tx=0x7f8afc006e40 comp rx=0 tx=0).stop 2024-05-03T22:30:38.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:38.818+0000 7f8b18200700 1 -- 172.21.15.44:0/2573667809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b10075840 msgr2=0x7f8b1019ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:38.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:38.818+0000 7f8b18200700 1 --2- 172.21.15.44:0/2573667809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b10075840 0x7f8b1019ef70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8b04006010 tx=0x7f8b040057f0 comp rx=0 tx=0).stop 2024-05-03T22:30:38.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:38.818+0000 7f8b18200700 1 -- 172.21.15.44:0/2573667809 shutdown_connections 2024-05-03T22:30:38.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:38.818+0000 7f8b18200700 1 --2- 172.21.15.44:0/2573667809 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8af803e570 0x7f8af8040a30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:38.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:38.818+0000 7f8b18200700 1 --2- 172.21.15.44:0/2573667809 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8b10075840 0x7f8b1019ef70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:38.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:38.818+0000 7f8b18200700 1 -- 172.21.15.44:0/2573667809 >> 172.21.15.44:0/2573667809 conn(0x7f8b100fe9e0 msgr2=0x7f8b10100370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:38.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:38.818+0000 7f8b18200700 1 -- 172.21.15.44:0/2573667809 shutdown_connections 2024-05-03T22:30:38.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:38.818+0000 7f8b18200700 1 -- 172.21.15.44:0/2573667809 wait complete. 2024-05-03T22:30:39.582 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-03T22:30:40.025 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:30:40.175 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:39 smithi044 ceph-mon[28604]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:30:40.175 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:39 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:40.175 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:39 smithi044 ceph-mon[28604]: Added host smithi060 2024-05-03T22:30:40.175 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:39 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:30:40.175 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:39 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:41.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:41.737 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:41 smithi044 ceph-mon[28604]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:30:42.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.223+0000 7f502ae00700 1 -- 172.21.15.44:0/845462348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5024105330 msgr2=0x7f5024105710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:42.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.223+0000 7f502ae00700 1 --2- 172.21.15.44:0/845462348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5024105330 0x7f5024105710 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5014009910 tx=0x7f5014009c20 comp rx=0 tx=0).stop 2024-05-03T22:30:42.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.223+0000 7f502ae00700 1 -- 172.21.15.44:0/845462348 shutdown_connections 2024-05-03T22:30:42.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.223+0000 7f502ae00700 1 --2- 172.21.15.44:0/845462348 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5024105330 0x7f5024105710 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:42.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.223+0000 7f502ae00700 1 -- 172.21.15.44:0/845462348 >> 172.21.15.44:0/845462348 conn(0x7f5024100bc0 msgr2=0x7f5024102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:42.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.224+0000 7f502ae00700 1 -- 172.21.15.44:0/845462348 shutdown_connections 2024-05-03T22:30:42.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.224+0000 7f502ae00700 1 -- 172.21.15.44:0/845462348 wait complete. 2024-05-03T22:30:42.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.225+0000 7f502ae00700 1 Processor -- start 2024-05-03T22:30:42.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.225+0000 7f502ae00700 1 -- start start 2024-05-03T22:30:42.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.225+0000 7f502ae00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5024105330 0x7f50241a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:42.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.225+0000 7f502ae00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f502410f6f0 con 0x7f5024105330 2024-05-03T22:30:42.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.226+0000 7f5023e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5024105330 0x7f50241a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:42.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.226+0000 7f5023e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5024105330 0x7f50241a07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45714/0 (socket says 172.21.15.44:45714) 2024-05-03T22:30:42.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.226+0000 7f5023e00700 1 -- 172.21.15.44:0/758273613 learned_addr learned my addr 172.21.15.44:0/758273613 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:42.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.226+0000 7f5023e00700 1 -- 172.21.15.44:0/758273613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50241a0d00 con 0x7f5024105330 2024-05-03T22:30:42.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.226+0000 7f5023e00700 1 --2- 172.21.15.44:0/758273613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5024105330 0x7f50241a07c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5014006010 tx=0x7f50140057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:42.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.227+0000 7f5021600700 1 -- 172.21.15.44:0/758273613 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5014026070 con 0x7f5024105330 2024-05-03T22:30:42.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.227+0000 7f5021600700 1 -- 172.21.15.44:0/758273613 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f501400bbc0 con 0x7f5024105330 2024-05-03T22:30:42.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.227+0000 7f5021600700 1 -- 172.21.15.44:0/758273613 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50140039d0 con 0x7f5024105330 2024-05-03T22:30:42.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.227+0000 7f502ae00700 1 -- 172.21.15.44:0/758273613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50241a0ff0 con 0x7f5024105330 2024-05-03T22:30:42.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.227+0000 7f502ae00700 1 -- 172.21.15.44:0/758273613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f502419a980 con 0x7f5024105330 2024-05-03T22:30:42.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.228+0000 7f5021600700 1 -- 172.21.15.44:0/758273613 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f5014029070 con 0x7f5024105330 2024-05-03T22:30:42.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.228+0000 7f502ae00700 1 -- 172.21.15.44:0/758273613 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5024106810 con 0x7f5024105330 2024-05-03T22:30:42.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.229+0000 7f5021600700 1 --2- 172.21.15.44:0/758273613 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f500803e570 0x7f5008040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:42.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.229+0000 7f5021600700 1 -- 172.21.15.44:0/758273613 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f501401e070 con 0x7f5024105330 2024-05-03T22:30:42.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.229+0000 7f501be00700 1 --2- 172.21.15.44:0/758273613 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f500803e570 0x7f5008040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:42.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.230+0000 7f501be00700 1 --2- 172.21.15.44:0/758273613 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f500803e570 0x7f5008040a30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f500c006fd0 tx=0x7f500c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:42.236 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.234+0000 7f5021600700 1 -- 172.21.15.44:0/758273613 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f5014013070 con 0x7f5024105330 2024-05-03T22:30:42.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.477+0000 7f502ae00700 1 -- 172.21.15.44:0/758273613 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f502419bf20 con 0x7f500803e570 2024-05-03T22:30:42.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.481+0000 7f5021600700 1 -- 172.21.15.44:0/758273613 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f502419bf20 con 0x7f500803e570 2024-05-03T22:30:42.483 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:30:42.483 INFO:teuthology.orchestra.run.smithi044.stdout:[{"addr": "172.21.15.44", "hostname": "smithi044", "labels": [], "status": ""}, {"addr": "172.21.15.60", "hostname": "smithi060", "labels": [], "status": ""}] 2024-05-03T22:30:42.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.484+0000 7f502ae00700 1 -- 172.21.15.44:0/758273613 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f500803e570 msgr2=0x7f5008040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:42.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.484+0000 7f502ae00700 1 --2- 172.21.15.44:0/758273613 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f500803e570 0x7f5008040a30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f500c006fd0 tx=0x7f500c006e40 comp rx=0 tx=0).stop 2024-05-03T22:30:42.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.484+0000 7f502ae00700 1 -- 172.21.15.44:0/758273613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5024105330 msgr2=0x7f50241a07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:42.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.484+0000 7f502ae00700 1 --2- 172.21.15.44:0/758273613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5024105330 0x7f50241a07c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5014006010 tx=0x7f50140057d0 comp rx=0 tx=0).stop 2024-05-03T22:30:42.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.484+0000 7f502ae00700 1 -- 172.21.15.44:0/758273613 shutdown_connections 2024-05-03T22:30:42.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.484+0000 7f502ae00700 1 --2- 172.21.15.44:0/758273613 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f500803e570 0x7f5008040a30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:42.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.484+0000 7f502ae00700 1 --2- 172.21.15.44:0/758273613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5024105330 0x7f50241a07c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:42.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.484+0000 7f502ae00700 1 -- 172.21.15.44:0/758273613 >> 172.21.15.44:0/758273613 conn(0x7f5024100bc0 msgr2=0x7f5024106d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:42.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.484+0000 7f502ae00700 1 -- 172.21.15.44:0/758273613 shutdown_connections 2024-05-03T22:30:42.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:42.484+0000 7f502ae00700 1 -- 172.21.15.44:0/758273613 wait complete. 2024-05-03T22:30:43.155 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi160 2024-05-03T22:30:43.155 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-03T22:30:43.156 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/etc/ceph/ceph.conf 2024-05-03T22:30:43.213 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-03T22:30:43.213 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:30:43.307 INFO:tasks.cephadm:Adding host smithi160 to orchestrator... 2024-05-03T22:30:43.307 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch host add smithi160 2024-05-03T22:30:43.765 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:30:44.199 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:43 smithi044 ceph-mon[28604]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:30:44.199 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:43 smithi044 ceph-mon[28604]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:30:44.199 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:43 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:45.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.735+0000 7fcad4a00700 1 -- 172.21.15.44:0/3395670605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad00758d0 msgr2=0x7fcad0075cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:45.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.735+0000 7fcad4a00700 1 --2- 172.21.15.44:0/3395670605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad00758d0 0x7fcad0075cb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcac0009910 tx=0x7fcac0009c20 comp rx=0 tx=0).stop 2024-05-03T22:30:45.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.735+0000 7fcad4a00700 1 -- 172.21.15.44:0/3395670605 shutdown_connections 2024-05-03T22:30:45.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.735+0000 7fcad4a00700 1 --2- 172.21.15.44:0/3395670605 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad00758d0 0x7fcad0075cb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:45.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.735+0000 7fcad4a00700 1 -- 172.21.15.44:0/3395670605 >> 172.21.15.44:0/3395670605 conn(0x7fcad00fe800 msgr2=0x7fcad0100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:45.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.735+0000 7fcad4a00700 1 -- 172.21.15.44:0/3395670605 shutdown_connections 2024-05-03T22:30:45.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.735+0000 7fcad4a00700 1 -- 172.21.15.44:0/3395670605 wait complete. 2024-05-03T22:30:45.738 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.736+0000 7fcad4a00700 1 Processor -- start 2024-05-03T22:30:45.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.736+0000 7fcad4a00700 1 -- start start 2024-05-03T22:30:45.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.737+0000 7fcad4a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad00758d0 0x7fcad01a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:45.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.737+0000 7fcad4a00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcad010f590 con 0x7fcad00758d0 2024-05-03T22:30:45.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.737+0000 7fcacf400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad00758d0 0x7fcad01a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:45.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.737+0000 7fcacf400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad00758d0 0x7fcad01a06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45740/0 (socket says 172.21.15.44:45740) 2024-05-03T22:30:45.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.737+0000 7fcacf400700 1 -- 172.21.15.44:0/2250601012 learned_addr learned my addr 172.21.15.44:0/2250601012 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:45.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.737+0000 7fcacf400700 1 -- 172.21.15.44:0/2250601012 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcad01a0c00 con 0x7fcad00758d0 2024-05-03T22:30:45.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.738+0000 7fcacf400700 1 --2- 172.21.15.44:0/2250601012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad00758d0 0x7fcad01a06c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcac0006010 tx=0x7fcac00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:45.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.738+0000 7fcac7e00700 1 -- 172.21.15.44:0/2250601012 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcac0026070 con 0x7fcad00758d0 2024-05-03T22:30:45.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.738+0000 7fcac7e00700 1 -- 172.21.15.44:0/2250601012 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fcac00044a0 con 0x7fcad00758d0 2024-05-03T22:30:45.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.738+0000 7fcac7e00700 1 -- 172.21.15.44:0/2250601012 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcac0003a70 con 0x7fcad00758d0 2024-05-03T22:30:45.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.738+0000 7fcad4a00700 1 -- 172.21.15.44:0/2250601012 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad01a0e90 con 0x7fcad00758d0 2024-05-03T22:30:45.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.738+0000 7fcad4a00700 1 -- 172.21.15.44:0/2250601012 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad019a840 con 0x7fcad00758d0 2024-05-03T22:30:45.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.739+0000 7fcad4a00700 1 -- 172.21.15.44:0/2250601012 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcad0076f80 con 0x7fcad00758d0 2024-05-03T22:30:45.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.740+0000 7fcac7e00700 1 -- 172.21.15.44:0/2250601012 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fcac0029070 con 0x7fcad00758d0 2024-05-03T22:30:45.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.740+0000 7fcac7e00700 1 --2- 172.21.15.44:0/2250601012 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fcab403e510 0x7fcab40409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:45.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.740+0000 7fcac7e00700 1 -- 172.21.15.44:0/2250601012 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fcac001e070 con 0x7fcad00758d0 2024-05-03T22:30:45.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.741+0000 7fcacea00700 1 --2- 172.21.15.44:0/2250601012 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fcab403e510 0x7fcab40409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:45.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.741+0000 7fcacea00700 1 --2- 172.21.15.44:0/2250601012 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fcab403e510 0x7fcab40409d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcabc006fd0 tx=0x7fcabc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:45.747 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.746+0000 7fcac7e00700 1 -- 172.21.15.44:0/2250601012 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fcac0013070 con 0x7fcad00758d0 2024-05-03T22:30:46.000 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:45.998+0000 7fcad4a00700 1 -- 172.21.15.44:0/2250601012 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi160", "target": ["mon-mgr", ""]}) -- 0x7fcad019bd70 con 0x7fcab403e510 2024-05-03T22:30:46.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:45 smithi044 ceph-mon[28604]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:30:47.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:46 smithi044 ceph-mon[28604]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi160", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:30:48.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:47 smithi044 ceph-mon[28604]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:30:49.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:49 smithi044 ceph-mon[28604]: Deploying cephadm binary to smithi160 2024-05-03T22:30:49.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:49 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:49.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:49 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:49.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:49 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:49.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:49 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:49.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:49 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:30:49.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:49 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:30:49.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:49 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:30:49.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:49 smithi044 ceph-mon[28604]: Updating smithi060:/etc/ceph/ceph.conf 2024-05-03T22:30:50.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:50 smithi044 ceph-mon[28604]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:30:52.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:52.419+0000 7fcac7e00700 1 -- 172.21.15.44:0/2250601012 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fcad019bd70 con 0x7fcab403e510 2024-05-03T22:30:52.421 INFO:teuthology.orchestra.run.smithi044.stdout:Added host 'smithi160' with addr '172.21.15.160' 2024-05-03T22:30:52.422 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:52 smithi044 ceph-mon[28604]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:30:52.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:52.423+0000 7fcad4a00700 1 -- 172.21.15.44:0/2250601012 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fcab403e510 msgr2=0x7fcab40409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:52.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:52.423+0000 7fcad4a00700 1 --2- 172.21.15.44:0/2250601012 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fcab403e510 0x7fcab40409d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fcabc006fd0 tx=0x7fcabc006e40 comp rx=0 tx=0).stop 2024-05-03T22:30:52.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:52.423+0000 7fcad4a00700 1 -- 172.21.15.44:0/2250601012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad00758d0 msgr2=0x7fcad01a06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:52.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:52.423+0000 7fcad4a00700 1 --2- 172.21.15.44:0/2250601012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad00758d0 0x7fcad01a06c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fcac0006010 tx=0x7fcac00057f0 comp rx=0 tx=0).stop 2024-05-03T22:30:52.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:52.423+0000 7fcad4a00700 1 -- 172.21.15.44:0/2250601012 shutdown_connections 2024-05-03T22:30:52.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:52.423+0000 7fcad4a00700 1 --2- 172.21.15.44:0/2250601012 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fcab403e510 0x7fcab40409d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:52.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:52.423+0000 7fcad4a00700 1 --2- 172.21.15.44:0/2250601012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcad00758d0 0x7fcad01a06c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:52.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:52.423+0000 7fcad4a00700 1 -- 172.21.15.44:0/2250601012 >> 172.21.15.44:0/2250601012 conn(0x7fcad00fe800 msgr2=0x7fcad0106f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:52.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:52.424+0000 7fcad4a00700 1 -- 172.21.15.44:0/2250601012 shutdown_connections 2024-05-03T22:30:52.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:52.424+0000 7fcad4a00700 1 -- 172.21.15.44:0/2250601012 wait complete. 2024-05-03T22:30:53.183 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-03T22:30:53.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:53 smithi044 ceph-mon[28604]: Updating smithi060:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:30:53.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:53.649 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:30:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:54 smithi044 ceph-mon[28604]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:30:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:54 smithi044 ceph-mon[28604]: Added host smithi160 2024-05-03T22:30:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:54 smithi044 ceph-mon[28604]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:30:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:54 smithi044 ceph-mon[28604]: Updating smithi060:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T22:30:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:54 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:54 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:54 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:55.365 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:55 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:30:55.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.657+0000 7ff415a00700 1 -- 172.21.15.44:0/2595527722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4100779d0 msgr2=0x7ff410077db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:55.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.657+0000 7ff415a00700 1 --2- 172.21.15.44:0/2595527722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4100779d0 0x7ff410077db0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff400009910 tx=0x7ff400009c20 comp rx=0 tx=0).stop 2024-05-03T22:30:55.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.657+0000 7ff415a00700 1 -- 172.21.15.44:0/2595527722 shutdown_connections 2024-05-03T22:30:55.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.657+0000 7ff415a00700 1 --2- 172.21.15.44:0/2595527722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4100779d0 0x7ff410077db0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:55.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.657+0000 7ff415a00700 1 -- 172.21.15.44:0/2595527722 >> 172.21.15.44:0/2595527722 conn(0x7ff4101009d0 msgr2=0x7ff410102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:55.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.657+0000 7ff415a00700 1 -- 172.21.15.44:0/2595527722 shutdown_connections 2024-05-03T22:30:55.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.657+0000 7ff415a00700 1 -- 172.21.15.44:0/2595527722 wait complete. 2024-05-03T22:30:55.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.658+0000 7ff415a00700 1 Processor -- start 2024-05-03T22:30:55.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.658+0000 7ff415a00700 1 -- start start 2024-05-03T22:30:55.660 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.659+0000 7ff415a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4100779d0 0x7ff41019ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:55.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.659+0000 7ff415a00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff410113960 con 0x7ff4100779d0 2024-05-03T22:30:55.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.659+0000 7ff40fe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4100779d0 0x7ff41019ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:55.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.659+0000 7ff40fe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4100779d0 0x7ff41019ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55474/0 (socket says 172.21.15.44:55474) 2024-05-03T22:30:55.661 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.659+0000 7ff40fe00700 1 -- 172.21.15.44:0/149198840 learned_addr learned my addr 172.21.15.44:0/149198840 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:55.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.660+0000 7ff40fe00700 1 -- 172.21.15.44:0/149198840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41019f2c0 con 0x7ff4100779d0 2024-05-03T22:30:55.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.660+0000 7ff40fe00700 1 --2- 172.21.15.44:0/149198840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4100779d0 0x7ff41019ed80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff400006010 tx=0x7ff4000057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:55.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.660+0000 7ff40cc00700 1 -- 172.21.15.44:0/149198840 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff400026070 con 0x7ff4100779d0 2024-05-03T22:30:55.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.660+0000 7ff40cc00700 1 -- 172.21.15.44:0/149198840 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7ff40000bc20 con 0x7ff4100779d0 2024-05-03T22:30:55.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.660+0000 7ff415a00700 1 -- 172.21.15.44:0/149198840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff41019f550 con 0x7ff4100779d0 2024-05-03T22:30:55.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.660+0000 7ff40cc00700 1 -- 172.21.15.44:0/149198840 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4000039a0 con 0x7ff4100779d0 2024-05-03T22:30:55.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.660+0000 7ff415a00700 1 -- 172.21.15.44:0/149198840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff41019f9b0 con 0x7ff4100779d0 2024-05-03T22:30:55.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.662+0000 7ff40cc00700 1 -- 172.21.15.44:0/149198840 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7ff400029070 con 0x7ff4100779d0 2024-05-03T22:30:55.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.662+0000 7ff415a00700 1 -- 172.21.15.44:0/149198840 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff410079110 con 0x7ff4100779d0 2024-05-03T22:30:55.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.662+0000 7ff40cc00700 1 --2- 172.21.15.44:0/149198840 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff3f403e570 0x7ff3f4040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:55.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.662+0000 7ff40cc00700 1 -- 172.21.15.44:0/149198840 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff40001e070 con 0x7ff4100779d0 2024-05-03T22:30:55.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.663+0000 7ff40f400700 1 --2- 172.21.15.44:0/149198840 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff3f403e570 0x7ff3f4040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:55.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.663+0000 7ff40f400700 1 --2- 172.21.15.44:0/149198840 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff3f403e570 0x7ff3f4040a30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc006fd0 tx=0x7ff3fc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:55.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.668+0000 7ff40cc00700 1 -- 172.21.15.44:0/149198840 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff400013070 con 0x7ff4100779d0 2024-05-03T22:30:55.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.913+0000 7ff415a00700 1 -- 172.21.15.44:0/149198840 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff4101a00e0 con 0x7ff3f403e570 2024-05-03T22:30:55.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.915+0000 7ff40cc00700 1 -- 172.21.15.44:0/149198840 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7ff4101a00e0 con 0x7ff3f403e570 2024-05-03T22:30:55.916 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:30:55.917 INFO:teuthology.orchestra.run.smithi044.stdout:[{"addr": "172.21.15.44", "hostname": "smithi044", "labels": [], "status": ""}, {"addr": "172.21.15.60", "hostname": "smithi060", "labels": [], "status": ""}, {"addr": "172.21.15.160", "hostname": "smithi160", "labels": [], "status": ""}] 2024-05-03T22:30:55.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.918+0000 7ff415a00700 1 -- 172.21.15.44:0/149198840 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff3f403e570 msgr2=0x7ff3f4040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:55.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.918+0000 7ff415a00700 1 --2- 172.21.15.44:0/149198840 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff3f403e570 0x7ff3f4040a30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc006fd0 tx=0x7ff3fc006e40 comp rx=0 tx=0).stop 2024-05-03T22:30:55.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.918+0000 7ff415a00700 1 -- 172.21.15.44:0/149198840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4100779d0 msgr2=0x7ff41019ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:55.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.918+0000 7ff415a00700 1 --2- 172.21.15.44:0/149198840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4100779d0 0x7ff41019ed80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff400006010 tx=0x7ff4000057d0 comp rx=0 tx=0).stop 2024-05-03T22:30:55.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.918+0000 7ff415a00700 1 -- 172.21.15.44:0/149198840 shutdown_connections 2024-05-03T22:30:55.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.918+0000 7ff415a00700 1 --2- 172.21.15.44:0/149198840 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff3f403e570 0x7ff3f4040a30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:55.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.918+0000 7ff415a00700 1 --2- 172.21.15.44:0/149198840 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4100779d0 0x7ff41019ed80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:55.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.918+0000 7ff415a00700 1 -- 172.21.15.44:0/149198840 >> 172.21.15.44:0/149198840 conn(0x7ff4101009d0 msgr2=0x7ff4101021a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:55.920 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.918+0000 7ff415a00700 1 -- 172.21.15.44:0/149198840 shutdown_connections 2024-05-03T22:30:55.921 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:55.918+0000 7ff415a00700 1 -- 172.21.15.44:0/149198840 wait complete. 2024-05-03T22:30:56.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:56 smithi044 ceph-mon[28604]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:30:56.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:56 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:56.637 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-03T22:30:56.637 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd crush tunables default 2024-05-03T22:30:57.088 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:30:57.422 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:57 smithi044 ceph-mon[28604]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:30:57.422 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:58.241 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:58 smithi044 ceph-mon[28604]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:30:59.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.028+0000 7f397e800700 1 -- 172.21.15.44:0/3212810104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3978075870 msgr2=0x7f3978075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:30:59.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.028+0000 7f397e800700 1 --2- 172.21.15.44:0/3212810104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3978075870 0x7f3978075c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f396c009910 tx=0x7f396c009c20 comp rx=0 tx=0).stop 2024-05-03T22:30:59.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.028+0000 7f397e800700 1 -- 172.21.15.44:0/3212810104 shutdown_connections 2024-05-03T22:30:59.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.028+0000 7f397e800700 1 --2- 172.21.15.44:0/3212810104 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3978075870 0x7f3978075c50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:30:59.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.028+0000 7f397e800700 1 -- 172.21.15.44:0/3212810104 >> 172.21.15.44:0/3212810104 conn(0x7f39780fe840 msgr2=0x7f3978100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:30:59.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.028+0000 7f397e800700 1 -- 172.21.15.44:0/3212810104 shutdown_connections 2024-05-03T22:30:59.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.028+0000 7f397e800700 1 -- 172.21.15.44:0/3212810104 wait complete. 2024-05-03T22:30:59.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.030+0000 7f397e800700 1 Processor -- start 2024-05-03T22:30:59.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.030+0000 7f397e800700 1 -- start start 2024-05-03T22:30:59.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.030+0000 7f397e800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3978075870 0x7f39781a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:59.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.030+0000 7f397e800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f397810f5a0 con 0x7f3978075870 2024-05-03T22:30:59.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.031+0000 7f397d400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3978075870 0x7f39781a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:59.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.031+0000 7f397d400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3978075870 0x7f39781a0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55484/0 (socket says 172.21.15.44:55484) 2024-05-03T22:30:59.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.031+0000 7f397d400700 1 -- 172.21.15.44:0/1588140682 learned_addr learned my addr 172.21.15.44:0/1588140682 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:30:59.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.031+0000 7f397d400700 1 -- 172.21.15.44:0/1588140682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39781a0bd0 con 0x7f3978075870 2024-05-03T22:30:59.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.031+0000 7f397d400700 1 --2- 172.21.15.44:0/1588140682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3978075870 0x7f39781a0690 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f396c009fd0 tx=0x7f396c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:59.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.032+0000 7f3976000700 1 -- 172.21.15.44:0/1588140682 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f396c027070 con 0x7f3978075870 2024-05-03T22:30:59.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.032+0000 7f3976000700 1 -- 172.21.15.44:0/1588140682 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f396c022470 con 0x7f3978075870 2024-05-03T22:30:59.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.032+0000 7f3976000700 1 -- 172.21.15.44:0/1588140682 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f396c00f5d0 con 0x7f3978075870 2024-05-03T22:30:59.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.032+0000 7f397e800700 1 -- 172.21.15.44:0/1588140682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39781a0e60 con 0x7f3978075870 2024-05-03T22:30:59.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.032+0000 7f397e800700 1 -- 172.21.15.44:0/1588140682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f397819a810 con 0x7f3978075870 2024-05-03T22:30:59.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.033+0000 7f3976000700 1 -- 172.21.15.44:0/1588140682 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f396c02a070 con 0x7f3978075870 2024-05-03T22:30:59.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.033+0000 7f397e800700 1 -- 172.21.15.44:0/1588140682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3978076f20 con 0x7f3978075870 2024-05-03T22:30:59.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.034+0000 7f3976000700 1 --2- 172.21.15.44:0/1588140682 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f396003e510 0x7f39600409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:30:59.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.034+0000 7f3976000700 1 -- 172.21.15.44:0/1588140682 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f396c01e030 con 0x7f3978075870 2024-05-03T22:30:59.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.034+0000 7f397ca00700 1 --2- 172.21.15.44:0/1588140682 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f396003e510 0x7f39600409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:30:59.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.035+0000 7f397ca00700 1 --2- 172.21.15.44:0/1588140682 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f396003e510 0x7f39600409d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3964006fd0 tx=0x7f3964006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:30:59.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.040+0000 7f3976000700 1 -- 172.21.15.44:0/1588140682 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f396c013070 con 0x7f3978075870 2024-05-03T22:30:59.283 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:30:59.281+0000 7f397e800700 1 -- 172.21.15.44:0/1588140682 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f397819bd40 con 0x7f3978075870 2024-05-03T22:30:59.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:59 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:30:59.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:30:59 smithi044 ceph-mon[28604]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:00.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:00.255+0000 7f3976000700 1 -- 172.21.15.44:0/1588140682 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f396c00d340 con 0x7f3978075870 2024-05-03T22:31:00.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:00.260+0000 7f397e800700 1 -- 172.21.15.44:0/1588140682 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f396003e510 msgr2=0x7f39600409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:00.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:00.260+0000 7f397e800700 1 --2- 172.21.15.44:0/1588140682 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f396003e510 0x7f39600409d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3964006fd0 tx=0x7f3964006e40 comp rx=0 tx=0).stop 2024-05-03T22:31:00.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:00.260+0000 7f397e800700 1 -- 172.21.15.44:0/1588140682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3978075870 msgr2=0x7f39781a0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:00.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:00.260+0000 7f397e800700 1 --2- 172.21.15.44:0/1588140682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3978075870 0x7f39781a0690 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f396c009fd0 tx=0x7f396c0057f0 comp rx=0 tx=0).stop 2024-05-03T22:31:00.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:00.260+0000 7f397e800700 1 -- 172.21.15.44:0/1588140682 shutdown_connections 2024-05-03T22:31:00.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:00.260+0000 7f397e800700 1 --2- 172.21.15.44:0/1588140682 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f396003e510 0x7f39600409d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:00.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:00.260+0000 7f397e800700 1 --2- 172.21.15.44:0/1588140682 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3978075870 0x7f39781a0690 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:00.263 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:00.260+0000 7f397e800700 1 -- 172.21.15.44:0/1588140682 >> 172.21.15.44:0/1588140682 conn(0x7f39780fe840 msgr2=0x7f3978107010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:31:00.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:00.260+0000 7f397e800700 1 -- 172.21.15.44:0/1588140682 shutdown_connections 2024-05-03T22:31:00.264 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:00.261+0000 7f397e800700 1 -- 172.21.15.44:0/1588140682 wait complete. 2024-05-03T22:31:00.265 INFO:teuthology.orchestra.run.smithi044.stderr:adjusted tunables profile to default 2024-05-03T22:31:00.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:00 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1588140682' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-03T22:31:01.036 INFO:tasks.cephadm:Adding mon.a on smithi044 2024-05-03T22:31:01.036 INFO:tasks.cephadm:Adding mon.b on smithi060 2024-05-03T22:31:01.036 INFO:tasks.cephadm:Adding mon.c on smithi160 2024-05-03T22:31:01.036 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch apply mon '3;smithi044:172.21.15.44=a;smithi060:172.21.15.60=b;smithi160:172.21.15.160=c' 2024-05-03T22:31:01.466 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-03T22:31:01.584 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-03T22:31:01.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:01 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1588140682' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-03T22:31:01.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:01 smithi044 ceph-mon[28604]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T22:31:01.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:01 smithi044 ceph-mon[28604]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:04.352 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.349+0000 7f04b6a00700 1 -- 172.21.15.160:0/2113170511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04b0101780 msgr2=0x7f04b0101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:04.352 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.349+0000 7f04b6a00700 1 --2- 172.21.15.160:0/2113170511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04b0101780 0x7f04b0101ba0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009910 tx=0x7f04a0009c20 comp rx=0 tx=0).stop 2024-05-03T22:31:04.352 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.350+0000 7f04b6a00700 1 -- 172.21.15.160:0/2113170511 shutdown_connections 2024-05-03T22:31:04.353 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.350+0000 7f04b6a00700 1 --2- 172.21.15.160:0/2113170511 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04b0101780 0x7f04b0101ba0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:04.353 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.350+0000 7f04b6a00700 1 -- 172.21.15.160:0/2113170511 >> 172.21.15.160:0/2113170511 conn(0x7f04b00fd3a0 msgr2=0x7f04b00ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:31:04.353 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.350+0000 7f04b6a00700 1 -- 172.21.15.160:0/2113170511 shutdown_connections 2024-05-03T22:31:04.353 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.350+0000 7f04b6a00700 1 -- 172.21.15.160:0/2113170511 wait complete. 2024-05-03T22:31:04.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.351+0000 7f04b6a00700 1 Processor -- start 2024-05-03T22:31:04.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.351+0000 7f04b6a00700 1 -- start start 2024-05-03T22:31:04.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.351+0000 7f04b6a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04b0101780 0x7f04b019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:04.355 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.351+0000 7f04b6a00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f04b010b170 con 0x7f04b0101780 2024-05-03T22:31:04.355 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.352+0000 7f04afe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04b0101780 0x7f04b019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:04.355 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.352+0000 7f04afe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04b0101780 0x7f04b019a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.160:57896/0 (socket says 172.21.15.160:57896) 2024-05-03T22:31:04.355 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.352+0000 7f04afe00700 1 -- 172.21.15.160:0/2660138452 learned_addr learned my addr 172.21.15.160:0/2660138452 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-03T22:31:04.355 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.353+0000 7f04afe00700 1 -- 172.21.15.160:0/2660138452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b019acc0 con 0x7f04b0101780 2024-05-03T22:31:04.355 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.353+0000 7f04afe00700 1 --2- 172.21.15.160:0/2660138452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04b0101780 0x7f04b019a780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f04a0000c00 tx=0x7f04a0009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:31:04.356 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.354+0000 7f04acc00700 1 -- 172.21.15.160:0/2660138452 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04a0027070 con 0x7f04b0101780 2024-05-03T22:31:04.357 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.354+0000 7f04b6a00700 1 -- 172.21.15.160:0/2660138452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b019af50 con 0x7f04b0101780 2024-05-03T22:31:04.357 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.354+0000 7f04acc00700 1 -- 172.21.15.160:0/2660138452 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f04a0022470 con 0x7f04b0101780 2024-05-03T22:31:04.357 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.354+0000 7f04acc00700 1 -- 172.21.15.160:0/2660138452 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04a000f5f0 con 0x7f04b0101780 2024-05-03T22:31:04.357 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.355+0000 7f04b6a00700 1 -- 172.21.15.160:0/2660138452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b019dbf0 con 0x7f04b0101780 2024-05-03T22:31:04.358 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.356+0000 7f04b6a00700 1 -- 172.21.15.160:0/2660138452 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04b010b8f0 con 0x7f04b0101780 2024-05-03T22:31:04.359 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.357+0000 7f04acc00700 1 -- 172.21.15.160:0/2660138452 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f04a002a070 con 0x7f04b0101780 2024-05-03T22:31:04.359 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.357+0000 7f04acc00700 1 --2- 172.21.15.160:0/2660138452 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f049403e570 0x7f0494040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:04.359 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.357+0000 7f04acc00700 1 -- 172.21.15.160:0/2660138452 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f04a001e030 con 0x7f04b0101780 2024-05-03T22:31:04.360 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.358+0000 7f04af400700 1 --2- 172.21.15.160:0/2660138452 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f049403e570 0x7f0494040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:04.361 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.359+0000 7f04af400700 1 --2- 172.21.15.160:0/2660138452 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f049403e570 0x7f0494040a30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f049c006fd0 tx=0x7f049c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:31:04.376 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.374+0000 7f04acc00700 1 -- 172.21.15.160:0/2660138452 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f04a0031070 con 0x7f04b0101780 2024-05-03T22:31:04.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:04 smithi044 ceph-mon[28604]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:04.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:04 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:04.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:04 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:04.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:04 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:04.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:04 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:04.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:04 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi160", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:04.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:04 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:04.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:04 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:31:04.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:04 smithi044 ceph-mon[28604]: Updating smithi160:/etc/ceph/ceph.conf 2024-05-03T22:31:04.625 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.623+0000 7f04b6a00700 1 -- 172.21.15.160:0/2660138452 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi044:172.21.15.44=a;smithi060:172.21.15.60=b;smithi160:172.21.15.160=c", "target": ["mon-mgr", ""]}) -- 0x7f04b002e7a0 con 0x7f049403e570 2024-05-03T22:31:04.640 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.638+0000 7f04acc00700 1 -- 172.21.15.160:0/2660138452 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f04b002e7a0 con 0x7f049403e570 2024-05-03T22:31:04.641 INFO:teuthology.orchestra.run.smithi160.stdout:Scheduled mon update... 2024-05-03T22:31:04.644 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.641+0000 7f04b6a00700 1 -- 172.21.15.160:0/2660138452 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f049403e570 msgr2=0x7f0494040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:04.644 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.641+0000 7f04b6a00700 1 --2- 172.21.15.160:0/2660138452 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f049403e570 0x7f0494040a30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f049c006fd0 tx=0x7f049c006e40 comp rx=0 tx=0).stop 2024-05-03T22:31:04.644 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.641+0000 7f04b6a00700 1 -- 172.21.15.160:0/2660138452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04b0101780 msgr2=0x7f04b019a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:04.644 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.641+0000 7f04b6a00700 1 --2- 172.21.15.160:0/2660138452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04b0101780 0x7f04b019a780 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f04a0000c00 tx=0x7f04a0009f10 comp rx=0 tx=0).stop 2024-05-03T22:31:04.644 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.642+0000 7f04b6a00700 1 -- 172.21.15.160:0/2660138452 shutdown_connections 2024-05-03T22:31:04.644 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.642+0000 7f04b6a00700 1 --2- 172.21.15.160:0/2660138452 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f049403e570 0x7f0494040a30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:04.644 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.642+0000 7f04b6a00700 1 --2- 172.21.15.160:0/2660138452 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f04b0101780 0x7f04b019a780 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:04.644 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.642+0000 7f04b6a00700 1 -- 172.21.15.160:0/2660138452 >> 172.21.15.160:0/2660138452 conn(0x7f04b00fd3a0 msgr2=0x7f04b00fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:31:04.644 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.642+0000 7f04b6a00700 1 -- 172.21.15.160:0/2660138452 shutdown_connections 2024-05-03T22:31:04.644 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:04.642+0000 7f04b6a00700 1 -- 172.21.15.160:0/2660138452 wait complete. 2024-05-03T22:31:05.458 DEBUG:teuthology.orchestra.run.smithi060:mon.b> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mon.b.service 2024-05-03T22:31:05.466 DEBUG:teuthology.orchestra.run.smithi160:mon.c> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mon.c.service 2024-05-03T22:31:05.471 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-03T22:31:05.471 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-03T22:31:05.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:05 smithi044 ceph-mon[28604]: Updating smithi160:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:31:05.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:05.904 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:31:06.404 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:06 smithi044 ceph-mon[28604]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:31:06.404 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:06 smithi044 ceph-mon[28604]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi044:172.21.15.44=a;smithi060:172.21.15.60=b;smithi160:172.21.15.160=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:31:06.404 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:06 smithi044 ceph-mon[28604]: Saving service mon spec with placement smithi044:172.21.15.44=a;smithi060:172.21.15.60=b;smithi160:172.21.15.160=c;count:3 2024-05-03T22:31:06.404 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:06 smithi044 ceph-mon[28604]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:06.404 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:06 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:06.404 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:06 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:06.404 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:06 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:06.404 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:06 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:31:06.404 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:06 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:07.431 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:07 smithi044 ceph-mon[28604]: Updating smithi160:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T22:31:07.431 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:07 smithi044 ceph-mon[28604]: Deploying daemon mon.c on smithi160 2024-05-03T22:31:08.205 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.189+0000 7f0321800700 1 -- 172.21.15.160:0/3937902144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c103110 msgr2=0x7f031c1034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:08.206 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.189+0000 7f0321800700 1 --2- 172.21.15.160:0/3937902144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c103110 0x7f031c1034f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f030c009910 tx=0x7f030c009c20 comp rx=0 tx=0).stop 2024-05-03T22:31:08.206 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.190+0000 7f0321800700 1 -- 172.21.15.160:0/3937902144 shutdown_connections 2024-05-03T22:31:08.206 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.190+0000 7f0321800700 1 --2- 172.21.15.160:0/3937902144 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c103110 0x7f031c1034f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:08.206 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.190+0000 7f0321800700 1 -- 172.21.15.160:0/3937902144 >> 172.21.15.160:0/3937902144 conn(0x7f031c0fe9e0 msgr2=0x7f031c100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:31:08.206 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.190+0000 7f0321800700 1 -- 172.21.15.160:0/3937902144 shutdown_connections 2024-05-03T22:31:08.206 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.190+0000 7f0321800700 1 -- 172.21.15.160:0/3937902144 wait complete. 2024-05-03T22:31:08.206 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.191+0000 7f0321800700 1 Processor -- start 2024-05-03T22:31:08.206 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.191+0000 7f0321800700 1 -- start start 2024-05-03T22:31:08.206 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.192+0000 7f0321800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c103110 0x7f031c0757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:08.206 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.192+0000 7f0321800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f031c10d4d0 con 0x7f031c103110 2024-05-03T22:31:08.207 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.192+0000 7f031aa00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c103110 0x7f031c0757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:08.207 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.192+0000 7f031aa00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c103110 0x7f031c0757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.160:33998/0 (socket says 172.21.15.160:33998) 2024-05-03T22:31:08.207 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.192+0000 7f031aa00700 1 -- 172.21.15.160:0/429382875 learned_addr learned my addr 172.21.15.160:0/429382875 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-03T22:31:08.207 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.193+0000 7f031aa00700 1 -- 172.21.15.160:0/429382875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f031c077690 con 0x7f031c103110 2024-05-03T22:31:08.207 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.193+0000 7f031aa00700 1 --2- 172.21.15.160:0/429382875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c103110 0x7f031c0757a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f030c005720 tx=0x7f030c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:31:08.207 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.194+0000 7f0313400700 1 -- 172.21.15.160:0/429382875 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f030c027070 con 0x7f031c103110 2024-05-03T22:31:08.207 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.194+0000 7f0321800700 1 -- 172.21.15.160:0/429382875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f031c075d40 con 0x7f031c103110 2024-05-03T22:31:08.207 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.194+0000 7f0313400700 1 -- 172.21.15.160:0/429382875 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f030c022470 con 0x7f031c103110 2024-05-03T22:31:08.207 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.194+0000 7f0313400700 1 -- 172.21.15.160:0/429382875 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f030c00f5d0 con 0x7f031c103110 2024-05-03T22:31:08.207 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.194+0000 7f0321800700 1 -- 172.21.15.160:0/429382875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f031c076200 con 0x7f031c103110 2024-05-03T22:31:08.207 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.195+0000 7f0321800700 1 -- 172.21.15.160:0/429382875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f031c1045f0 con 0x7f031c103110 2024-05-03T22:31:08.207 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.196+0000 7f0313400700 1 -- 172.21.15.160:0/429382875 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f030c02a070 con 0x7f031c103110 2024-05-03T22:31:08.207 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.196+0000 7f0313400700 1 --2- 172.21.15.160:0/429382875 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f030003e510 0x7f03000409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:08.207 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.196+0000 7f0313400700 1 -- 172.21.15.160:0/429382875 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f030c01e030 con 0x7f031c103110 2024-05-03T22:31:08.207 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.197+0000 7f031a000700 1 --2- 172.21.15.160:0/429382875 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f030003e510 0x7f03000409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:08.207 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.198+0000 7f031a000700 1 --2- 172.21.15.160:0/429382875 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f030003e510 0x7f03000409d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0308006fd0 tx=0x7f0308006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:31:08.214 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.213+0000 7f0313400700 1 -- 172.21.15.160:0/429382875 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f030c013070 con 0x7f031c103110 2024-05-03T22:31:08.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:08 smithi044 ceph-mon[28604]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:08.555 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.553+0000 7f0321800700 1 -- 172.21.15.160:0/429382875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f031c076d70 con 0x7f031c103110 2024-05-03T22:31:08.557 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.555+0000 7f0313400700 1 -- 172.21.15.160:0/429382875 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f030c017d10 con 0x7f031c103110 2024-05-03T22:31:08.557 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:31:08.557 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":1,"fsid":"5b0efdca-099c-11ef-bc97-c7b262605968","modified":"2024-05-03T22:28:45.098903Z","created":"2024-05-03T22:28:45.098903Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-03T22:31:08.561 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.558+0000 7f0321800700 1 -- 172.21.15.160:0/429382875 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f030003e510 msgr2=0x7f03000409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:08.561 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.558+0000 7f0321800700 1 --2- 172.21.15.160:0/429382875 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f030003e510 0x7f03000409d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0308006fd0 tx=0x7f0308006e40 comp rx=0 tx=0).stop 2024-05-03T22:31:08.561 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.558+0000 7f0321800700 1 -- 172.21.15.160:0/429382875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c103110 msgr2=0x7f031c0757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:08.561 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.558+0000 7f0321800700 1 --2- 172.21.15.160:0/429382875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c103110 0x7f031c0757a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f030c005720 tx=0x7f030c005800 comp rx=0 tx=0).stop 2024-05-03T22:31:08.561 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.559+0000 7f0321800700 1 -- 172.21.15.160:0/429382875 shutdown_connections 2024-05-03T22:31:08.561 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.559+0000 7f0321800700 1 --2- 172.21.15.160:0/429382875 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f030003e510 0x7f03000409d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:08.561 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.559+0000 7f0321800700 1 --2- 172.21.15.160:0/429382875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f031c103110 0x7f031c0757a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:08.561 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.559+0000 7f0321800700 1 -- 172.21.15.160:0/429382875 >> 172.21.15.160:0/429382875 conn(0x7f031c0fe9e0 msgr2=0x7f031c104ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:31:08.561 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.559+0000 7f0321800700 1 -- 172.21.15.160:0/429382875 shutdown_connections 2024-05-03T22:31:08.561 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:08.559+0000 7f0321800700 1 -- 172.21.15.160:0/429382875 wait complete. 2024-05-03T22:31:08.562 INFO:teuthology.orchestra.run.smithi160.stderr:dumped monmap epoch 1 2024-05-03T22:31:09.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:09 smithi044 ceph-mon[28604]: from='client.? 172.21.15.160:0/429382875' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:31:10.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:10 smithi044 ceph-mon[28604]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:11.344 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-03T22:31:11.344 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-03T22:31:11.913 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:31:12.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:12 smithi044 ceph-mon[28604]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:13.469 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 podman[32490]: 2024-05-03 22:31:13.222464286 +0000 UTC m=+0.042911621 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:31:14.132 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 podman[32490]: 2024-05-03 22:31:13.813335849 +0000 UTC m=+0.633783228 container init bfea2da91fd4ba74b4292148e6948a85d582dda2c3095b5f0b590f6fab226f5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-03T22:31:14.132 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 podman[32490]: 2024-05-03 22:31:13.823778555 +0000 UTC m=+0.644225891 container start bfea2da91fd4ba74b4292148e6948a85d582dda2c3095b5f0b590f6fab226f5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-c, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-03T22:31:14.132 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: set uid:gid to 167:167 (ceph:ceph) 2024-05-03T22:31:14.132 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev), process ceph-mon, pid 2 2024-05-03T22:31:14.133 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pidfile_write: ignore empty --pid-file 2024-05-03T22:31:14.133 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: load: jerasure load: lrc 2024-05-03T22:31:14.133 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: RocksDB version: 7.9.2 2024-05-03T22:31:14.133 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Git sha 0 2024-05-03T22:31:14.133 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Compile date 2024-05-01 21:12:03 2024-05-03T22:31:14.133 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: DB SUMMARY 2024-05-03T22:31:14.133 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: DB Session ID: 9W8OMAAQ8UUF0SQG3EHO 2024-05-03T22:31:14.133 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: CURRENT file: CURRENT 2024-05-03T22:31:14.133 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: IDENTITY file: IDENTITY 2024-05-03T22:31:14.133 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-03T22:31:14.133 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-05-03T22:31:14.133 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-05-03T22:31:14.133 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.error_if_exists: 0 2024-05-03T22:31:14.133 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.create_if_missing: 0 2024-05-03T22:31:14.133 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.paranoid_checks: 1 2024-05-03T22:31:14.134 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-03T22:31:14.134 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-03T22:31:14.134 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-03T22:31:14.134 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.env: 0x55b966dfacc0 2024-05-03T22:31:14.134 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.fs: PosixFileSystem 2024-05-03T22:31:14.134 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.info_log: 0x55b969985de0 2024-05-03T22:31:14.134 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_file_opening_threads: 16 2024-05-03T22:31:14.134 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.statistics: (nil) 2024-05-03T22:31:14.135 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.use_fsync: 0 2024-05-03T22:31:14.135 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_log_file_size: 0 2024-05-03T22:31:14.135 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-03T22:31:14.135 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-03T22:31:14.135 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.keep_log_file_num: 1000 2024-05-03T22:31:14.135 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.recycle_log_file_num: 0 2024-05-03T22:31:14.135 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.allow_fallocate: 1 2024-05-03T22:31:14.135 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.allow_mmap_reads: 0 2024-05-03T22:31:14.135 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.allow_mmap_writes: 0 2024-05-03T22:31:14.135 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.use_direct_reads: 0 2024-05-03T22:31:14.135 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-03T22:31:14.135 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.create_missing_column_families: 0 2024-05-03T22:31:14.136 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.db_log_dir: 2024-05-03T22:31:14.136 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.wal_dir: 2024-05-03T22:31:14.136 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-03T22:31:14.136 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-03T22:31:14.136 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-03T22:31:14.136 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-03T22:31:14.136 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-03T22:31:14.136 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-03T22:31:14.136 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.advise_random_on_open: 1 2024-05-03T22:31:14.136 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.db_write_buffer_size: 0 2024-05-03T22:31:14.136 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.write_buffer_manager: 0x55b9699570e0 2024-05-03T22:31:14.136 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-03T22:31:14.136 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-03T22:31:14.137 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-03T22:31:14.137 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.rate_limiter: (nil) 2024-05-03T22:31:14.137 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-03T22:31:14.137 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.wal_recovery_mode: 2 2024-05-03T22:31:14.137 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.enable_thread_tracking: 0 2024-05-03T22:31:14.137 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.enable_pipelined_write: 0 2024-05-03T22:31:14.137 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.unordered_write: 0 2024-05-03T22:31:14.137 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-03T22:31:14.137 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-03T22:31:14.137 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-03T22:31:14.137 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-03T22:31:14.137 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.row_cache: None 2024-05-03T22:31:14.137 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.wal_filter: None 2024-05-03T22:31:14.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-03T22:31:14.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.allow_ingest_behind: 0 2024-05-03T22:31:14.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.two_write_queues: 0 2024-05-03T22:31:14.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.manual_wal_flush: 0 2024-05-03T22:31:14.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.wal_compression: 0 2024-05-03T22:31:14.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.atomic_flush: 0 2024-05-03T22:31:14.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-03T22:31:14.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-03T22:31:14.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-03T22:31:14.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.log_readahead_size: 0 2024-05-03T22:31:14.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-03T22:31:14.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.best_efforts_recovery: 0 2024-05-03T22:31:14.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-03T22:31:14.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-03T22:31:14.138 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.allow_data_in_errors: 0 2024-05-03T22:31:14.139 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.db_host_id: __hostname__ 2024-05-03T22:31:14.139 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-03T22:31:14.139 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_background_jobs: 2 2024-05-03T22:31:14.139 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_background_compactions: -1 2024-05-03T22:31:14.139 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_subcompactions: 1 2024-05-03T22:31:14.139 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-03T22:31:14.139 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-03T22:31:14.139 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-03T22:31:14.139 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_total_wal_size: 0 2024-05-03T22:31:14.139 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-03T22:31:14.139 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-03T22:31:14.139 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-03T22:31:14.139 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-03T22:31:14.140 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_open_files: -1 2024-05-03T22:31:14.140 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.bytes_per_sync: 0 2024-05-03T22:31:14.140 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-03T22:31:14.140 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-03T22:31:14.140 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compaction_readahead_size: 0 2024-05-03T22:31:14.140 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_background_flushes: -1 2024-05-03T22:31:14.140 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Compression algorithms supported: 2024-05-03T22:31:14.140 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-03T22:31:14.140 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: kZSTD supported: 0 2024-05-03T22:31:14.140 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: kXpressCompression supported: 0 2024-05-03T22:31:14.140 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: kLZ4HCCompression supported: 1 2024-05-03T22:31:14.140 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: kZlibCompression supported: 1 2024-05-03T22:31:14.140 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: kSnappyCompression supported: 1 2024-05-03T22:31:14.142 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: kLZ4Compression supported: 1 2024-05-03T22:31:14.142 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: kBZip2Compression supported: 0 2024-05-03T22:31:14.142 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-03T22:31:14.142 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-03T22:31:14.142 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-05-03T22:31:14.142 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-03T22:31:14.142 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-03T22:31:14.143 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.merge_operator: 2024-05-03T22:31:14.143 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compaction_filter: None 2024-05-03T22:31:14.143 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compaction_filter_factory: None 2024-05-03T22:31:14.143 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.sst_partitioner_factory: None 2024-05-03T22:31:14.143 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-03T22:31:14.143 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-03T22:31:14.143 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b969985fa0) 2024-05-03T22:31:14.143 INFO:journalctl@ceph.mon.c.smithi160.stdout: cache_index_and_filter_blocks: 1 2024-05-03T22:31:14.143 INFO:journalctl@ceph.mon.c.smithi160.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-03T22:31:14.143 INFO:journalctl@ceph.mon.c.smithi160.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-03T22:31:14.143 INFO:journalctl@ceph.mon.c.smithi160.stdout: pin_top_level_index_and_filter: 1 2024-05-03T22:31:14.143 INFO:journalctl@ceph.mon.c.smithi160.stdout: index_type: 0 2024-05-03T22:31:14.143 INFO:journalctl@ceph.mon.c.smithi160.stdout: data_block_index_type: 0 2024-05-03T22:31:14.143 INFO:journalctl@ceph.mon.c.smithi160.stdout: index_shortening: 1 2024-05-03T22:31:14.144 INFO:journalctl@ceph.mon.c.smithi160.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-03T22:31:14.144 INFO:journalctl@ceph.mon.c.smithi160.stdout: checksum: 4 2024-05-03T22:31:14.144 INFO:journalctl@ceph.mon.c.smithi160.stdout: no_block_cache: 0 2024-05-03T22:31:14.144 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_cache: 0x55b9699891f0 2024-05-03T22:31:14.144 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_cache_name: BinnedLRUCache 2024-05-03T22:31:14.144 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_cache_options: 2024-05-03T22:31:14.144 INFO:journalctl@ceph.mon.c.smithi160.stdout: capacity : 536870912 2024-05-03T22:31:14.144 INFO:journalctl@ceph.mon.c.smithi160.stdout: num_shard_bits : 4 2024-05-03T22:31:14.144 INFO:journalctl@ceph.mon.c.smithi160.stdout: strict_capacity_limit : 0 2024-05-03T22:31:14.144 INFO:journalctl@ceph.mon.c.smithi160.stdout: high_pri_pool_ratio: 0.000 2024-05-03T22:31:14.144 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_cache_compressed: (nil) 2024-05-03T22:31:14.144 INFO:journalctl@ceph.mon.c.smithi160.stdout: persistent_cache: (nil) 2024-05-03T22:31:14.144 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_size: 4096 2024-05-03T22:31:14.144 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_size_deviation: 10 2024-05-03T22:31:14.145 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_restart_interval: 16 2024-05-03T22:31:14.145 INFO:journalctl@ceph.mon.c.smithi160.stdout: index_block_restart_interval: 1 2024-05-03T22:31:14.145 INFO:journalctl@ceph.mon.c.smithi160.stdout: metadata_block_size: 4096 2024-05-03T22:31:14.145 INFO:journalctl@ceph.mon.c.smithi160.stdout: partition_filters: 0 2024-05-03T22:31:14.145 INFO:journalctl@ceph.mon.c.smithi160.stdout: use_delta_encoding: 1 2024-05-03T22:31:14.145 INFO:journalctl@ceph.mon.c.smithi160.stdout: filter_policy: bloomfilter 2024-05-03T22:31:14.145 INFO:journalctl@ceph.mon.c.smithi160.stdout: whole_key_filtering: 1 2024-05-03T22:31:14.145 INFO:journalctl@ceph.mon.c.smithi160.stdout: verify_compression: 0 2024-05-03T22:31:14.145 INFO:journalctl@ceph.mon.c.smithi160.stdout: read_amp_bytes_per_bit: 0 2024-05-03T22:31:14.145 INFO:journalctl@ceph.mon.c.smithi160.stdout: format_version: 5 2024-05-03T22:31:14.145 INFO:journalctl@ceph.mon.c.smithi160.stdout: enable_index_compression: 1 2024-05-03T22:31:14.145 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_align: 0 2024-05-03T22:31:14.145 INFO:journalctl@ceph.mon.c.smithi160.stdout: max_auto_readahead_size: 262144 2024-05-03T22:31:14.145 INFO:journalctl@ceph.mon.c.smithi160.stdout: prepopulate_block_cache: 0 2024-05-03T22:31:14.146 INFO:journalctl@ceph.mon.c.smithi160.stdout: initial_auto_readahead_size: 8192 2024-05-03T22:31:14.146 INFO:journalctl@ceph.mon.c.smithi160.stdout: num_file_reads_for_auto_readahead: 2 2024-05-03T22:31:14.146 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.write_buffer_size: 33554432 2024-05-03T22:31:14.146 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_write_buffer_number: 2 2024-05-03T22:31:14.146 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compression: NoCompression 2024-05-03T22:31:14.146 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.bottommost_compression: Disabled 2024-05-03T22:31:14.146 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.prefix_extractor: nullptr 2024-05-03T22:31:14.146 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-03T22:31:14.146 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.num_levels: 7 2024-05-03T22:31:14.146 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-03T22:31:14.146 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-03T22:31:14.146 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-03T22:31:14.146 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-03T22:31:14.147 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-03T22:31:14.147 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-03T22:31:14.147 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-03T22:31:14.147 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-03T22:31:14.147 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-03T22:31:14.147 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-03T22:31:14.147 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-03T22:31:14.147 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-03T22:31:14.147 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-03T22:31:14.147 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compression_opts.level: 32767 2024-05-03T22:31:14.147 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compression_opts.strategy: 0 2024-05-03T22:31:14.147 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-03T22:31:14.147 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-03T22:31:14.148 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-03T22:31:14.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-03T22:31:14.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compression_opts.enabled: false 2024-05-03T22:31:14.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-03T22:31:14.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-03T22:31:14.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-03T22:31:14.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-03T22:31:14.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.target_file_size_base: 67108864 2024-05-03T22:31:14.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-03T22:31:14.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-03T22:31:14.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-03T22:31:14.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-03T22:31:14.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-03T22:31:14.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-03T22:31:14.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-03T22:31:14.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-03T22:31:14.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-03T22:31:14.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-03T22:31:14.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-03T22:31:14.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-03T22:31:14.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-03T22:31:14.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-03T22:31:14.151 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.arena_block_size: 1048576 2024-05-03T22:31:14.151 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-03T22:31:14.151 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-03T22:31:14.151 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.disable_auto_compactions: 0 2024-05-03T22:31:14.151 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-03T22:31:14.151 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-03T22:31:14.151 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-03T22:31:14.151 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-03T22:31:14.151 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-03T22:31:14.151 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-03T22:31:14.151 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-03T22:31:14.152 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-03T22:31:14.152 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-03T22:31:14.152 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-03T22:31:14.152 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-03T22:31:14.152 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.inplace_update_support: 0 2024-05-03T22:31:14.152 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-03T22:31:14.152 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-03T22:31:14.152 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-03T22:31:14.152 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-03T22:31:14.152 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.bloom_locality: 0 2024-05-03T22:31:14.152 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.max_successive_merges: 0 2024-05-03T22:31:14.152 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-03T22:31:14.152 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.paranoid_file_checks: 0 2024-05-03T22:31:14.152 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.force_consistency_checks: 1 2024-05-03T22:31:14.152 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.report_bg_io_stats: 0 2024-05-03T22:31:14.153 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.ttl: 2592000 2024-05-03T22:31:14.153 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-03T22:31:14.153 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-03T22:31:14.153 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-03T22:31:14.153 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.enable_blob_files: false 2024-05-03T22:31:14.153 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.min_blob_size: 0 2024-05-03T22:31:14.153 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.blob_file_size: 268435456 2024-05-03T22:31:14.153 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-03T22:31:14.153 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-03T22:31:14.153 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-03T22:31:14.153 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-03T22:31:14.153 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-03T22:31:14.154 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.blob_file_starting_level: 0 2024-05-03T22:31:14.154 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-03T22:31:14.154 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-03T22:31:14.154 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-03T22:31:14.154 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ab5a0235-02dd-44b5-b8ae-e2a75202407a 2024-05-03T22:31:14.154 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714775473881053, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-03T22:31:14.154 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-03T22:31:14.154 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714775473881963, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714775473, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ab5a0235-02dd-44b5-b8ae-e2a75202407a", "db_session_id": "9W8OMAAQ8UUF0SQG3EHO", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-03T22:31:14.154 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714775473882242, "job": 1, "event": "recovery_finished"} 2024-05-03T22:31:14.154 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-03T22:31:14.154 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-03T22:31:14.154 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55b969aa6000 2024-05-03T22:31:14.154 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: DB pointer 0x55b969a92000 2024-05-03T22:31:14.155 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-03T22:31:14.155 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-03T22:31:14.155 INFO:journalctl@ceph.mon.c.smithi160.stdout: ** DB Stats ** 2024-05-03T22:31:14.155 INFO:journalctl@ceph.mon.c.smithi160.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-03T22:31:14.155 INFO:journalctl@ceph.mon.c.smithi160.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-03T22:31:14.155 INFO:journalctl@ceph.mon.c.smithi160.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-03T22:31:14.155 INFO:journalctl@ceph.mon.c.smithi160.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-03T22:31:14.155 INFO:journalctl@ceph.mon.c.smithi160.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-03T22:31:14.155 INFO:journalctl@ceph.mon.c.smithi160.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-03T22:31:14.155 INFO:journalctl@ceph.mon.c.smithi160.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-03T22:31:14.155 INFO:journalctl@ceph.mon.c.smithi160.stdout: 2024-05-03T22:31:14.155 INFO:journalctl@ceph.mon.c.smithi160.stdout: ** Compaction Stats [default] ** 2024-05-03T22:31:14.155 INFO:journalctl@ceph.mon.c.smithi160.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-03T22:31:14.155 INFO:journalctl@ceph.mon.c.smithi160.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-03T22:31:14.156 INFO:journalctl@ceph.mon.c.smithi160.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:31:14.156 INFO:journalctl@ceph.mon.c.smithi160.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:31:14.156 INFO:journalctl@ceph.mon.c.smithi160.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:31:14.156 INFO:journalctl@ceph.mon.c.smithi160.stdout: 2024-05-03T22:31:14.156 INFO:journalctl@ceph.mon.c.smithi160.stdout: ** Compaction Stats [default] ** 2024-05-03T22:31:14.156 INFO:journalctl@ceph.mon.c.smithi160.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-03T22:31:14.156 INFO:journalctl@ceph.mon.c.smithi160.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-03T22:31:14.156 INFO:journalctl@ceph.mon.c.smithi160.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:31:14.156 INFO:journalctl@ceph.mon.c.smithi160.stdout: 2024-05-03T22:31:14.156 INFO:journalctl@ceph.mon.c.smithi160.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-03T22:31:14.156 INFO:journalctl@ceph.mon.c.smithi160.stdout: 2024-05-03T22:31:14.156 INFO:journalctl@ceph.mon.c.smithi160.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-03T22:31:14.156 INFO:journalctl@ceph.mon.c.smithi160.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-03T22:31:14.156 INFO:journalctl@ceph.mon.c.smithi160.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-03T22:31:14.156 INFO:journalctl@ceph.mon.c.smithi160.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-03T22:31:14.157 INFO:journalctl@ceph.mon.c.smithi160.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-03T22:31:14.157 INFO:journalctl@ceph.mon.c.smithi160.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-03T22:31:14.157 INFO:journalctl@ceph.mon.c.smithi160.stdout: Cumulative compaction: 0.00 GB write, 0.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-03T22:31:14.157 INFO:journalctl@ceph.mon.c.smithi160.stdout: Interval compaction: 0.00 GB write, 0.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-03T22:31:14.157 INFO:journalctl@ceph.mon.c.smithi160.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-03T22:31:14.157 INFO:journalctl@ceph.mon.c.smithi160.stdout: Block cache BinnedLRUCache@0x55b9699891f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-05-03T22:31:14.157 INFO:journalctl@ceph.mon.c.smithi160.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-03T22:31:14.157 INFO:journalctl@ceph.mon.c.smithi160.stdout: 2024-05-03T22:31:14.157 INFO:journalctl@ceph.mon.c.smithi160.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-03T22:31:14.157 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-05-03T22:31:14.157 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: using public_addr v2:172.21.15.160:0/0 -> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-05-03T22:31:14.157 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: starting mon.c rank -1 at public addrs [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] at bind addrs [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:31:14.157 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: mon.c@-1(???) e0 preinit fsid 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:31:14.157 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: mon.c@-1(synchronizing).mds e1 new map 2024-05-03T22:31:14.157 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: mon.c@-1(synchronizing).mds e1 print_map 2024-05-03T22:31:14.157 INFO:journalctl@ceph.mon.c.smithi160.stdout: e1 2024-05-03T22:31:14.158 INFO:journalctl@ceph.mon.c.smithi160.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-03T22:31:14.158 INFO:journalctl@ceph.mon.c.smithi160.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-03T22:31:14.158 INFO:journalctl@ceph.mon.c.smithi160.stdout: legacy client fscid: -1 2024-05-03T22:31:14.158 INFO:journalctl@ceph.mon.c.smithi160.stdout: 2024-05-03T22:31:14.158 INFO:journalctl@ceph.mon.c.smithi160.stdout: No filesystems configured 2024-05-03T22:31:14.158 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-03T22:31:14.158 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-03T22:31:14.158 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-03T22:31:14.158 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-03T22:31:14.158 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-03T22:31:14.158 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-03T22:31:14.158 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-03T22:31:14.158 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T22:31:14.158 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T22:31:14.158 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T22:31:14.159 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi060", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:31:14.159 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.159 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: Deploying cephadm binary to smithi060 2024-05-03T22:31:14.159 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.159 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.159 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.159 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.159 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: Added host smithi060 2024-05-03T22:31:14.159 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:31:14.159 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.159 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.159 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.159 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:31:14.159 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.159 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.160 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.160 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi160", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:31:14.160 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.160 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: Deploying cephadm binary to smithi160 2024-05-03T22:31:14.160 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.160 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.160 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.160 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.160 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:14.160 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:14.161 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:31:14.161 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: Updating smithi060:/etc/ceph/ceph.conf 2024-05-03T22:31:14.161 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.161 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.161 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: Updating smithi060:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:31:14.161 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.161 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:31:14.161 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: Added host smithi160 2024-05-03T22:31:14.162 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.162 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: Updating smithi060:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T22:31:14.162 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.162 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.162 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.162 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:31:14.163 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.163 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.163 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:31:14.163 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.163 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.163 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.164 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.164 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1588140682' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-03T22:31:14.164 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1588140682' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-03T22:31:14.164 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T22:31:14.164 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.165 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.165 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.165 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.165 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.165 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.165 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi160", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:14.166 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:14.166 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:31:14.166 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: Updating smithi160:/etc/ceph/ceph.conf 2024-05-03T22:31:14.166 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: Updating smithi160:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:31:14.166 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.166 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:31:14.167 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi044:172.21.15.44=a;smithi060:172.21.15.60=b;smithi160:172.21.15.160=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:31:14.167 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: Saving service mon spec with placement smithi044:172.21.15.44=a;smithi060:172.21.15.60=b;smithi160:172.21.15.160=c;count:3 2024-05-03T22:31:14.167 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.167 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.167 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.167 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:14.167 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:31:14.167 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:14.168 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: Updating smithi160:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T22:31:14.168 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: Deploying daemon mon.c on smithi160 2024-05-03T22:31:14.168 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.169 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: from='client.? 172.21.15.160:0/429382875' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:31:14.169 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.169 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:14.169 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:13 smithi160 ceph-mon[32531]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-03T22:31:14.169 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:14 smithi160 bash[32490]: bfea2da91fd4ba74b4292148e6948a85d582dda2c3095b5f0b590f6fab226f5f 2024-05-03T22:31:14.169 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:14 smithi160 systemd[1]: Started Ceph mon.c for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:31:19.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:31:19.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: mon.a calling monitor election 2024-05-03T22:31:19.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:19.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:19.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:19.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:19.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: mon.c calling monitor election 2024-05-03T22:31:19.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:19.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:19.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:19.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:19.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-03T22:31:19.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: monmap epoch 2 2024-05-03T22:31:19.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: fsid 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:31:19.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: last_changed 2024-05-03T22:31:13.934928+0000 2024-05-03T22:31:19.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: created 2024-05-03T22:28:45.098903+0000 2024-05-03T22:31:19.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: min_mon_release 19 (squid) 2024-05-03T22:31:19.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: election_strategy: 1 2024-05-03T22:31:19.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-05-03T22:31:19.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-05-03T22:31:19.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: fsmap 2024-05-03T22:31:19.505 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T22:31:19.505 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: mgrmap e13: x(active, since 70s) 2024-05-03T22:31:19.505 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: overall HEALTH_OK 2024-05-03T22:31:19.505 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:19.505 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:19 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:19.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:31:19.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: mon.a calling monitor election 2024-05-03T22:31:19.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:19.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:19.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:19.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:19.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: mon.c calling monitor election 2024-05-03T22:31:19.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:19.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:19.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:19.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:19.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-03T22:31:19.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: monmap epoch 2 2024-05-03T22:31:19.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: fsid 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:31:19.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: last_changed 2024-05-03T22:31:13.934928+0000 2024-05-03T22:31:19.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: created 2024-05-03T22:28:45.098903+0000 2024-05-03T22:31:19.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: min_mon_release 19 (squid) 2024-05-03T22:31:19.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: election_strategy: 1 2024-05-03T22:31:19.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-05-03T22:31:19.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-05-03T22:31:19.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: fsmap 2024-05-03T22:31:19.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T22:31:19.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: mgrmap e13: x(active, since 70s) 2024-05-03T22:31:19.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: overall HEALTH_OK 2024-05-03T22:31:19.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:19.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:19 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:20.075 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.071+0000 7faa04200700 1 -- 172.21.15.160:0/1098145695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9e4005cc0 msgr2=0x7fa9e4008150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:20.075 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.071+0000 7faa04200700 1 --2- 172.21.15.160:0/1098145695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9e4005cc0 0x7fa9e4008150 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc076cd0 tx=0x7fa9f000ff20 comp rx=0 tx=0).stop 2024-05-03T22:31:20.075 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.071+0000 7faa04200700 1 -- 172.21.15.160:0/1098145695 shutdown_connections 2024-05-03T22:31:20.075 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.071+0000 7faa04200700 1 --2- 172.21.15.160:0/1098145695 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9e4005cc0 0x7fa9e4008150 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:20.075 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.071+0000 7faa04200700 1 -- 172.21.15.160:0/1098145695 >> 172.21.15.160:0/1098145695 conn(0x7fa9fc0fea70 msgr2=0x7fa9fc100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:31:20.075 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.071+0000 7faa04200700 1 -- 172.21.15.160:0/1098145695 shutdown_connections 2024-05-03T22:31:20.075 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.071+0000 7faa04200700 1 -- 172.21.15.160:0/1098145695 wait complete. 2024-05-03T22:31:20.076 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.074+0000 7faa04200700 1 Processor -- start 2024-05-03T22:31:20.076 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.074+0000 7faa04200700 1 -- start start 2024-05-03T22:31:20.078 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.075+0000 7faa04200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9e4005cc0 0x7fa9fc19f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:20.078 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.075+0000 7faa04200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9fc19f720 0x7fa9fc1a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:20.078 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.076+0000 7faa04200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa9fc1115e0 con 0x7fa9e4005cc0 2024-05-03T22:31:20.078 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.076+0000 7faa04200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa9fc111460 con 0x7fa9fc19f720 2024-05-03T22:31:20.078 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.076+0000 7faa01800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9e4005cc0 0x7fa9fc19f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:20.078 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.076+0000 7faa01800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9e4005cc0 0x7fa9fc19f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.160:35058/0 (socket says 172.21.15.160:35058) 2024-05-03T22:31:20.078 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.076+0000 7faa01800700 1 -- 172.21.15.160:0/2381750884 learned_addr learned my addr 172.21.15.160:0/2381750884 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-03T22:31:20.079 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.077+0000 7faa00e00700 1 --2- 172.21.15.160:0/2381750884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9fc19f720 0x7fa9fc1a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:20.079 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.077+0000 7faa01800700 1 -- 172.21.15.160:0/2381750884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9fc19f720 msgr2=0x7fa9fc1a3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:20.079 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.077+0000 7faa01800700 1 --2- 172.21.15.160:0/2381750884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9fc19f720 0x7fa9fc1a3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:20.079 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.077+0000 7faa01800700 1 -- 172.21.15.160:0/2381750884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9fc19fd60 con 0x7fa9e4005cc0 2024-05-03T22:31:20.079 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.077+0000 7faa00e00700 1 --2- 172.21.15.160:0/2381750884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9fc19f720 0x7fa9fc1a3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:31:20.080 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.078+0000 7faa01800700 1 --2- 172.21.15.160:0/2381750884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9e4005cc0 0x7fa9fc19f1e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0012be0 tx=0x7fa9f0012c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:31:20.080 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.078+0000 7fa9fa000700 1 -- 172.21.15.160:0/2381750884 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fa9f0004ac0 con 0x7fa9e4005cc0 2024-05-03T22:31:20.081 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.078+0000 7fa9fa000700 1 -- 172.21.15.160:0/2381750884 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fa9f00044f0 con 0x7fa9e4005cc0 2024-05-03T22:31:20.081 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.078+0000 7fa9fa000700 1 -- 172.21.15.160:0/2381750884 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fa9f0027620 con 0x7fa9e4005cc0 2024-05-03T22:31:20.081 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.079+0000 7faa04200700 1 -- 172.21.15.160:0/2381750884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9fc1a3ff0 con 0x7fa9e4005cc0 2024-05-03T22:31:20.081 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.079+0000 7faa04200700 1 -- 172.21.15.160:0/2381750884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9fc1a4550 con 0x7fa9e4005cc0 2024-05-03T22:31:20.082 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.080+0000 7faa04200700 1 -- 172.21.15.160:0/2381750884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9fc076f80 con 0x7fa9e4005cc0 2024-05-03T22:31:20.082 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.081+0000 7fa9fa000700 1 -- 172.21.15.160:0/2381750884 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fa9f0024040 con 0x7fa9e4005cc0 2024-05-03T22:31:20.083 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.081+0000 7fa9fa000700 1 --2- 172.21.15.160:0/2381750884 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa9dc03e2d0 0x7fa9dc040790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:20.083 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.082+0000 7fa9fa000700 1 -- 172.21.15.160:0/2381750884 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa9f0022020 con 0x7fa9e4005cc0 2024-05-03T22:31:20.084 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.082+0000 7faa00e00700 1 --2- 172.21.15.160:0/2381750884 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa9dc03e2d0 0x7fa9dc040790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:20.085 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.083+0000 7faa00e00700 1 --2- 172.21.15.160:0/2381750884 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa9dc03e2d0 0x7fa9dc040790 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80079b0 tx=0x7fa9e8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:31:20.099 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.097+0000 7fa9fa000700 1 -- 172.21.15.160:0/2381750884 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa9f002b030 con 0x7fa9e4005cc0 2024-05-03T22:31:20.437 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.435+0000 7faa04200700 1 -- 172.21.15.160:0/2381750884 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa9fc1a48a0 con 0x7fa9e4005cc0 2024-05-03T22:31:20.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:20 smithi160 ceph-mon[32531]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:20.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:20 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:20.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:20 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:31:20.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:20 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:20.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:20 smithi160 ceph-mon[32531]: Deploying daemon mon.b on smithi060 2024-05-03T22:31:20.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:20 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:20.439 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.437+0000 7fa9fa000700 1 -- 172.21.15.160:0/2381750884 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fa9f0026c70 con 0x7fa9e4005cc0 2024-05-03T22:31:20.439 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:31:20.439 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":2,"fsid":"5b0efdca-099c-11ef-bc97-c7b262605968","modified":"2024-05-03T22:31:13.934928Z","created":"2024-05-03T22:28:45.098903Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:3300","nonce":0},{"type":"v1","addr":"172.21.15.160:6789","nonce":0}]},"addr":"172.21.15.160:6789/0","public_addr":"172.21.15.160:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-03T22:31:20.443 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.441+0000 7faa04200700 1 -- 172.21.15.160:0/2381750884 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa9dc03e2d0 msgr2=0x7fa9dc040790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:20.443 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.441+0000 7faa04200700 1 --2- 172.21.15.160:0/2381750884 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa9dc03e2d0 0x7fa9dc040790 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa9e80079b0 tx=0x7fa9e8008040 comp rx=0 tx=0).stop 2024-05-03T22:31:20.443 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.441+0000 7faa04200700 1 -- 172.21.15.160:0/2381750884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9e4005cc0 msgr2=0x7fa9fc19f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:20.443 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.441+0000 7faa04200700 1 --2- 172.21.15.160:0/2381750884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9e4005cc0 0x7fa9fc19f1e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0012be0 tx=0x7fa9f0012c10 comp rx=0 tx=0).stop 2024-05-03T22:31:20.444 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.441+0000 7faa04200700 1 -- 172.21.15.160:0/2381750884 shutdown_connections 2024-05-03T22:31:20.444 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.441+0000 7faa04200700 1 --2- 172.21.15.160:0/2381750884 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa9e4005cc0 0x7fa9fc19f1e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:20.444 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.441+0000 7faa04200700 1 --2- 172.21.15.160:0/2381750884 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa9dc03e2d0 0x7fa9dc040790 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:20.444 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.441+0000 7faa04200700 1 --2- 172.21.15.160:0/2381750884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa9fc19f720 0x7fa9fc1a3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:20.444 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.441+0000 7faa04200700 1 -- 172.21.15.160:0/2381750884 >> 172.21.15.160:0/2381750884 conn(0x7fa9fc0fea70 msgr2=0x7fa9fc197b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:31:20.444 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.441+0000 7faa04200700 1 -- 172.21.15.160:0/2381750884 shutdown_connections 2024-05-03T22:31:20.444 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:20.441+0000 7faa04200700 1 -- 172.21.15.160:0/2381750884 wait complete. 2024-05-03T22:31:20.445 INFO:teuthology.orchestra.run.smithi160.stderr:dumped monmap epoch 2 2024-05-03T22:31:20.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:20 smithi044 ceph-mon[28604]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:20.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:20 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:20.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:20 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:31:20.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:20 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:20.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:20 smithi044 ceph-mon[28604]: Deploying daemon mon.b on smithi060 2024-05-03T22:31:20.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:20 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:21.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:21 smithi044 ceph-mon[28604]: from='client.? 172.21.15.160:0/2381750884' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:31:21.252 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:31:20 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:31:20.935+0000 7f0307600700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-03T22:31:21.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:21 smithi160 ceph-mon[32531]: from='client.? 172.21.15.160:0/2381750884' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:31:22.177 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-03T22:31:22.177 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-03T22:31:22.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:22 smithi044 ceph-mon[28604]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:22.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:22 smithi160 ceph-mon[32531]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:22.601 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:31:24.369 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:24 smithi160 ceph-mon[32531]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:24.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:24 smithi044 ceph-mon[28604]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:24.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.534+0000 7f0cb0c00700 1 -- 172.21.15.160:0/1673114849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cac10f690 msgr2=0x7f0cac10fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:24.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.534+0000 7f0cb0c00700 1 --2- 172.21.15.160:0/1673114849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cac10f690 0x7f0cac10fa70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c009910 tx=0x7f0c9c009c20 comp rx=0 tx=0).stop 2024-05-03T22:31:24.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.534+0000 7f0cb0c00700 1 -- 172.21.15.160:0/1673114849 shutdown_connections 2024-05-03T22:31:24.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.534+0000 7f0cb0c00700 1 --2- 172.21.15.160:0/1673114849 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cac10f690 0x7f0cac10fa70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:24.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.534+0000 7f0cb0c00700 1 -- 172.21.15.160:0/1673114849 >> 172.21.15.160:0/1673114849 conn(0x7f0cac078e20 msgr2=0x7f0cac07b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:31:24.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.534+0000 7f0cb0c00700 1 -- 172.21.15.160:0/1673114849 shutdown_connections 2024-05-03T22:31:24.537 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.534+0000 7f0cb0c00700 1 -- 172.21.15.160:0/1673114849 wait complete. 2024-05-03T22:31:24.538 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.536+0000 7f0cb0c00700 1 Processor -- start 2024-05-03T22:31:24.538 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.536+0000 7f0cb0c00700 1 -- start start 2024-05-03T22:31:24.538 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.536+0000 7f0cb0c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0cac10f690 0x7f0cac19f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:24.539 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.536+0000 7f0cb0c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cac19f6e0 0x7f0cac1a3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:24.539 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.536+0000 7f0cb0c00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac113c00 con 0x7f0cac19f6e0 2024-05-03T22:31:24.539 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.536+0000 7f0cb0c00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac113a80 con 0x7f0cac10f690 2024-05-03T22:31:24.540 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.537+0000 7f0ca9e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0cac10f690 0x7f0cac19f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:24.540 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.537+0000 7f0ca9e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0cac10f690 0x7f0cac19f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:51026/0 (socket says 172.21.15.160:51026) 2024-05-03T22:31:24.540 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.537+0000 7f0ca9e00700 1 -- 172.21.15.160:0/2393518804 learned_addr learned my addr 172.21.15.160:0/2393518804 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-03T22:31:24.540 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.537+0000 7f0ca9400700 1 --2- 172.21.15.160:0/2393518804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cac19f6e0 0x7f0cac1a3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:24.540 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.538+0000 7f0ca9e00700 1 -- 172.21.15.160:0/2393518804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cac19f6e0 msgr2=0x7f0cac1a3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:24.540 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.538+0000 7f0ca9e00700 1 --2- 172.21.15.160:0/2393518804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cac19f6e0 0x7f0cac1a3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:24.540 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.538+0000 7f0ca9e00700 1 -- 172.21.15.160:0/2393518804 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cac19fd20 con 0x7f0cac10f690 2024-05-03T22:31:24.540 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.538+0000 7f0ca9e00700 1 --2- 172.21.15.160:0/2393518804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0cac10f690 0x7f0cac19f1a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c009fd0 tx=0x7f0c9c004c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:31:24.541 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.538+0000 7f0ca2a00700 1 -- 172.21.15.160:0/2393518804 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0c9c00b960 con 0x7f0cac10f690 2024-05-03T22:31:24.541 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.538+0000 7f0ca2a00700 1 -- 172.21.15.160:0/2393518804 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f0c9c022470 con 0x7f0cac10f690 2024-05-03T22:31:24.541 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.538+0000 7f0cb0c00700 1 -- 172.21.15.160:0/2393518804 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cac1a3fb0 con 0x7f0cac10f690 2024-05-03T22:31:24.541 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.538+0000 7f0ca2a00700 1 -- 172.21.15.160:0/2393518804 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0c9c00f620 con 0x7f0cac10f690 2024-05-03T22:31:24.541 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.539+0000 7f0cb0c00700 1 -- 172.21.15.160:0/2393518804 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cac1a4510 con 0x7f0cac10f690 2024-05-03T22:31:24.542 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.540+0000 7f0cb0c00700 1 -- 172.21.15.160:0/2393518804 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cac1a4880 con 0x7f0cac10f690 2024-05-03T22:31:24.542 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.540+0000 7f0ca2a00700 1 -- 172.21.15.160:0/2393518804 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f0c9c02a070 con 0x7f0cac10f690 2024-05-03T22:31:24.542 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.541+0000 7f0ca2a00700 1 --2- 172.21.15.160:0/2393518804 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f0c9003e2b0 0x7f0c90040770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:24.542 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.541+0000 7f0ca2a00700 1 -- 172.21.15.160:0/2393518804 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0c9c01e030 con 0x7f0cac10f690 2024-05-03T22:31:24.543 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.541+0000 7f0ca9400700 1 --2- 172.21.15.160:0/2393518804 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f0c9003e2b0 0x7f0c90040770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:24.544 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.542+0000 7f0ca9400700 1 --2- 172.21.15.160:0/2393518804 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f0c9003e2b0 0x7f0c90040770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0c98009ad0 tx=0x7f0c98009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:31:24.549 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.547+0000 7f0ca2a00700 1 -- 172.21.15.160:0/2393518804 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0c9c013070 con 0x7f0cac10f690 2024-05-03T22:31:24.757 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 podman[31702]: 2024-05-03 22:31:24.60994741 +0000 UTC m=+0.152106801 container create cfdc67598a7c40b73c5d333b8af1665eb1ca9cc707cbd094355e56c1ab55c53b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-b, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-03T22:31:24.872 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.870+0000 7f0cb0c00700 1 -- 172.21.15.160:0/2393518804 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f0cac1a0500 con 0x7f0cac10f690 2024-05-03T22:31:24.873 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.871+0000 7f0ca2a00700 1 -- 172.21.15.160:0/2393518804 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f0c9c0229b0 con 0x7f0cac10f690 2024-05-03T22:31:24.873 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:31:24.873 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":2,"fsid":"5b0efdca-099c-11ef-bc97-c7b262605968","modified":"2024-05-03T22:31:13.934928Z","created":"2024-05-03T22:28:45.098903Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:3300","nonce":0},{"type":"v1","addr":"172.21.15.160:6789","nonce":0}]},"addr":"172.21.15.160:6789/0","public_addr":"172.21.15.160:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-03T22:31:24.876 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.873+0000 7f0cb0c00700 1 -- 172.21.15.160:0/2393518804 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f0c9003e2b0 msgr2=0x7f0c90040770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:24.876 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.873+0000 7f0cb0c00700 1 --2- 172.21.15.160:0/2393518804 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f0c9003e2b0 0x7f0c90040770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0c98009ad0 tx=0x7f0c98009210 comp rx=0 tx=0).stop 2024-05-03T22:31:24.876 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.873+0000 7f0cb0c00700 1 -- 172.21.15.160:0/2393518804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0cac10f690 msgr2=0x7f0cac19f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:24.876 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.873+0000 7f0cb0c00700 1 --2- 172.21.15.160:0/2393518804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0cac10f690 0x7f0cac19f1a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c009fd0 tx=0x7f0c9c004c10 comp rx=0 tx=0).stop 2024-05-03T22:31:24.876 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.874+0000 7f0cb0c00700 1 -- 172.21.15.160:0/2393518804 shutdown_connections 2024-05-03T22:31:24.876 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.874+0000 7f0cb0c00700 1 --2- 172.21.15.160:0/2393518804 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f0c9003e2b0 0x7f0c90040770 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:24.876 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.874+0000 7f0cb0c00700 1 --2- 172.21.15.160:0/2393518804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0cac10f690 0x7f0cac19f1a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:24.877 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.874+0000 7f0cb0c00700 1 --2- 172.21.15.160:0/2393518804 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0cac19f6e0 0x7f0cac1a3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:24.877 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.874+0000 7f0cb0c00700 1 -- 172.21.15.160:0/2393518804 >> 172.21.15.160:0/2393518804 conn(0x7f0cac078e20 msgr2=0x7f0cac07a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:31:24.877 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.874+0000 7f0cb0c00700 1 -- 172.21.15.160:0/2393518804 shutdown_connections 2024-05-03T22:31:24.877 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:24.874+0000 7f0cb0c00700 1 -- 172.21.15.160:0/2393518804 wait complete. 2024-05-03T22:31:24.877 INFO:teuthology.orchestra.run.smithi160.stderr:dumped monmap epoch 2 2024-05-03T22:31:25.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 podman[31702]: 2024-05-03 22:31:24.88537817 +0000 UTC m=+0.427537593 container init cfdc67598a7c40b73c5d333b8af1665eb1ca9cc707cbd094355e56c1ab55c53b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-05-03T22:31:25.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 podman[31702]: 2024-05-03 22:31:24.89659503 +0000 UTC m=+0.438754434 container start cfdc67598a7c40b73c5d333b8af1665eb1ca9cc707cbd094355e56c1ab55c53b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-03T22:31:25.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: set uid:gid to 167:167 (ceph:ceph) 2024-05-03T22:31:25.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev), process ceph-mon, pid 2 2024-05-03T22:31:25.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: pidfile_write: ignore empty --pid-file 2024-05-03T22:31:25.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: load: jerasure load: lrc 2024-05-03T22:31:25.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: RocksDB version: 7.9.2 2024-05-03T22:31:25.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Git sha 0 2024-05-03T22:31:25.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Compile date 2024-05-01 21:12:03 2024-05-03T22:31:25.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: DB SUMMARY 2024-05-03T22:31:25.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: DB Session ID: FKR8NJZD3LPJKFVIUHIZ 2024-05-03T22:31:25.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: CURRENT file: CURRENT 2024-05-03T22:31:25.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: IDENTITY file: IDENTITY 2024-05-03T22:31:25.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-03T22:31:25.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-05-03T22:31:25.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-05-03T22:31:25.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.error_if_exists: 0 2024-05-03T22:31:25.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.create_if_missing: 0 2024-05-03T22:31:25.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.paranoid_checks: 1 2024-05-03T22:31:25.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-03T22:31:25.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-03T22:31:25.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-03T22:31:25.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.env: 0x564f08f13cc0 2024-05-03T22:31:25.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.fs: PosixFileSystem 2024-05-03T22:31:25.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.info_log: 0x564f2a155de0 2024-05-03T22:31:25.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_file_opening_threads: 16 2024-05-03T22:31:25.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.statistics: (nil) 2024-05-03T22:31:25.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.use_fsync: 0 2024-05-03T22:31:25.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_log_file_size: 0 2024-05-03T22:31:25.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-03T22:31:25.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-03T22:31:25.260 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.keep_log_file_num: 1000 2024-05-03T22:31:25.260 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.recycle_log_file_num: 0 2024-05-03T22:31:25.260 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.allow_fallocate: 1 2024-05-03T22:31:25.260 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.allow_mmap_reads: 0 2024-05-03T22:31:25.260 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.allow_mmap_writes: 0 2024-05-03T22:31:25.260 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.use_direct_reads: 0 2024-05-03T22:31:25.260 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-03T22:31:25.260 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.create_missing_column_families: 0 2024-05-03T22:31:25.260 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.db_log_dir: 2024-05-03T22:31:25.260 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.wal_dir: 2024-05-03T22:31:25.260 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-03T22:31:25.260 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-03T22:31:25.260 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-03T22:31:25.261 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-03T22:31:25.261 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-03T22:31:25.261 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-03T22:31:25.261 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.advise_random_on_open: 1 2024-05-03T22:31:25.261 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.db_write_buffer_size: 0 2024-05-03T22:31:25.261 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.write_buffer_manager: 0x564f2a1270e0 2024-05-03T22:31:25.261 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-03T22:31:25.261 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-03T22:31:25.261 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-03T22:31:25.261 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.rate_limiter: (nil) 2024-05-03T22:31:25.261 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-03T22:31:25.261 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.wal_recovery_mode: 2 2024-05-03T22:31:25.261 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.enable_thread_tracking: 0 2024-05-03T22:31:25.261 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.enable_pipelined_write: 0 2024-05-03T22:31:25.261 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.unordered_write: 0 2024-05-03T22:31:25.262 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-03T22:31:25.262 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-03T22:31:25.262 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-03T22:31:25.262 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-03T22:31:25.262 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.row_cache: None 2024-05-03T22:31:25.262 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.wal_filter: None 2024-05-03T22:31:25.263 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-03T22:31:25.263 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.allow_ingest_behind: 0 2024-05-03T22:31:25.263 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.two_write_queues: 0 2024-05-03T22:31:25.263 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.manual_wal_flush: 0 2024-05-03T22:31:25.263 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.wal_compression: 0 2024-05-03T22:31:25.263 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.atomic_flush: 0 2024-05-03T22:31:25.263 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-03T22:31:25.263 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-03T22:31:25.263 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-03T22:31:25.263 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.log_readahead_size: 0 2024-05-03T22:31:25.263 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-03T22:31:25.263 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.best_efforts_recovery: 0 2024-05-03T22:31:25.263 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-03T22:31:25.264 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-03T22:31:25.264 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.allow_data_in_errors: 0 2024-05-03T22:31:25.264 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.db_host_id: __hostname__ 2024-05-03T22:31:25.264 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-03T22:31:25.264 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_background_jobs: 2 2024-05-03T22:31:25.264 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_background_compactions: -1 2024-05-03T22:31:25.264 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_subcompactions: 1 2024-05-03T22:31:25.264 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-03T22:31:25.264 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-03T22:31:25.264 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-03T22:31:25.264 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_total_wal_size: 0 2024-05-03T22:31:25.264 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-03T22:31:25.264 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-03T22:31:25.264 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-03T22:31:25.264 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-03T22:31:25.265 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_open_files: -1 2024-05-03T22:31:25.265 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.bytes_per_sync: 0 2024-05-03T22:31:25.265 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-03T22:31:25.265 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-03T22:31:25.265 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compaction_readahead_size: 0 2024-05-03T22:31:25.265 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_background_flushes: -1 2024-05-03T22:31:25.265 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Compression algorithms supported: 2024-05-03T22:31:25.265 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-03T22:31:25.265 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: kZSTD supported: 0 2024-05-03T22:31:25.265 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: kXpressCompression supported: 0 2024-05-03T22:31:25.265 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: kLZ4HCCompression supported: 1 2024-05-03T22:31:25.265 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: kZlibCompression supported: 1 2024-05-03T22:31:25.265 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: kSnappyCompression supported: 1 2024-05-03T22:31:25.265 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: kLZ4Compression supported: 1 2024-05-03T22:31:25.265 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: kBZip2Compression supported: 0 2024-05-03T22:31:25.266 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-03T22:31:25.266 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-03T22:31:25.266 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-05-03T22:31:25.266 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-03T22:31:25.266 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-03T22:31:25.266 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.merge_operator: 2024-05-03T22:31:25.266 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compaction_filter: None 2024-05-03T22:31:25.266 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compaction_filter_factory: None 2024-05-03T22:31:25.266 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.sst_partitioner_factory: None 2024-05-03T22:31:25.266 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-03T22:31:25.266 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-03T22:31:25.266 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564f2a155fa0) 2024-05-03T22:31:25.266 INFO:journalctl@ceph.mon.b.smithi060.stdout: cache_index_and_filter_blocks: 1 2024-05-03T22:31:25.266 INFO:journalctl@ceph.mon.b.smithi060.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-03T22:31:25.267 INFO:journalctl@ceph.mon.b.smithi060.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-03T22:31:25.267 INFO:journalctl@ceph.mon.b.smithi060.stdout: pin_top_level_index_and_filter: 1 2024-05-03T22:31:25.267 INFO:journalctl@ceph.mon.b.smithi060.stdout: index_type: 0 2024-05-03T22:31:25.267 INFO:journalctl@ceph.mon.b.smithi060.stdout: data_block_index_type: 0 2024-05-03T22:31:25.267 INFO:journalctl@ceph.mon.b.smithi060.stdout: index_shortening: 1 2024-05-03T22:31:25.267 INFO:journalctl@ceph.mon.b.smithi060.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-03T22:31:25.267 INFO:journalctl@ceph.mon.b.smithi060.stdout: checksum: 4 2024-05-03T22:31:25.267 INFO:journalctl@ceph.mon.b.smithi060.stdout: no_block_cache: 0 2024-05-03T22:31:25.267 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_cache: 0x564f2a1591f0 2024-05-03T22:31:25.267 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_cache_name: BinnedLRUCache 2024-05-03T22:31:25.267 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_cache_options: 2024-05-03T22:31:25.267 INFO:journalctl@ceph.mon.b.smithi060.stdout: capacity : 536870912 2024-05-03T22:31:25.267 INFO:journalctl@ceph.mon.b.smithi060.stdout: num_shard_bits : 4 2024-05-03T22:31:25.267 INFO:journalctl@ceph.mon.b.smithi060.stdout: strict_capacity_limit : 0 2024-05-03T22:31:25.267 INFO:journalctl@ceph.mon.b.smithi060.stdout: high_pri_pool_ratio: 0.000 2024-05-03T22:31:25.268 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_cache_compressed: (nil) 2024-05-03T22:31:25.268 INFO:journalctl@ceph.mon.b.smithi060.stdout: persistent_cache: (nil) 2024-05-03T22:31:25.268 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_size: 4096 2024-05-03T22:31:25.268 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_size_deviation: 10 2024-05-03T22:31:25.268 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_restart_interval: 16 2024-05-03T22:31:25.268 INFO:journalctl@ceph.mon.b.smithi060.stdout: index_block_restart_interval: 1 2024-05-03T22:31:25.268 INFO:journalctl@ceph.mon.b.smithi060.stdout: metadata_block_size: 4096 2024-05-03T22:31:25.268 INFO:journalctl@ceph.mon.b.smithi060.stdout: partition_filters: 0 2024-05-03T22:31:25.268 INFO:journalctl@ceph.mon.b.smithi060.stdout: use_delta_encoding: 1 2024-05-03T22:31:25.268 INFO:journalctl@ceph.mon.b.smithi060.stdout: filter_policy: bloomfilter 2024-05-03T22:31:25.268 INFO:journalctl@ceph.mon.b.smithi060.stdout: whole_key_filtering: 1 2024-05-03T22:31:25.268 INFO:journalctl@ceph.mon.b.smithi060.stdout: verify_compression: 0 2024-05-03T22:31:25.268 INFO:journalctl@ceph.mon.b.smithi060.stdout: read_amp_bytes_per_bit: 0 2024-05-03T22:31:25.268 INFO:journalctl@ceph.mon.b.smithi060.stdout: format_version: 5 2024-05-03T22:31:25.268 INFO:journalctl@ceph.mon.b.smithi060.stdout: enable_index_compression: 1 2024-05-03T22:31:25.268 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_align: 0 2024-05-03T22:31:25.269 INFO:journalctl@ceph.mon.b.smithi060.stdout: max_auto_readahead_size: 262144 2024-05-03T22:31:25.269 INFO:journalctl@ceph.mon.b.smithi060.stdout: prepopulate_block_cache: 0 2024-05-03T22:31:25.269 INFO:journalctl@ceph.mon.b.smithi060.stdout: initial_auto_readahead_size: 8192 2024-05-03T22:31:25.270 INFO:journalctl@ceph.mon.b.smithi060.stdout: num_file_reads_for_auto_readahead: 2 2024-05-03T22:31:25.270 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.write_buffer_size: 33554432 2024-05-03T22:31:25.270 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_write_buffer_number: 2 2024-05-03T22:31:25.270 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compression: NoCompression 2024-05-03T22:31:25.270 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.bottommost_compression: Disabled 2024-05-03T22:31:25.271 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.prefix_extractor: nullptr 2024-05-03T22:31:25.271 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-03T22:31:25.271 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.num_levels: 7 2024-05-03T22:31:25.271 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-03T22:31:25.271 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-03T22:31:25.271 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-03T22:31:25.271 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-03T22:31:25.271 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-03T22:31:25.271 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-03T22:31:25.271 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-03T22:31:25.271 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-03T22:31:25.271 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-03T22:31:25.271 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-03T22:31:25.271 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-03T22:31:25.272 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-03T22:31:25.272 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-03T22:31:25.272 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compression_opts.level: 32767 2024-05-03T22:31:25.272 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compression_opts.strategy: 0 2024-05-03T22:31:25.272 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-03T22:31:25.272 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-03T22:31:25.272 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-03T22:31:25.272 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-03T22:31:25.272 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compression_opts.enabled: false 2024-05-03T22:31:25.272 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-03T22:31:25.272 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-03T22:31:25.272 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-03T22:31:25.272 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-03T22:31:25.272 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.target_file_size_base: 67108864 2024-05-03T22:31:25.272 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-03T22:31:25.273 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-03T22:31:25.273 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-03T22:31:25.273 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-03T22:31:25.273 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-03T22:31:25.273 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-03T22:31:25.273 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-03T22:31:25.273 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-03T22:31:25.273 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-03T22:31:25.273 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-03T22:31:25.273 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-03T22:31:25.273 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-03T22:31:25.273 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-03T22:31:25.273 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-03T22:31:25.273 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.arena_block_size: 1048576 2024-05-03T22:31:25.273 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-03T22:31:25.274 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-03T22:31:25.274 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.disable_auto_compactions: 0 2024-05-03T22:31:25.274 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-03T22:31:25.274 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-03T22:31:25.274 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-03T22:31:25.274 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-03T22:31:25.274 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-03T22:31:25.274 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-03T22:31:25.274 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-03T22:31:25.274 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-03T22:31:25.274 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-03T22:31:25.274 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-03T22:31:25.274 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-03T22:31:25.274 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.inplace_update_support: 0 2024-05-03T22:31:25.275 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-03T22:31:25.275 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-03T22:31:25.275 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-03T22:31:25.275 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-03T22:31:25.275 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.bloom_locality: 0 2024-05-03T22:31:25.275 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.max_successive_merges: 0 2024-05-03T22:31:25.275 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-03T22:31:25.275 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.paranoid_file_checks: 0 2024-05-03T22:31:25.275 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.force_consistency_checks: 1 2024-05-03T22:31:25.275 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.report_bg_io_stats: 0 2024-05-03T22:31:25.275 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.ttl: 2592000 2024-05-03T22:31:25.275 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-03T22:31:25.275 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-03T22:31:25.275 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-03T22:31:25.275 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.enable_blob_files: false 2024-05-03T22:31:25.276 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.min_blob_size: 0 2024-05-03T22:31:25.276 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.blob_file_size: 268435456 2024-05-03T22:31:25.276 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-03T22:31:25.276 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-03T22:31:25.276 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-03T22:31:25.276 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-03T22:31:25.276 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-03T22:31:25.276 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.blob_file_starting_level: 0 2024-05-03T22:31:25.276 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-03T22:31:25.276 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-03T22:31:25.276 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-03T22:31:25.276 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6157481f-6fbc-4fcd-9c86-588caf2bc201 2024-05-03T22:31:25.276 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714775484958255, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-03T22:31:25.276 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-03T22:31:25.276 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714775484959246, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714775484, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6157481f-6fbc-4fcd-9c86-588caf2bc201", "db_session_id": "FKR8NJZD3LPJKFVIUHIZ", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-03T22:31:25.277 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714775484959520, "job": 1, "event": "recovery_finished"} 2024-05-03T22:31:25.277 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-03T22:31:25.277 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-03T22:31:25.277 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564f2a276000 2024-05-03T22:31:25.277 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: DB pointer 0x564f2a262000 2024-05-03T22:31:25.277 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-03T22:31:25.277 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-03T22:31:25.277 INFO:journalctl@ceph.mon.b.smithi060.stdout: ** DB Stats ** 2024-05-03T22:31:25.277 INFO:journalctl@ceph.mon.b.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-03T22:31:25.277 INFO:journalctl@ceph.mon.b.smithi060.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-03T22:31:25.277 INFO:journalctl@ceph.mon.b.smithi060.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-03T22:31:25.277 INFO:journalctl@ceph.mon.b.smithi060.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-03T22:31:25.277 INFO:journalctl@ceph.mon.b.smithi060.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-03T22:31:25.277 INFO:journalctl@ceph.mon.b.smithi060.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-03T22:31:25.278 INFO:journalctl@ceph.mon.b.smithi060.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-03T22:31:25.278 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2024-05-03T22:31:25.278 INFO:journalctl@ceph.mon.b.smithi060.stdout: ** Compaction Stats [default] ** 2024-05-03T22:31:25.278 INFO:journalctl@ceph.mon.b.smithi060.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-03T22:31:25.278 INFO:journalctl@ceph.mon.b.smithi060.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-03T22:31:25.278 INFO:journalctl@ceph.mon.b.smithi060.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:31:25.278 INFO:journalctl@ceph.mon.b.smithi060.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:31:25.278 INFO:journalctl@ceph.mon.b.smithi060.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:31:25.278 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2024-05-03T22:31:25.278 INFO:journalctl@ceph.mon.b.smithi060.stdout: ** Compaction Stats [default] ** 2024-05-03T22:31:25.278 INFO:journalctl@ceph.mon.b.smithi060.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-03T22:31:25.279 INFO:journalctl@ceph.mon.b.smithi060.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-03T22:31:25.279 INFO:journalctl@ceph.mon.b.smithi060.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-03T22:31:25.279 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2024-05-03T22:31:25.279 INFO:journalctl@ceph.mon.b.smithi060.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-03T22:31:25.279 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2024-05-03T22:31:25.279 INFO:journalctl@ceph.mon.b.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-03T22:31:25.279 INFO:journalctl@ceph.mon.b.smithi060.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-03T22:31:25.279 INFO:journalctl@ceph.mon.b.smithi060.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-03T22:31:25.279 INFO:journalctl@ceph.mon.b.smithi060.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-03T22:31:25.279 INFO:journalctl@ceph.mon.b.smithi060.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-03T22:31:25.279 INFO:journalctl@ceph.mon.b.smithi060.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-03T22:31:25.279 INFO:journalctl@ceph.mon.b.smithi060.stdout: Cumulative compaction: 0.00 GB write, 0.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-03T22:31:25.280 INFO:journalctl@ceph.mon.b.smithi060.stdout: Interval compaction: 0.00 GB write, 0.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-03T22:31:25.280 INFO:journalctl@ceph.mon.b.smithi060.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-03T22:31:25.280 INFO:journalctl@ceph.mon.b.smithi060.stdout: Block cache BinnedLRUCache@0x564f2a1591f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-05-03T22:31:25.280 INFO:journalctl@ceph.mon.b.smithi060.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-03T22:31:25.280 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2024-05-03T22:31:25.280 INFO:journalctl@ceph.mon.b.smithi060.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-03T22:31:25.280 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-05-03T22:31:25.280 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: using public_addr v2:172.21.15.60:0/0 -> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] 2024-05-03T22:31:25.280 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: starting mon.b rank -1 at public addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] at bind addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:31:25.280 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: mon.b@-1(???) e0 preinit fsid 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:31:25.280 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 bash[31702]: cfdc67598a7c40b73c5d333b8af1665eb1ca9cc707cbd094355e56c1ab55c53b 2024-05-03T22:31:25.280 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 systemd[1]: Started Ceph mon.b for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:31:25.280 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: mon.b@-1(synchronizing).mds e1 new map 2024-05-03T22:31:25.281 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: mon.b@-1(synchronizing).mds e1 print_map 2024-05-03T22:31:25.281 INFO:journalctl@ceph.mon.b.smithi060.stdout: e1 2024-05-03T22:31:25.281 INFO:journalctl@ceph.mon.b.smithi060.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-03T22:31:25.281 INFO:journalctl@ceph.mon.b.smithi060.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-03T22:31:25.281 INFO:journalctl@ceph.mon.b.smithi060.stdout: legacy client fscid: -1 2024-05-03T22:31:25.281 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2024-05-03T22:31:25.281 INFO:journalctl@ceph.mon.b.smithi060.stdout: No filesystems configured 2024-05-03T22:31:25.281 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-03T22:31:25.281 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-03T22:31:25.281 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-03T22:31:25.281 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-03T22:31:25.281 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-03T22:31:25.281 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:24 smithi060 ceph-mon[31721]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-03T22:31:25.282 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-03T22:31:25.282 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T22:31:25.282 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T22:31:25.282 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-03T22:31:25.282 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi060", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:31:25.282 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.282 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: Deploying cephadm binary to smithi060 2024-05-03T22:31:25.282 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.282 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.282 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.282 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.282 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: Added host smithi060 2024-05-03T22:31:25.282 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:31:25.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:31:25.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi160", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:31:25.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: Deploying cephadm binary to smithi160 2024-05-03T22:31:25.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:25.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:25.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:31:25.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: Updating smithi060:/etc/ceph/ceph.conf 2024-05-03T22:31:25.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: Updating smithi060:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:31:25.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:31:25.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: Added host smithi160 2024-05-03T22:31:25.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: Updating smithi060:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T22:31:25.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.285 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.285 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:31:25.285 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.286 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.286 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:31:25.286 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.286 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.286 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.286 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.286 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1588140682' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-03T22:31:25.286 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1588140682' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-03T22:31:25.286 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T22:31:25.286 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.286 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.286 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.286 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.287 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.287 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.287 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi160", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:31:25.287 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:25.287 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:31:25.287 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: Updating smithi160:/etc/ceph/ceph.conf 2024-05-03T22:31:25.287 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: Updating smithi160:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:31:25.287 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.287 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:31:25.287 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi044:172.21.15.44=a;smithi060:172.21.15.60=b;smithi160:172.21.15.160=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:31:25.287 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: Saving service mon spec with placement smithi044:172.21.15.44=a;smithi060:172.21.15.60=b;smithi160:172.21.15.160=c;count:3 2024-05-03T22:31:25.287 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.287 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.288 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.288 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.288 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:31:25.288 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:25.288 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: Updating smithi160:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-03T22:31:25.288 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: Deploying daemon mon.c on smithi160 2024-05-03T22:31:25.288 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.288 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='client.? 172.21.15.160:0/429382875' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:31:25.288 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.288 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.288 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:31:25.288 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: mon.a calling monitor election 2024-05-03T22:31:25.288 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:25.288 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.288 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:25.289 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:25.289 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: mon.c calling monitor election 2024-05-03T22:31:25.289 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.289 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:25.289 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:25.289 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:25.289 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-03T22:31:25.289 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: monmap epoch 2 2024-05-03T22:31:25.289 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: fsid 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:31:25.289 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: last_changed 2024-05-03T22:31:13.934928+0000 2024-05-03T22:31:25.289 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: created 2024-05-03T22:28:45.098903+0000 2024-05-03T22:31:25.289 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: min_mon_release 19 (squid) 2024-05-03T22:31:25.289 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: election_strategy: 1 2024-05-03T22:31:25.289 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-05-03T22:31:25.289 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-05-03T22:31:25.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: fsmap 2024-05-03T22:31:25.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T22:31:25.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: mgrmap e13: x(active, since 70s) 2024-05-03T22:31:25.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: overall HEALTH_OK 2024-05-03T22:31:25.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:25.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:31:25.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:25.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: Deploying daemon mon.b on smithi060 2024-05-03T22:31:25.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:25.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: from='client.? 172.21.15.160:0/2381750884' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:31:25.290 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.291 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:25.291 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:25 smithi060 ceph-mon[31721]: mon.b@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2024-05-03T22:31:26.594 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-03T22:31:26.595 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-03T22:31:27.035 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:31:30.306 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.303+0000 7eff8b800700 1 -- 172.21.15.160:0/1072146435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff8410f690 msgr2=0x7eff8410fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:30.306 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.303+0000 7eff8b800700 1 --2- 172.21.15.160:0/1072146435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff8410f690 0x7eff8410fa70 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff78005fa0 tx=0x7eff7800fe80 comp rx=0 tx=0).stop 2024-05-03T22:31:30.306 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.303+0000 7eff8b800700 1 -- 172.21.15.160:0/1072146435 shutdown_connections 2024-05-03T22:31:30.306 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.303+0000 7eff8b800700 1 --2- 172.21.15.160:0/1072146435 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff8410f690 0x7eff8410fa70 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:30.306 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.303+0000 7eff8b800700 1 -- 172.21.15.160:0/1072146435 >> 172.21.15.160:0/1072146435 conn(0x7eff84078e20 msgr2=0x7eff8407b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:31:30.306 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.304+0000 7eff8b800700 1 -- 172.21.15.160:0/1072146435 shutdown_connections 2024-05-03T22:31:30.307 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.304+0000 7eff8b800700 1 -- 172.21.15.160:0/1072146435 wait complete. 2024-05-03T22:31:30.307 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.305+0000 7eff8b800700 1 Processor -- start 2024-05-03T22:31:30.307 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.306+0000 7eff8b800700 1 -- start start 2024-05-03T22:31:30.308 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.306+0000 7eff8b800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff8410f690 0x7eff8419f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:30.308 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.306+0000 7eff8b800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff8419f7a0 0x7eff841a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:30.308 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.306+0000 7eff8b800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff841a4070 0x7eff841a4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:30.308 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.306+0000 7eff8b800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7eff84113be0 con 0x7eff8410f690 2024-05-03T22:31:30.309 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.306+0000 7eff8b800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7eff84113a60 con 0x7eff8419f7a0 2024-05-03T22:31:30.309 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.306+0000 7eff8b800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7eff84113d60 con 0x7eff841a4070 2024-05-03T22:31:30.309 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.307+0000 7eff89800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff841a4070 0x7eff841a4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:30.309 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.307+0000 7eff89800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff841a4070 0x7eff841a4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:50860/0 (socket says 172.21.15.160:50860) 2024-05-03T22:31:30.309 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.307+0000 7eff88e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff8410f690 0x7eff8419f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:30.309 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.307+0000 7eff89800700 1 -- 172.21.15.160:0/411490692 learned_addr learned my addr 172.21.15.160:0/411490692 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-03T22:31:30.310 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.308+0000 7eff89800700 1 -- 172.21.15.160:0/411490692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff8419f7a0 msgr2=0x7eff841a3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:30.310 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.308+0000 7eff89800700 1 --2- 172.21.15.160:0/411490692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff8419f7a0 0x7eff841a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:30.310 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.308+0000 7eff89800700 1 -- 172.21.15.160:0/411490692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff8410f690 msgr2=0x7eff8419f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:30.310 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.308+0000 7eff89800700 1 --2- 172.21.15.160:0/411490692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff8410f690 0x7eff8419f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:30.310 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.308+0000 7eff89800700 1 -- 172.21.15.160:0/411490692 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff841abde0 con 0x7eff841a4070 2024-05-03T22:31:30.310 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.308+0000 7eff89800700 1 --2- 172.21.15.160:0/411490692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff841a4070 0x7eff841a4520 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00ba50 tx=0x7eff7c00bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:31:30.311 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.309+0000 7eff81600700 1 -- 172.21.15.160:0/411490692 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c019070 con 0x7eff841a4070 2024-05-03T22:31:30.311 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.309+0000 7eff81600700 1 -- 172.21.15.160:0/411490692 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7eff7c014440 con 0x7eff841a4070 2024-05-03T22:31:30.311 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.309+0000 7eff81600700 1 -- 172.21.15.160:0/411490692 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c0075b0 con 0x7eff841a4070 2024-05-03T22:31:30.311 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.309+0000 7eff8b800700 1 -- 172.21.15.160:0/411490692 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff841ac010 con 0x7eff841a4070 2024-05-03T22:31:30.311 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.309+0000 7eff8b800700 1 -- 172.21.15.160:0/411490692 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff841ac550 con 0x7eff841a4070 2024-05-03T22:31:30.312 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.310+0000 7eff8b800700 1 -- 172.21.15.160:0/411490692 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff84064b00 con 0x7eff841a4070 2024-05-03T22:31:30.312 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.311+0000 7eff81600700 1 -- 172.21.15.160:0/411490692 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7eff7c01c070 con 0x7eff841a4070 2024-05-03T22:31:30.313 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.311+0000 7eff81600700 1 --2- 172.21.15.160:0/411490692 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7eff6c03e9a0 0x7eff6c040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:30.313 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.311+0000 7eff81600700 1 -- 172.21.15.160:0/411490692 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7eff7c051e00 con 0x7eff841a4070 2024-05-03T22:31:30.313 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.312+0000 7eff88e00700 1 --2- 172.21.15.160:0/411490692 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7eff6c03e9a0 0x7eff6c040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:30.315 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.313+0000 7eff88e00700 1 --2- 172.21.15.160:0/411490692 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7eff6c03e9a0 0x7eff6c040e60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7eff780116c0 tx=0x7eff7801e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:31:30.321 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.319+0000 7eff81600700 1 -- 172.21.15.160:0/411490692 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7eff7c01c360 con 0x7eff841a4070 2024-05-03T22:31:30.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:30.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:31:30.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: mon.a calling monitor election 2024-05-03T22:31:30.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: mon.c calling monitor election 2024-05-03T22:31:30.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:30.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:30.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:30.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:30.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:30.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: mon.b calling monitor election 2024-05-03T22:31:30.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:30.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:30.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:30.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:30.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-03T22:31:30.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: monmap epoch 3 2024-05-03T22:31:30.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: fsid 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:31:30.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: last_changed 2024-05-03T22:31:25.010633+0000 2024-05-03T22:31:30.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: created 2024-05-03T22:28:45.098903+0000 2024-05-03T22:31:30.504 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: min_mon_release 19 (squid) 2024-05-03T22:31:30.505 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: election_strategy: 1 2024-05-03T22:31:30.505 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-05-03T22:31:30.505 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-05-03T22:31:30.505 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: 2: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.b 2024-05-03T22:31:30.505 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: fsmap 2024-05-03T22:31:30.505 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T22:31:30.505 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: mgrmap e13: x(active, since 81s) 2024-05-03T22:31:30.505 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: overall HEALTH_OK 2024-05-03T22:31:30.505 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:30.505 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:30.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:30.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:31:30.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: mon.a calling monitor election 2024-05-03T22:31:30.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: mon.c calling monitor election 2024-05-03T22:31:30.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:30.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:30.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:30.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:30.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:30.507 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: mon.b calling monitor election 2024-05-03T22:31:30.507 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:30.507 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:30.507 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:30.507 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:30.507 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-03T22:31:30.507 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: monmap epoch 3 2024-05-03T22:31:30.507 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: fsid 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:31:30.507 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: last_changed 2024-05-03T22:31:25.010633+0000 2024-05-03T22:31:30.507 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: created 2024-05-03T22:28:45.098903+0000 2024-05-03T22:31:30.507 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: min_mon_release 19 (squid) 2024-05-03T22:31:30.507 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: election_strategy: 1 2024-05-03T22:31:30.507 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-05-03T22:31:30.507 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-05-03T22:31:30.507 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: 2: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.b 2024-05-03T22:31:30.507 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: fsmap 2024-05-03T22:31:30.508 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T22:31:30.508 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: mgrmap e13: x(active, since 81s) 2024-05-03T22:31:30.508 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: overall HEALTH_OK 2024-05-03T22:31:30.508 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:30.508 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:30.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:31:30.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: mon.a calling monitor election 2024-05-03T22:31:30.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: mon.c calling monitor election 2024-05-03T22:31:30.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:30.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:31:30.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:30.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:30.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:30.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: mon.b calling monitor election 2024-05-03T22:31:30.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:30.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:30.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:30.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:30.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-03T22:31:30.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: monmap epoch 3 2024-05-03T22:31:30.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: fsid 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:31:30.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: last_changed 2024-05-03T22:31:25.010633+0000 2024-05-03T22:31:30.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: created 2024-05-03T22:28:45.098903+0000 2024-05-03T22:31:30.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: min_mon_release 19 (squid) 2024-05-03T22:31:30.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: election_strategy: 1 2024-05-03T22:31:30.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: 0: [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] mon.a 2024-05-03T22:31:30.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: 1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.c 2024-05-03T22:31:30.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: 2: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.b 2024-05-03T22:31:30.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: fsmap 2024-05-03T22:31:30.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: osdmap e4: 0 total, 0 up, 0 in 2024-05-03T22:31:30.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: mgrmap e13: x(active, since 81s) 2024-05-03T22:31:30.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: overall HEALTH_OK 2024-05-03T22:31:30.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:30.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:30.641 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.639+0000 7eff8b800700 1 -- 172.21.15.160:0/411490692 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7eff841ac960 con 0x7eff841a4070 2024-05-03T22:31:30.642 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.640+0000 7eff81600700 1 -- 172.21.15.160:0/411490692 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1281 (secure 0 0 0) 0x7eff7c012d90 con 0x7eff841a4070 2024-05-03T22:31:30.642 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-05-03T22:31:30.642 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":3,"fsid":"5b0efdca-099c-11ef-bc97-c7b262605968","modified":"2024-05-03T22:31:25.010633Z","created":"2024-05-03T22:28:45.098903Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:3300","nonce":0},{"type":"v1","addr":"172.21.15.44:6789","nonce":0}]},"addr":"172.21.15.44:6789/0","public_addr":"172.21.15.44:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:3300","nonce":0},{"type":"v1","addr":"172.21.15.160:6789","nonce":0}]},"addr":"172.21.15.160:6789/0","public_addr":"172.21.15.160:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-03T22:31:30.645 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.643+0000 7eff8b800700 1 -- 172.21.15.160:0/411490692 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7eff6c03e9a0 msgr2=0x7eff6c040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:30.645 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.643+0000 7eff8b800700 1 --2- 172.21.15.160:0/411490692 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7eff6c03e9a0 0x7eff6c040e60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7eff780116c0 tx=0x7eff7801e040 comp rx=0 tx=0).stop 2024-05-03T22:31:30.645 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.643+0000 7eff8b800700 1 -- 172.21.15.160:0/411490692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff841a4070 msgr2=0x7eff841a4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:30.645 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.643+0000 7eff8b800700 1 --2- 172.21.15.160:0/411490692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff841a4070 0x7eff841a4520 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00ba50 tx=0x7eff7c00bd60 comp rx=0 tx=0).stop 2024-05-03T22:31:30.645 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.643+0000 7eff8b800700 1 -- 172.21.15.160:0/411490692 shutdown_connections 2024-05-03T22:31:30.646 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.643+0000 7eff8b800700 1 --2- 172.21.15.160:0/411490692 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7eff6c03e9a0 0x7eff6c040e60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:30.646 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.643+0000 7eff8b800700 1 --2- 172.21.15.160:0/411490692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff841a4070 0x7eff841a4520 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:30.646 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.643+0000 7eff8b800700 1 --2- 172.21.15.160:0/411490692 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7eff8410f690 0x7eff8419f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:30.646 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.643+0000 7eff8b800700 1 --2- 172.21.15.160:0/411490692 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff8419f7a0 0x7eff841a3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:30.646 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.643+0000 7eff8b800700 1 -- 172.21.15.160:0/411490692 >> 172.21.15.160:0/411490692 conn(0x7eff84078e20 msgr2=0x7eff84079200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:31:30.646 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.643+0000 7eff8b800700 1 -- 172.21.15.160:0/411490692 shutdown_connections 2024-05-03T22:31:30.646 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:30.643+0000 7eff8b800700 1 -- 172.21.15.160:0/411490692 wait complete. 2024-05-03T22:31:30.646 INFO:teuthology.orchestra.run.smithi160.stderr:dumped monmap epoch 3 2024-05-03T22:31:31.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:31 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:31.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:31 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:31.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:31 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:31:31.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:31 smithi160 ceph-mon[32531]: from='client.? 172.21.15.160:0/411490692' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:31:31.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:31 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:31.498 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-03T22:31:31.498 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph config generate-minimal-conf 2024-05-03T22:31:31.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:31 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:31.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:31 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:31.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:31 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:31:31.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:31 smithi060 ceph-mon[31721]: from='client.? 172.21.15.160:0/411490692' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:31:31.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:31 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:31.506 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:31 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:31.506 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:31 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:31.506 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:31 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:31:31.506 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:31 smithi044 ceph-mon[28604]: from='client.? 172.21.15.160:0/411490692' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-03T22:31:31.506 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:31 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:31:31.924 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:31:32.159 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:32 smithi160 ceph-mon[32531]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:32.297 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:32 smithi044 ceph-mon[28604]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:32.297 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:31:32 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:31:32.010+0000 7f0307600700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-03T22:31:32.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:32 smithi060 ceph-mon[31721]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:33.589 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:33 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:33.589 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:33 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:33.589 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:33 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:33.589 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:33 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:33.589 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:33 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:33.589 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:33 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:31:33.589 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:33 smithi044 ceph-mon[28604]: Updating smithi044:/etc/ceph/ceph.conf 2024-05-03T22:31:33.590 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:33 smithi044 ceph-mon[28604]: Updating smithi060:/etc/ceph/ceph.conf 2024-05-03T22:31:33.590 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:33 smithi044 ceph-mon[28604]: Updating smithi160:/etc/ceph/ceph.conf 2024-05-03T22:31:33.590 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:33 smithi044 ceph-mon[28604]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:33.725 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:33 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:33.725 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:33 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:33.725 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:33 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:33.726 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:33 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:33.726 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:33 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:33.726 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:33 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:31:33.726 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:33 smithi160 ceph-mon[32531]: Updating smithi044:/etc/ceph/ceph.conf 2024-05-03T22:31:33.726 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:33 smithi160 ceph-mon[32531]: Updating smithi060:/etc/ceph/ceph.conf 2024-05-03T22:31:33.726 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:33 smithi160 ceph-mon[32531]: Updating smithi160:/etc/ceph/ceph.conf 2024-05-03T22:31:33.726 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:33 smithi160 ceph-mon[32531]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:33.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:33 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:33.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:33 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:33.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:33 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:33.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:33 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:33.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:33 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:33.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:33 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:31:33.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:33 smithi060 ceph-mon[31721]: Updating smithi044:/etc/ceph/ceph.conf 2024-05-03T22:31:33.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:33 smithi060 ceph-mon[31721]: Updating smithi060:/etc/ceph/ceph.conf 2024-05-03T22:31:33.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:33 smithi060 ceph-mon[31721]: Updating smithi160:/etc/ceph/ceph.conf 2024-05-03T22:31:33.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:33 smithi060 ceph-mon[31721]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:34.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.198+0000 7fd818200700 1 -- 172.21.15.44:0/950121105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd810108f40 msgr2=0x7fd810109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:34.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.198+0000 7fd818200700 1 --2- 172.21.15.44:0/950121105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd810108f40 0x7fd810109320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd804009910 tx=0x7fd804009c20 comp rx=0 tx=0).stop 2024-05-03T22:31:34.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.198+0000 7fd818200700 1 -- 172.21.15.44:0/950121105 shutdown_connections 2024-05-03T22:31:34.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.198+0000 7fd818200700 1 --2- 172.21.15.44:0/950121105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd810108f40 0x7fd810109320 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:34.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.198+0000 7fd818200700 1 -- 172.21.15.44:0/950121105 >> 172.21.15.44:0/950121105 conn(0x7fd810077900 msgr2=0x7fd810077d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:31:34.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.198+0000 7fd818200700 1 -- 172.21.15.44:0/950121105 shutdown_connections 2024-05-03T22:31:34.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.198+0000 7fd818200700 1 -- 172.21.15.44:0/950121105 wait complete. 2024-05-03T22:31:34.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.199+0000 7fd818200700 1 Processor -- start 2024-05-03T22:31:34.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.199+0000 7fd818200700 1 -- start start 2024-05-03T22:31:34.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.200+0000 7fd818200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd810108f40 0x7fd81019aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:34.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.200+0000 7fd818200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd81019b400 0x7fd81019f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:34.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.200+0000 7fd818200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd81019fc80 0x7fd8101a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:34.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.200+0000 7fd818200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd81010d4c0 con 0x7fd81019b400 2024-05-03T22:31:34.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.200+0000 7fd818200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd81010d340 con 0x7fd810108f40 2024-05-03T22:31:34.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.200+0000 7fd818200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd81010d640 con 0x7fd81019fc80 2024-05-03T22:31:34.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.200+0000 7fd814e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd81019b400 0x7fd81019f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:34.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.200+0000 7fd814e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd81019b400 0x7fd81019f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51340/0 (socket says 172.21.15.44:51340) 2024-05-03T22:31:34.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.200+0000 7fd814e00700 1 -- 172.21.15.44:0/2339364501 learned_addr learned my addr 172.21.15.44:0/2339364501 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:31:34.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.200+0000 7fd815800700 1 --2- 172.21.15.44:0/2339364501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd810108f40 0x7fd81019aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:34.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.201+0000 7fd815800700 1 -- 172.21.15.44:0/2339364501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd810108f40 msgr2=0x7fd81019aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-03T22:31:34.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.201+0000 7fd815800700 1 -- 172.21.15.44:0/2339364501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd810108f40 msgr2=0x7fd81019aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-03T22:31:34.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.201+0000 7fd816200700 1 --2- 172.21.15.44:0/2339364501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd81019fc80 0x7fd8101a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:34.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.201+0000 7fd815800700 1 --2- 172.21.15.44:0/2339364501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd810108f40 0x7fd81019aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-03T22:31:34.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.201+0000 7fd815800700 1 --2- 172.21.15.44:0/2339364501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd810108f40 0x7fd81019aec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-03T22:31:34.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.201+0000 7fd814e00700 1 -- 172.21.15.44:0/2339364501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd81019fc80 msgr2=0x7fd8101a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:34.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.201+0000 7fd814e00700 1 --2- 172.21.15.44:0/2339364501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd81019fc80 0x7fd8101a0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:34.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.201+0000 7fd814e00700 1 -- 172.21.15.44:0/2339364501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd810108f40 msgr2=0x7fd81019aec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-03T22:31:34.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.201+0000 7fd814e00700 1 --2- 172.21.15.44:0/2339364501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd810108f40 0x7fd81019aec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:34.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.201+0000 7fd814e00700 1 -- 172.21.15.44:0/2339364501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8101a79f0 con 0x7fd81019b400 2024-05-03T22:31:34.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.201+0000 7fd814e00700 1 --2- 172.21.15.44:0/2339364501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd81019b400 0x7fd81019f740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00b780 tx=0x7fd7fc00bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:31:34.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.201+0000 7fd80e000700 1 -- 172.21.15.44:0/2339364501 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc004230 con 0x7fd81019b400 2024-05-03T22:31:34.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.202+0000 7fd80e000700 1 -- 172.21.15.44:0/2339364501 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fd7fc0043d0 con 0x7fd81019b400 2024-05-03T22:31:34.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.202+0000 7fd818200700 1 -- 172.21.15.44:0/2339364501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8101a7c20 con 0x7fd81019b400 2024-05-03T22:31:34.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.202+0000 7fd818200700 1 -- 172.21.15.44:0/2339364501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8101a8160 con 0x7fd81019b400 2024-05-03T22:31:34.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.202+0000 7fd80e000700 1 -- 172.21.15.44:0/2339364501 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc011c30 con 0x7fd81019b400 2024-05-03T22:31:34.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.203+0000 7fd818200700 1 -- 172.21.15.44:0/2339364501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd810064b00 con 0x7fd81019b400 2024-05-03T22:31:34.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.203+0000 7fd80e000700 1 -- 172.21.15.44:0/2339364501 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fd7fc0036a0 con 0x7fd81019b400 2024-05-03T22:31:34.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.204+0000 7fd80e000700 1 --2- 172.21.15.44:0/2339364501 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd7f803e9a0 0x7fd7f8040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:34.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.204+0000 7fd80e000700 1 -- 172.21.15.44:0/2339364501 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd7fc052480 con 0x7fd81019b400 2024-05-03T22:31:34.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.204+0000 7fd815800700 1 --2- 172.21.15.44:0/2339364501 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd7f803e9a0 0x7fd7f8040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:34.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.205+0000 7fd815800700 1 --2- 172.21.15.44:0/2339364501 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd7f803e9a0 0x7fd7f8040e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd804009750 tx=0x7fd80400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:31:34.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.210+0000 7fd80e000700 1 -- 172.21.15.44:0/2339364501 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd7fc020ae0 con 0x7fd81019b400 2024-05-03T22:31:34.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.454+0000 7fd818200700 1 -- 172.21.15.44:0/2339364501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fd81002e510 con 0x7fd81019b400 2024-05-03T22:31:34.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.455+0000 7fd80e000700 1 -- 172.21.15.44:0/2339364501 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7fd7fc00d280 con 0x7fd81019b400 2024-05-03T22:31:34.457 INFO:teuthology.orchestra.run.smithi044.stdout:# minimal ceph.conf for 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:31:34.457 INFO:teuthology.orchestra.run.smithi044.stdout:[global] 2024-05-03T22:31:34.457 INFO:teuthology.orchestra.run.smithi044.stdout: fsid = 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:31:34.457 INFO:teuthology.orchestra.run.smithi044.stdout: mon_host = [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2024-05-03T22:31:34.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.458+0000 7fd818200700 1 -- 172.21.15.44:0/2339364501 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd7f803e9a0 msgr2=0x7fd7f8040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:34.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.458+0000 7fd818200700 1 --2- 172.21.15.44:0/2339364501 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd7f803e9a0 0x7fd7f8040e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd804009750 tx=0x7fd80400b540 comp rx=0 tx=0).stop 2024-05-03T22:31:34.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.458+0000 7fd818200700 1 -- 172.21.15.44:0/2339364501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd81019b400 msgr2=0x7fd81019f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:34.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.458+0000 7fd818200700 1 --2- 172.21.15.44:0/2339364501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd81019b400 0x7fd81019f740 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00b780 tx=0x7fd7fc00bb40 comp rx=0 tx=0).stop 2024-05-03T22:31:34.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.458+0000 7fd818200700 1 -- 172.21.15.44:0/2339364501 shutdown_connections 2024-05-03T22:31:34.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.458+0000 7fd818200700 1 --2- 172.21.15.44:0/2339364501 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd7f803e9a0 0x7fd7f8040e60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:34.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.458+0000 7fd818200700 1 --2- 172.21.15.44:0/2339364501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd81019fc80 0x7fd8101a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:34.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.458+0000 7fd818200700 1 --2- 172.21.15.44:0/2339364501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd810108f40 0x7fd81019aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:34.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.458+0000 7fd818200700 1 --2- 172.21.15.44:0/2339364501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd81019b400 0x7fd81019f740 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:34.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.458+0000 7fd818200700 1 -- 172.21.15.44:0/2339364501 >> 172.21.15.44:0/2339364501 conn(0x7fd810077900 msgr2=0x7fd8100ff2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:31:34.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.458+0000 7fd818200700 1 -- 172.21.15.44:0/2339364501 shutdown_connections 2024-05-03T22:31:34.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:34.458+0000 7fd818200700 1 -- 172.21.15.44:0/2339364501 wait complete. 2024-05-03T22:31:35.213 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:34 smithi044 ceph-mon[28604]: Updating smithi160:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:31:35.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:34 smithi044 ceph-mon[28604]: Updating smithi044:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:31:35.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:34 smithi044 ceph-mon[28604]: Updating smithi060:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:31:35.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:34 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2339364501' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:35.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:31:35.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T22:31:35.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:35.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:34 smithi060 ceph-mon[31721]: Updating smithi160:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:31:35.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:34 smithi060 ceph-mon[31721]: Updating smithi044:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:31:35.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:34 smithi060 ceph-mon[31721]: Updating smithi060:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:31:35.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:34 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2339364501' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:35.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:31:35.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T22:31:35.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:35.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:34 smithi160 ceph-mon[32531]: Updating smithi160:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:31:35.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:34 smithi160 ceph-mon[32531]: Updating smithi044:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:31:35.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:34 smithi160 ceph-mon[32531]: Updating smithi060:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-03T22:31:35.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:34 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2339364501' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:35.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:35.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:31:35.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T22:31:35.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:35.279 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-03T22:31:35.279 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T22:31:35.279 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.conf 2024-05-03T22:31:35.357 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T22:31:35.357 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:31:35.470 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-03T22:31:35.470 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.conf 2024-05-03T22:31:35.569 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-03T22:31:35.569 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:31:35.704 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-03T22:31:35.704 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.conf 2024-05-03T22:31:35.796 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-03T22:31:35.797 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-03T22:31:35.926 INFO:tasks.cephadm:Adding mgr.x on smithi044 2024-05-03T22:31:35.926 INFO:tasks.cephadm:Adding mgr.y on smithi060 2024-05-03T22:31:35.926 INFO:tasks.cephadm:Adding mgr.z on smithi160 2024-05-03T22:31:35.926 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch apply mgr '3;smithi044=x;smithi060=y;smithi160=z' 2024-05-03T22:31:36.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:35 smithi044 ceph-mon[28604]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:36.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:35 smithi044 ceph-mon[28604]: Reconfiguring mon.a (unknown last config time)... 2024-05-03T22:31:36.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:35 smithi044 ceph-mon[28604]: Reconfiguring daemon mon.a on smithi044 2024-05-03T22:31:36.044 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:35 smithi160 ceph-mon[32531]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:36.045 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:35 smithi160 ceph-mon[32531]: Reconfiguring mon.a (unknown last config time)... 2024-05-03T22:31:36.045 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:35 smithi160 ceph-mon[32531]: Reconfiguring daemon mon.a on smithi044 2024-05-03T22:31:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:35 smithi060 ceph-mon[31721]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:35 smithi060 ceph-mon[31721]: Reconfiguring mon.a (unknown last config time)... 2024-05-03T22:31:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:35 smithi060 ceph-mon[31721]: Reconfiguring daemon mon.a on smithi044 2024-05-03T22:31:36.387 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:31:38.190 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:38 smithi060 ceph-mon[31721]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:38.190 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:38 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:38.190 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:38 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:38.191 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:38 smithi060 ceph-mon[31721]: Reconfiguring mon.b (monmap changed)... 2024-05-03T22:31:38.191 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:38 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:31:38.191 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:38 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T22:31:38.191 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:38 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:38.191 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:38 smithi060 ceph-mon[31721]: Reconfiguring daemon mon.b on smithi060 2024-05-03T22:31:38.302 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.300+0000 7f9add800700 1 -- 172.21.15.160:0/3529267019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad8103030 msgr2=0x7f9ad8103450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:38.302 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.300+0000 7f9add800700 1 --2- 172.21.15.160:0/3529267019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad8103030 0x7f9ad8103450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8009910 tx=0x7f9ac8009c20 comp rx=0 tx=0).stop 2024-05-03T22:31:38.302 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.300+0000 7f9add800700 1 -- 172.21.15.160:0/3529267019 shutdown_connections 2024-05-03T22:31:38.302 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.300+0000 7f9add800700 1 --2- 172.21.15.160:0/3529267019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad8103030 0x7f9ad8103450 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:38.302 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.300+0000 7f9add800700 1 -- 172.21.15.160:0/3529267019 >> 172.21.15.160:0/3529267019 conn(0x7f9ad80fe5d0 msgr2=0x7f9ad8100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:31:38.302 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.300+0000 7f9add800700 1 -- 172.21.15.160:0/3529267019 shutdown_connections 2024-05-03T22:31:38.302 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.300+0000 7f9add800700 1 -- 172.21.15.160:0/3529267019 wait complete. 2024-05-03T22:31:38.303 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.301+0000 7f9add800700 1 Processor -- start 2024-05-03T22:31:38.303 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.302+0000 7f9add800700 1 -- start start 2024-05-03T22:31:38.303 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.302+0000 7f9add800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ad8103030 0x7f9ad819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:38.303 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.302+0000 7f9add800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ad819af60 0x7f9ad819ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:38.303 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.302+0000 7f9add800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad819b3e0 0x7f9ad81a2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:38.303 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.302+0000 7f9add800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad81090b0 con 0x7f9ad819b3e0 2024-05-03T22:31:38.303 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.302+0000 7f9add800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad8108f30 con 0x7f9ad819af60 2024-05-03T22:31:38.303 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.302+0000 7f9add800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad8109230 con 0x7f9ad8103030 2024-05-03T22:31:38.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.302+0000 7f9ad6a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ad8103030 0x7f9ad819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:38.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.302+0000 7f9ad6a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ad8103030 0x7f9ad819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:46660/0 (socket says 172.21.15.160:46660) 2024-05-03T22:31:38.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.302+0000 7f9ad6a00700 1 -- 172.21.15.160:0/1438211941 learned_addr learned my addr 172.21.15.160:0/1438211941 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-03T22:31:38.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.303+0000 7f9ad6000700 1 --2- 172.21.15.160:0/1438211941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ad819af60 0x7f9ad819ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:38.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.303+0000 7f9ad7400700 1 --2- 172.21.15.160:0/1438211941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad819b3e0 0x7f9ad81a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:38.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.303+0000 7f9ad6a00700 1 -- 172.21.15.160:0/1438211941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ad819af60 msgr2=0x7f9ad819ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:38.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.303+0000 7f9ad6a00700 1 --2- 172.21.15.160:0/1438211941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ad819af60 0x7f9ad819ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:38.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.303+0000 7f9ad6a00700 1 -- 172.21.15.160:0/1438211941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad819b3e0 msgr2=0x7f9ad81a2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:38.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.303+0000 7f9ad6a00700 1 --2- 172.21.15.160:0/1438211941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad819b3e0 0x7f9ad81a2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:38.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.303+0000 7f9ad6a00700 1 -- 172.21.15.160:0/1438211941 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad81a2e30 con 0x7f9ad8103030 2024-05-03T22:31:38.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.303+0000 7f9ad7400700 1 --2- 172.21.15.160:0/1438211941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad819b3e0 0x7f9ad81a2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:31:38.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.303+0000 7f9ad6a00700 1 --2- 172.21.15.160:0/1438211941 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ad8103030 0x7f9ad819aa20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8005e00 tx=0x7f9ac8005030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:31:38.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.304+0000 7f9acf400700 1 -- 172.21.15.160:0/1438211941 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac8026070 con 0x7f9ad8103030 2024-05-03T22:31:38.305 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.304+0000 7f9add800700 1 -- 172.21.15.160:0/1438211941 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad81a30c0 con 0x7f9ad8103030 2024-05-03T22:31:38.306 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.304+0000 7f9acf400700 1 -- 172.21.15.160:0/1438211941 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f9ac800f460 con 0x7f9ad8103030 2024-05-03T22:31:38.306 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.304+0000 7f9acf400700 1 -- 172.21.15.160:0/1438211941 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ac80176a0 con 0x7f9ad8103030 2024-05-03T22:31:38.306 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.304+0000 7f9add800700 1 -- 172.21.15.160:0/1438211941 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad81a3620 con 0x7f9ad8103030 2024-05-03T22:31:38.306 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.305+0000 7f9add800700 1 -- 172.21.15.160:0/1438211941 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ad8064b00 con 0x7f9ad8103030 2024-05-03T22:31:38.306 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.305+0000 7f9acf400700 1 -- 172.21.15.160:0/1438211941 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f9ac8029070 con 0x7f9ad8103030 2024-05-03T22:31:38.307 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.306+0000 7f9acf400700 1 --2- 172.21.15.160:0/1438211941 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9abc03e9a0 0x7f9abc040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:38.307 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.306+0000 7f9acf400700 1 -- 172.21.15.160:0/1438211941 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f9ac8053590 con 0x7f9ad8103030 2024-05-03T22:31:38.307 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.307+0000 7f9ad6000700 1 --2- 172.21.15.160:0/1438211941 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9abc03e9a0 0x7f9abc040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:38.308 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.308+0000 7f9ad6000700 1 --2- 172.21.15.160:0/1438211941 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9abc03e9a0 0x7f9abc040e60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40078e0 tx=0x7f9ac4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:31:38.313 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.312+0000 7f9acf400700 1 -- 172.21.15.160:0/1438211941 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f9ac8013070 con 0x7f9ad8103030 2024-05-03T22:31:38.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:38 smithi044 ceph-mon[28604]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:38.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:38 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:38.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:38 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:38.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:38 smithi044 ceph-mon[28604]: Reconfiguring mon.b (monmap changed)... 2024-05-03T22:31:38.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:38 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:31:38.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:38 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T22:31:38.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:38 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:38.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:38 smithi044 ceph-mon[28604]: Reconfiguring daemon mon.b on smithi060 2024-05-03T22:31:38.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:38 smithi160 ceph-mon[32531]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:38.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:38 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:38.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:38 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:38.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:38 smithi160 ceph-mon[32531]: Reconfiguring mon.b (monmap changed)... 2024-05-03T22:31:38.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:38 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:31:38.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:38 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T22:31:38.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:38 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:38.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:38 smithi160 ceph-mon[32531]: Reconfiguring daemon mon.b on smithi060 2024-05-03T22:31:38.560 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.559+0000 7f9add800700 1 -- 172.21.15.160:0/1438211941 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi044=x;smithi060=y;smithi160=z", "target": ["mon-mgr", ""]}) -- 0x7f9ad8063a30 con 0x7f9abc03e9a0 2024-05-03T22:31:38.575 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.574+0000 7f9acf400700 1 -- 172.21.15.160:0/1438211941 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f9ad8063a30 con 0x7f9abc03e9a0 2024-05-03T22:31:38.575 INFO:teuthology.orchestra.run.smithi160.stdout:Scheduled mgr update... 2024-05-03T22:31:38.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.577+0000 7f9add800700 1 -- 172.21.15.160:0/1438211941 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9abc03e9a0 msgr2=0x7f9abc040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:38.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.577+0000 7f9add800700 1 --2- 172.21.15.160:0/1438211941 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9abc03e9a0 0x7f9abc040e60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40078e0 tx=0x7f9ac4008040 comp rx=0 tx=0).stop 2024-05-03T22:31:38.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.577+0000 7f9add800700 1 -- 172.21.15.160:0/1438211941 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ad8103030 msgr2=0x7f9ad819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:38.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.577+0000 7f9add800700 1 --2- 172.21.15.160:0/1438211941 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ad8103030 0x7f9ad819aa20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8005e00 tx=0x7f9ac8005030 comp rx=0 tx=0).stop 2024-05-03T22:31:38.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.577+0000 7f9add800700 1 -- 172.21.15.160:0/1438211941 shutdown_connections 2024-05-03T22:31:38.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.577+0000 7f9add800700 1 --2- 172.21.15.160:0/1438211941 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9ad819b3e0 0x7f9ad81a2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:38.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.577+0000 7f9add800700 1 --2- 172.21.15.160:0/1438211941 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9abc03e9a0 0x7f9abc040e60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:38.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.577+0000 7f9add800700 1 --2- 172.21.15.160:0/1438211941 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ad8103030 0x7f9ad819aa20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:38.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.577+0000 7f9add800700 1 --2- 172.21.15.160:0/1438211941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ad819af60 0x7f9ad819ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:38.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.577+0000 7f9add800700 1 -- 172.21.15.160:0/1438211941 >> 172.21.15.160:0/1438211941 conn(0x7f9ad80fe5d0 msgr2=0x7f9ad80ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:31:38.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.577+0000 7f9add800700 1 -- 172.21.15.160:0/1438211941 shutdown_connections 2024-05-03T22:31:38.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:31:38.578+0000 7f9add800700 1 -- 172.21.15.160:0/1438211941 wait complete. 2024-05-03T22:31:39.329 DEBUG:teuthology.orchestra.run.smithi060:mgr.y> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mgr.y.service 2024-05-03T22:31:39.337 DEBUG:teuthology.orchestra.run.smithi160:mgr.z> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mgr.z.service 2024-05-03T22:31:39.344 INFO:tasks.cephadm:Deploying OSDs... 2024-05-03T22:31:39.344 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T22:31:39.344 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/scratch_devs of=/dev/stdout 2024-05-03T22:31:39.407 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-03T22:31:39.408 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_1 2024-05-03T22:31:39.463 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-03T22:31:39.463 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:31:39.463 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-05-03T22:31:39.463 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:31:39.463 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:31:39.463 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-05-03 22:30:25.009486916 +0000 2024-05-03T22:31:39.463 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-05-03 22:24:49.280992497 +0000 2024-05-03T22:31:39.463 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-05-03 22:24:49.280992497 +0000 2024-05-03T22:31:39.463 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-05-03 22:24:49.280992497 +0000 2024-05-03T22:31:39.463 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-03T22:31:39.550 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-05-03T22:31:39.550 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-05-03T22:31:39.550 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000405894 s, 1.3 MB/s 2024-05-03T22:31:39.554 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-03T22:31:39.616 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_2 2024-05-03T22:31:39.668 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-03T22:31:39.668 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:31:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-05-03T22:31:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:31:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:31:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-05-03 22:30:25.097485574 +0000 2024-05-03T22:31:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-05-03 22:24:49.918982640 +0000 2024-05-03T22:31:39.668 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-05-03 22:24:49.918982640 +0000 2024-05-03T22:31:39.668 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-05-03 22:24:49.918982640 +0000 2024-05-03T22:31:39.668 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-03T22:31:39.746 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-05-03T22:31:39.746 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-05-03T22:31:39.746 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000378033 s, 1.4 MB/s 2024-05-03T22:31:39.749 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-03T22:31:39.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:39 smithi060 ceph-mon[31721]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi044=x;smithi060=y;smithi160=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:31:39.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:39 smithi060 ceph-mon[31721]: Saving service mgr spec with placement smithi044=x;smithi060=y;smithi160=z;count:3 2024-05-03T22:31:39.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:39 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:39.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:39 smithi060 ceph-mon[31721]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:39.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:39 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:39.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:39 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:39.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:39 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:31:39.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:39 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T22:31:39.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:39 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:39.807 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_3 2024-05-03T22:31:39.857 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-03T22:31:39.857 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:31:39.857 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-05-03T22:31:39.857 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:31:39.857 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:31:39.857 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-05-03 22:30:25.163484567 +0000 2024-05-03T22:31:39.857 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-05-03 22:24:50.553972829 +0000 2024-05-03T22:31:39.857 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-05-03 22:24:50.553972829 +0000 2024-05-03T22:31:39.857 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-05-03 22:24:50.553972829 +0000 2024-05-03T22:31:39.858 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-03T22:31:39.930 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:39 smithi044 ceph-mon[28604]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi044=x;smithi060=y;smithi160=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:31:39.930 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:39 smithi044 ceph-mon[28604]: Saving service mgr spec with placement smithi044=x;smithi060=y;smithi160=z;count:3 2024-05-03T22:31:39.930 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:39 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:39.930 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:39 smithi044 ceph-mon[28604]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:39.930 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:39 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:39.931 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:39 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:39.931 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:39 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:31:39.931 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:39 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T22:31:39.931 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:39 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:39.939 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-05-03T22:31:39.940 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-05-03T22:31:39.940 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000358855 s, 1.4 MB/s 2024-05-03T22:31:39.944 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-03T22:31:40.002 DEBUG:teuthology.orchestra.run.smithi044:> stat /dev/vg_nvme/lv_4 2024-05-03T22:31:40.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:39 smithi160 ceph-mon[32531]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi044=x;smithi060=y;smithi160=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:31:40.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:39 smithi160 ceph-mon[32531]: Saving service mgr spec with placement smithi044=x;smithi060=y;smithi160=z;count:3 2024-05-03T22:31:40.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:39 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:40.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:39 smithi160 ceph-mon[32531]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:40.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:39 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:40.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:39 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:40.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:39 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-03T22:31:40.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:39 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-03T22:31:40.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:39 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:40.058 INFO:teuthology.orchestra.run.smithi044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-03T22:31:40.058 INFO:teuthology.orchestra.run.smithi044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:31:40.059 INFO:teuthology.orchestra.run.smithi044.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-05-03T22:31:40.059 INFO:teuthology.orchestra.run.smithi044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:31:40.059 INFO:teuthology.orchestra.run.smithi044.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:31:40.059 INFO:teuthology.orchestra.run.smithi044.stdout:Access: 2024-05-03 22:30:25.236483454 +0000 2024-05-03T22:31:40.059 INFO:teuthology.orchestra.run.smithi044.stdout:Modify: 2024-05-03 22:24:51.154963544 +0000 2024-05-03T22:31:40.059 INFO:teuthology.orchestra.run.smithi044.stdout:Change: 2024-05-03 22:24:51.154963544 +0000 2024-05-03T22:31:40.059 INFO:teuthology.orchestra.run.smithi044.stdout: Birth: 2024-05-03 22:24:51.154963544 +0000 2024-05-03T22:31:40.059 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-03T22:31:40.144 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records in 2024-05-03T22:31:40.144 INFO:teuthology.orchestra.run.smithi044.stderr:1+0 records out 2024-05-03T22:31:40.144 INFO:teuthology.orchestra.run.smithi044.stderr:512 bytes copied, 0.000406807 s, 1.3 MB/s 2024-05-03T22:31:40.148 DEBUG:teuthology.orchestra.run.smithi044:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-03T22:31:40.208 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-05-03T22:31:40.208 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2024-05-03T22:31:40.270 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-03T22:31:40.271 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2024-05-03T22:31:40.324 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-03T22:31:40.325 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:31:40.325 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-05-03T22:31:40.325 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:31:40.325 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:31:40.325 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-05-03 22:31:24.055671422 +0000 2024-05-03T22:31:40.325 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-05-03 22:25:00.281309527 +0000 2024-05-03T22:31:40.325 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-05-03 22:25:00.281309527 +0000 2024-05-03T22:31:40.325 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-05-03 22:25:00.281309527 +0000 2024-05-03T22:31:40.325 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-03T22:31:40.406 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-05-03T22:31:40.406 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-05-03T22:31:40.406 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000291251 s, 1.8 MB/s 2024-05-03T22:31:40.410 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-03T22:31:40.470 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2024-05-03T22:31:40.523 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-03T22:31:40.523 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:31:40.523 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-05-03T22:31:40.523 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:31:40.523 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:31:40.523 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-05-03 22:31:24.055671422 +0000 2024-05-03T22:31:40.523 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-05-03 22:25:00.872303790 +0000 2024-05-03T22:31:40.523 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-05-03 22:25:00.872303790 +0000 2024-05-03T22:31:40.523 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-05-03 22:25:00.872303790 +0000 2024-05-03T22:31:40.524 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-03T22:31:40.603 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-05-03T22:31:40.603 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-05-03T22:31:40.604 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000303154 s, 1.7 MB/s 2024-05-03T22:31:40.607 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-03T22:31:40.664 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2024-05-03T22:31:40.717 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-03T22:31:40.717 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:31:40.717 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-05-03T22:31:40.717 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:31:40.718 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:31:40.718 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-05-03 22:31:24.056671413 +0000 2024-05-03T22:31:40.718 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-05-03 22:25:01.512297578 +0000 2024-05-03T22:31:40.718 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-05-03 22:25:01.512297578 +0000 2024-05-03T22:31:40.718 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-05-03 22:25:01.512297578 +0000 2024-05-03T22:31:40.718 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-03T22:31:40.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:40 smithi060 ceph-mon[31721]: Reconfiguring mon.c (monmap changed)... 2024-05-03T22:31:40.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:40 smithi060 ceph-mon[31721]: Reconfiguring daemon mon.c on smithi160 2024-05-03T22:31:40.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:40 smithi160 ceph-mon[32531]: Reconfiguring mon.c (monmap changed)... 2024-05-03T22:31:40.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:40 smithi160 ceph-mon[32531]: Reconfiguring daemon mon.c on smithi160 2024-05-03T22:31:40.799 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-05-03T22:31:40.800 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-05-03T22:31:40.800 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000290156 s, 1.8 MB/s 2024-05-03T22:31:40.804 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-03T22:31:40.908 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2024-05-03T22:31:40.962 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-03T22:31:40.962 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:31:40.962 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-05-03T22:31:40.963 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:31:40.963 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:31:40.963 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-05-03 22:31:24.057671403 +0000 2024-05-03T22:31:40.963 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-05-03 22:25:02.083292037 +0000 2024-05-03T22:31:40.963 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-05-03 22:25:02.083292037 +0000 2024-05-03T22:31:40.963 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-05-03 22:25:02.083292037 +0000 2024-05-03T22:31:40.963 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-03T22:31:41.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:40 smithi044 ceph-mon[28604]: Reconfiguring mon.c (monmap changed)... 2024-05-03T22:31:41.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:40 smithi044 ceph-mon[28604]: Reconfiguring daemon mon.c on smithi160 2024-05-03T22:31:41.041 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-05-03T22:31:41.042 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-05-03T22:31:41.042 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.00026724 s, 1.9 MB/s 2024-05-03T22:31:41.045 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-03T22:31:41.097 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-05-03T22:31:41.098 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/scratch_devs of=/dev/stdout 2024-05-03T22:31:41.155 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-03T22:31:41.156 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_1 2024-05-03T22:31:41.203 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-03T22:31:41.204 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:31:41.204 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 628 Links: 1 2024-05-03T22:31:41.204 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:31:41.204 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:31:41.204 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-05-03 22:31:11.818486003 +0000 2024-05-03T22:31:41.204 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-05-03 22:24:38.643539297 +0000 2024-05-03T22:31:41.204 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-05-03 22:24:38.643539297 +0000 2024-05-03T22:31:41.204 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-05-03 22:24:38.643539297 +0000 2024-05-03T22:31:41.204 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-03T22:31:41.274 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-05-03T22:31:41.274 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-05-03T22:31:41.274 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000417741 s, 1.2 MB/s 2024-05-03T22:31:41.277 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-03T22:31:41.323 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_2 2024-05-03T22:31:41.415 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-03T22:31:41.415 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:31:41.415 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 647 Links: 1 2024-05-03T22:31:41.415 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:31:41.415 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:31:41.415 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-05-03 22:31:11.819485989 +0000 2024-05-03T22:31:41.415 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-05-03 22:24:39.243530565 +0000 2024-05-03T22:31:41.415 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-05-03 22:24:39.243530565 +0000 2024-05-03T22:31:41.415 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-05-03 22:24:39.243530565 +0000 2024-05-03T22:31:41.416 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-03T22:31:41.483 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-05-03T22:31:41.483 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-05-03T22:31:41.483 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000337756 s, 1.5 MB/s 2024-05-03T22:31:41.486 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-03T22:31:41.532 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_3 2024-05-03T22:31:41.616 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-03T22:31:41.616 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:31:41.616 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 666 Links: 1 2024-05-03T22:31:41.616 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:31:41.616 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:31:41.616 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-05-03 22:31:11.820485975 +0000 2024-05-03T22:31:41.616 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-05-03 22:24:39.841521867 +0000 2024-05-03T22:31:41.617 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-05-03 22:24:39.841521867 +0000 2024-05-03T22:31:41.617 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-05-03 22:24:39.841521867 +0000 2024-05-03T22:31:41.617 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-03T22:31:41.727 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-05-03T22:31:41.727 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-05-03T22:31:41.727 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.00034961 s, 1.5 MB/s 2024-05-03T22:31:41.730 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:41 smithi160 ceph-mon[32531]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:41.730 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:41.730 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:41.730 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:31:41.730 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:41.730 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:31:41.730 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:41.730 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T22:31:41.730 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-03T22:31:41.730 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T22:31:41.731 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:41.731 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-03T22:31:41.778 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_4 2024-05-03T22:31:41.824 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-03T22:31:41.825 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-03T22:31:41.825 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 683 Links: 1 2024-05-03T22:31:41.825 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-03T22:31:41.825 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-05-03T22:31:41.825 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-05-03 22:31:11.820485975 +0000 2024-05-03T22:31:41.825 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-05-03 22:24:40.449513024 +0000 2024-05-03T22:31:41.825 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-05-03 22:24:40.449513024 +0000 2024-05-03T22:31:41.825 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-05-03 22:24:40.449513024 +0000 2024-05-03T22:31:41.825 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-03T22:31:41.938 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-05-03T22:31:41.938 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-05-03T22:31:41.938 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000339479 s, 1.5 MB/s 2024-05-03T22:31:41.941 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-03T22:31:41.994 INFO:tasks.cephadm:Deploying osd.0 on smithi044 with /dev/vg_nvme/lv_4... 2024-05-03T22:31:41.995 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-03T22:31:42.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:41 smithi044 ceph-mon[28604]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:42.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:42.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:42.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:31:42.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:42.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:31:42.004 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:42.004 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T22:31:42.004 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-03T22:31:42.004 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T22:31:42.004 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:42.004 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:41 smithi060 ceph-mon[31721]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:42.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:42.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:42.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:31:42.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:42.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:31:42.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:42.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T22:31:42.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-03T22:31:42.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T22:31:42.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:42.463 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:31:42.693 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:42 smithi160 ceph-mon[32531]: Deploying daemon mgr.z on smithi160 2024-05-03T22:31:42.923 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:42 smithi044 ceph-mon[28604]: Deploying daemon mgr.z on smithi160 2024-05-03T22:31:43.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:42 smithi060 ceph-mon[31721]: Deploying daemon mgr.z on smithi160 2024-05-03T22:31:43.633 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:43 smithi044 ceph-mon[28604]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:43.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:43 smithi160 ceph-mon[32531]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:44.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:43 smithi060 ceph-mon[31721]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:44.515 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:44 smithi160 systemd[1]: Starting Ceph mgr.z for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T22:31:44.828 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:44 smithi160 podman[34421]: 2024-05-03 22:31:44.546821829 +0000 UTC m=+0.126514295 container create 3fc33530ccfba8d8ee288d9f8b73de0c311c621b2987e3b0703fe9b21b527206 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-05-03T22:31:44.828 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:44 smithi160 podman[34421]: 2024-05-03 22:31:44.45283029 +0000 UTC m=+0.032522733 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:31:44.828 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:44 smithi160 podman[34421]: 2024-05-03 22:31:44.764304783 +0000 UTC m=+0.343997325 container init 3fc33530ccfba8d8ee288d9f8b73de0c311c621b2987e3b0703fe9b21b527206 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:31:44.828 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:44 smithi160 podman[34421]: 2024-05-03 22:31:44.776693337 +0000 UTC m=+0.356385785 container start 3fc33530ccfba8d8ee288d9f8b73de0c311c621b2987e3b0703fe9b21b527206 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS) 2024-05-03T22:31:44.828 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:44 smithi160 ceph-mgr[34440]: -- 172.21.15.160:0/230383918 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dd5218e5a0 con 0x55dd52163000 2024-05-03T22:31:45.184 INFO:teuthology.orchestra.run.smithi044.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-03T22:31:45.184 INFO:teuthology.orchestra.run.smithi044.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-03T22:31:45.184 INFO:teuthology.orchestra.run.smithi044.stderr: stderr: 10+0 records in 2024-05-03T22:31:45.184 INFO:teuthology.orchestra.run.smithi044.stderr:10+0 records out 2024-05-03T22:31:45.184 INFO:teuthology.orchestra.run.smithi044.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.033515 s, 313 MB/s 2024-05-03T22:31:45.184 INFO:teuthology.orchestra.run.smithi044.stderr:--> Zapping successful for: 2024-05-03T22:31:45.265 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:44 smithi160 bash[34421]: 3fc33530ccfba8d8ee288d9f8b73de0c311c621b2987e3b0703fe9b21b527206 2024-05-03T22:31:45.265 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:44 smithi160 systemd[1]: Started Ceph mgr.z for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:31:45.265 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:45 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:45.021+0000 7f9b56f40200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-03T22:31:45.765 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:45 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:45.281+0000 7f9b56f40200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:31:45.765 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:45 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:45.411+0000 7f9b56f40200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-03T22:31:46.049 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_4 2024-05-03T22:31:46.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:46 smithi044 ceph-mon[28604]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:46.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:46.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:46.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:46.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T22:31:46.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-03T22:31:46.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T22:31:46.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:46.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:46 smithi044 ceph-mon[28604]: Deploying daemon mgr.y on smithi060 2024-05-03T22:31:46.265 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:45 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:45.805+0000 7f9b56f40200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-03T22:31:46.265 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:45 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:45.918+0000 7f9b56f40200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-03T22:31:46.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:46 smithi160 ceph-mon[32531]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:46.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:46.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:46.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:46.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T22:31:46.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-03T22:31:46.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T22:31:46.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:46.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:46 smithi160 ceph-mon[32531]: Deploying daemon mgr.y on smithi060 2024-05-03T22:31:46.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:46 smithi060 ceph-mon[31721]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:46.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:46.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:46.283 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:46.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T22:31:46.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-03T22:31:46.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T22:31:46.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:46.284 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:46 smithi060 ceph-mon[31721]: Deploying daemon mgr.y on smithi060 2024-05-03T22:31:46.495 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:31:47.765 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:47 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:47.506+0000 7f9b56f40200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-03T22:31:47.765 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:47 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:47.735+0000 7f9b56f40200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-03T22:31:48.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:48 smithi044 ceph-mon[28604]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:48.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:48 smithi060 ceph-mon[31721]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:48.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:48 smithi160 ceph-mon[32531]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:48.265 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:47 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:47.952+0000 7f9b56f40200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-03T22:31:48.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.461+0000 7f7f90000700 1 -- 172.21.15.44:0/1190230962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f8810b3d0 msgr2=0x7f7f8810d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:48.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.461+0000 7f7f90000700 1 --2- 172.21.15.44:0/1190230962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f8810b3d0 0x7f7f8810d860 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009f90 tx=0x7f7f8000b330 comp rx=0 tx=0).stop 2024-05-03T22:31:48.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.461+0000 7f7f90000700 1 -- 172.21.15.44:0/1190230962 shutdown_connections 2024-05-03T22:31:48.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.461+0000 7f7f90000700 1 --2- 172.21.15.44:0/1190230962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f8810b3d0 0x7f7f8810d860 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:48.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.461+0000 7f7f90000700 1 --2- 172.21.15.44:0/1190230962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f880774d0 0x7f7f88075930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.461+0000 7f7f90000700 1 --2- 172.21.15.44:0/1190230962 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f88075f00 0x7f7f88076380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.461+0000 7f7f90000700 1 -- 172.21.15.44:0/1190230962 >> 172.21.15.44:0/1190230962 conn(0x7f7f880feaa0 msgr2=0x7f7f88100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:31:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.461+0000 7f7f90000700 1 -- 172.21.15.44:0/1190230962 shutdown_connections 2024-05-03T22:31:48.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.461+0000 7f7f90000700 1 -- 172.21.15.44:0/1190230962 wait complete. 2024-05-03T22:31:48.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.462+0000 7f7f90000700 1 Processor -- start 2024-05-03T22:31:48.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.463+0000 7f7f90000700 1 -- start start 2024-05-03T22:31:48.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.463+0000 7f7f90000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f88075f00 0x7f7f8819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:48.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.463+0000 7f7f90000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f880774d0 0x7f7f8819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:48.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.463+0000 7f7f90000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f8810b3d0 0x7f7f881a2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:48.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.463+0000 7f7f90000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7f881112f0 con 0x7f7f880774d0 2024-05-03T22:31:48.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.463+0000 7f7f90000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7f88111170 con 0x7f7f8810b3d0 2024-05-03T22:31:48.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.463+0000 7f7f90000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7f88111470 con 0x7f7f88075f00 2024-05-03T22:31:48.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.463+0000 7f7f8cc00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f880774d0 0x7f7f8819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:48.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.463+0000 7f7f8cc00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f880774d0 0x7f7f8819be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51856/0 (socket says 172.21.15.44:51856) 2024-05-03T22:31:48.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.463+0000 7f7f8cc00700 1 -- 172.21.15.44:0/4283977383 learned_addr learned my addr 172.21.15.44:0/4283977383 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:31:48.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.463+0000 7f7f8d600700 1 --2- 172.21.15.44:0/4283977383 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f88075f00 0x7f7f8819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:48.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.464+0000 7f7f8e000700 1 --2- 172.21.15.44:0/4283977383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f8810b3d0 0x7f7f881a2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:48.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.464+0000 7f7f8cc00700 1 -- 172.21.15.44:0/4283977383 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f88075f00 msgr2=0x7f7f8819b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:48.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.464+0000 7f7f8cc00700 1 --2- 172.21.15.44:0/4283977383 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f88075f00 0x7f7f8819b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:48.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.464+0000 7f7f8cc00700 1 -- 172.21.15.44:0/4283977383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f8810b3d0 msgr2=0x7f7f881a2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:31:48.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.464+0000 7f7f8cc00700 1 --2- 172.21.15.44:0/4283977383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f8810b3d0 0x7f7f881a2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:31:48.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.464+0000 7f7f8cc00700 1 -- 172.21.15.44:0/4283977383 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f881a3530 con 0x7f7f880774d0 2024-05-03T22:31:48.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.464+0000 7f7f8e000700 1 --2- 172.21.15.44:0/4283977383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f8810b3d0 0x7f7f881a2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:31:48.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.464+0000 7f7f8cc00700 1 --2- 172.21.15.44:0/4283977383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f880774d0 0x7f7f8819be10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400ec20 tx=0x7f7f7400ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:31:48.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.465+0000 7f7f86000700 1 -- 172.21.15.44:0/4283977383 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7400cd40 con 0x7f7f880774d0 2024-05-03T22:31:48.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.465+0000 7f7f86000700 1 -- 172.21.15.44:0/4283977383 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f7f74010900 con 0x7f7f880774d0 2024-05-03T22:31:48.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.465+0000 7f7f90000700 1 -- 172.21.15.44:0/4283977383 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f881a3820 con 0x7f7f880774d0 2024-05-03T22:31:48.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.465+0000 7f7f86000700 1 -- 172.21.15.44:0/4283977383 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f740189b0 con 0x7f7f880774d0 2024-05-03T22:31:48.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.465+0000 7f7f90000700 1 -- 172.21.15.44:0/4283977383 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f881a3d60 con 0x7f7f880774d0 2024-05-03T22:31:48.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.466+0000 7f7f86000700 1 -- 172.21.15.44:0/4283977383 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f7f7401f020 con 0x7f7f880774d0 2024-05-03T22:31:48.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.466+0000 7f7f90000700 1 -- 172.21.15.44:0/4283977383 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f8806a190 con 0x7f7f880774d0 2024-05-03T22:31:48.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.467+0000 7f7f86000700 1 --2- 172.21.15.44:0/4283977383 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7f7003e750 0x7f7f70040c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:31:48.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.467+0000 7f7f86000700 1 -- 172.21.15.44:0/4283977383 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7f74052b30 con 0x7f7f880774d0 2024-05-03T22:31:48.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.467+0000 7f7f8d600700 1 --2- 172.21.15.44:0/4283977383 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7f7003e750 0x7f7f70040c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:31:48.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.468+0000 7f7f8d600700 1 --2- 172.21.15.44:0/4283977383 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7f7003e750 0x7f7f70040c10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7f880778b0 tx=0x7f7f7c00b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:31:48.474 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.473+0000 7f7f86000700 1 -- 172.21.15.44:0/4283977383 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f7f74018c20 con 0x7f7f880774d0 2024-05-03T22:31:48.715 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:48 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:48.335+0000 7f9b56f40200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-03T22:31:48.715 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:48 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:48.459+0000 7f9b56f40200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-03T22:31:48.720 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:48.718+0000 7f7f90000700 1 -- 172.21.15.44:0/4283977383 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7f880638e0 con 0x7f7f7003e750 2024-05-03T22:31:48.742 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:48 smithi060 podman[33092]: 2024-05-03 22:31:48.403758257 +0000 UTC m=+0.152159627 container create 37779647d94c304d1b6baad848e94da400daef1b47f7e773ff0b08245ecab775 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-03T22:31:48.742 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:48 smithi060 podman[33092]: 2024-05-03 22:31:48.740340641 +0000 UTC m=+0.488742021 container init 37779647d94c304d1b6baad848e94da400daef1b47f7e773ff0b08245ecab775 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-05-03T22:31:48.969 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:48 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:48.712+0000 7f9b56f40200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-03T22:31:48.970 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:48 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:48.967+0000 7f9b56f40200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:31:49.001 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:48 smithi060 podman[33092]: 2024-05-03 22:31:48.751011145 +0000 UTC m=+0.499412453 container start 37779647d94c304d1b6baad848e94da400daef1b47f7e773ff0b08245ecab775 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:31:49.001 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:48 smithi060 ceph-mgr[33111]: -- 172.21.15.60:0/604562215 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a24cbd85a0 con 0x55a24cbad000 2024-05-03T22:31:49.002 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:48 smithi060 bash[33092]: 37779647d94c304d1b6baad848e94da400daef1b47f7e773ff0b08245ecab775 2024-05-03T22:31:49.002 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:48 smithi060 systemd[1]: Started Ceph mgr.y for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:31:49.255 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:49 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:48.998+0000 7f989fa6c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-03T22:31:49.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:49 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:31:49.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:49 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:31:49.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:49 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:49.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:49 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:49.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:49 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:49.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:49 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:31:49.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:49 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:31:49.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:49 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:49.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:49 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:49.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:49 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:49.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:49 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:31:49.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:49 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:31:49.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:49 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:49.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:49 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:49.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:49 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:49.755 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:49 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:49.268+0000 7f989fa6c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:31:49.755 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:49 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:49.412+0000 7f989fa6c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-03T22:31:49.952 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:49 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:49.791+0000 7f9b56f40200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-03T22:31:50.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:50 smithi044 ceph-mon[28604]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:31:50.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:50 smithi044 ceph-mon[28604]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:50.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:50 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:50.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:50 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:50.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:50 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:31:50.254 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:49 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:49.844+0000 7f989fa6c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-03T22:31:50.255 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:49 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:49.962+0000 7f989fa6c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-03T22:31:50.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:50 smithi060 ceph-mon[31721]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:31:50.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:50 smithi060 ceph-mon[31721]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:50.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:50 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:50.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:50 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:50.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:50 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:31:50.265 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:50 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:50.095+0000 7f9b56f40200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-03T22:31:50.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:50 smithi160 ceph-mon[32531]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:31:50.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:50 smithi160 ceph-mon[32531]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:50.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:50 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:50.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:50 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:50.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:50 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:31:50.852 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:50 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:50.717+0000 7f9b56f40200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-03T22:31:51.265 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:50 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:50.849+0000 7f9b56f40200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-03T22:31:51.765 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:51 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:51.334+0000 7f9b56f40200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-03T22:31:52.005 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:51 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:51.694+0000 7f989fa6c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-03T22:31:52.005 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:51 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:51.936+0000 7f989fa6c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-03T22:31:52.174 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:51 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:51.786+0000 7f9b56f40200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-03T22:31:52.174 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:51 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:51.908+0000 7f9b56f40200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-03T22:31:52.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:52 smithi044 ceph-mon[28604]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:52.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:52 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:52.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:52 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:52.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:52 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:52.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:52 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:52.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:52 smithi060 ceph-mon[31721]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:52.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:52 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:52.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:52 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:52.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:52 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:52.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:52 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:52.505 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:52 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:52.159+0000 7f989fa6c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-03T22:31:52.515 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:52 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:52.230+0000 7f9b56f40200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-03T22:31:52.515 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:52 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:52.408+0000 7f9b56f40200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-03T22:31:52.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:52 smithi160 ceph-mon[32531]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:52.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:52 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:52.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:52 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:52.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:52 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:52.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:52 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:52.955 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:52 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:52.561+0000 7f989fa6c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-03T22:31:52.955 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:52 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:52.690+0000 7f989fa6c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-03T22:31:53.064 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:52 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:52.785+0000 7f9b56f40200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-03T22:31:53.064 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:52 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:52.940+0000 7f9b56f40200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-03T22:31:53.064 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:53 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:53.062+0000 7f9b56f40200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-03T22:31:53.218 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:53 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:53.218 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:53 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:31:53.218 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:53 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:53.219 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:53 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/27731687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "05869397-bdc9-4c38-b1c6-deb466454dd3"}]: dispatch 2024-05-03T22:31:53.219 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:53 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/27731687' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "05869397-bdc9-4c38-b1c6-deb466454dd3"}]': finished 2024-05-03T22:31:53.219 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:53 smithi060 ceph-mon[31721]: osdmap e5: 1 total, 0 up, 1 in 2024-05-03T22:31:53.219 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:53 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:31:53.219 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:53 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T22:31:53.219 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:53 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T22:31:53.219 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:53 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:53.219 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:52 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:52.953+0000 7f989fa6c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-03T22:31:53.219 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:53 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:53.215+0000 7f989fa6c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-03T22:31:53.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:53.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:31:53.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:53.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:53 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/27731687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "05869397-bdc9-4c38-b1c6-deb466454dd3"}]: dispatch 2024-05-03T22:31:53.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:53 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/27731687' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "05869397-bdc9-4c38-b1c6-deb466454dd3"}]': finished 2024-05-03T22:31:53.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:53 smithi044 ceph-mon[28604]: osdmap e5: 1 total, 0 up, 1 in 2024-05-03T22:31:53.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:31:53.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T22:31:53.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T22:31:53.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:53.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:53 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:53.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:53 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:31:53.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:53 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:53.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:53 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/27731687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "05869397-bdc9-4c38-b1c6-deb466454dd3"}]: dispatch 2024-05-03T22:31:53.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:53 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/27731687' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "05869397-bdc9-4c38-b1c6-deb466454dd3"}]': finished 2024-05-03T22:31:53.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:53 smithi160 ceph-mon[32531]: osdmap e5: 1 total, 0 up, 1 in 2024-05-03T22:31:53.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:53 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:31:53.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:53 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-03T22:31:53.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:53 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-03T22:31:53.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:53 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:31:54.103 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:53 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:53.816+0000 7f9b56f40200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-03T22:31:54.336 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:54 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:54.036+0000 7f989fa6c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-03T22:31:54.336 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:54 smithi060 ceph-mon[31721]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:54.336 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:54 smithi060 ceph-mon[31721]: Reconfiguring mgr.x (unknown last config time)... 2024-05-03T22:31:54.336 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:54 smithi060 ceph-mon[31721]: Reconfiguring daemon mgr.x on smithi044 2024-05-03T22:31:54.336 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:54 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3525941985' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:31:54.337 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:54 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:54.337 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:54 smithi060 ceph-mon[31721]: Standby manager daemon z started 2024-05-03T22:31:54.337 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:54 smithi060 ceph-mon[31721]: from='mgr.? 172.21.15.160:0/2314415015' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-03T22:31:54.337 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:54 smithi060 ceph-mon[31721]: from='mgr.? 172.21.15.160:0/2314415015' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-03T22:31:54.337 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:54 smithi060 ceph-mon[31721]: from='mgr.? 172.21.15.160:0/2314415015' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-03T22:31:54.337 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:54 smithi060 ceph-mon[31721]: from='mgr.? 172.21.15.160:0/2314415015' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-03T22:31:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:54 smithi044 ceph-mon[28604]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:54 smithi044 ceph-mon[28604]: Reconfiguring mgr.x (unknown last config time)... 2024-05-03T22:31:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:54 smithi044 ceph-mon[28604]: Reconfiguring daemon mgr.x on smithi044 2024-05-03T22:31:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:54 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3525941985' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:31:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:54 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:54 smithi044 ceph-mon[28604]: Standby manager daemon z started 2024-05-03T22:31:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:54 smithi044 ceph-mon[28604]: from='mgr.? 172.21.15.160:0/2314415015' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-03T22:31:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:54 smithi044 ceph-mon[28604]: from='mgr.? 172.21.15.160:0/2314415015' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-03T22:31:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:54 smithi044 ceph-mon[28604]: from='mgr.? 172.21.15.160:0/2314415015' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-03T22:31:54.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:54 smithi044 ceph-mon[28604]: from='mgr.? 172.21.15.160:0/2314415015' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-03T22:31:54.515 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 22:31:54 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z[34436]: 2024-05-03T22:31:54.101+0000 7f9b56f40200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-03T22:31:54.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:54 smithi160 ceph-mon[32531]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:54.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:54 smithi160 ceph-mon[32531]: Reconfiguring mgr.x (unknown last config time)... 2024-05-03T22:31:54.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:54 smithi160 ceph-mon[32531]: Reconfiguring daemon mgr.x on smithi044 2024-05-03T22:31:54.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:54 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3525941985' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:31:54.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:54 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:54.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:54 smithi160 ceph-mon[32531]: Standby manager daemon z started 2024-05-03T22:31:54.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:54 smithi160 ceph-mon[32531]: from='mgr.? 172.21.15.160:0/2314415015' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-03T22:31:54.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:54 smithi160 ceph-mon[32531]: from='mgr.? 172.21.15.160:0/2314415015' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-03T22:31:54.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:54 smithi160 ceph-mon[32531]: from='mgr.? 172.21.15.160:0/2314415015' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-03T22:31:54.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:54 smithi160 ceph-mon[32531]: from='mgr.? 172.21.15.160:0/2314415015' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-03T22:31:54.755 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:54 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:54.333+0000 7f989fa6c200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-03T22:31:54.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:54.879+0000 7f7f86000700 1 -- 172.21.15.44:0/4283977383 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mgrmap(e 14) ==== 99937+0+0 (secure 0 0 0) 0x7f7f74010430 con 0x7f7f880774d0 2024-05-03T22:31:55.255 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:54 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:54.912+0000 7f989fa6c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-03T22:31:55.255 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:55 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:55.044+0000 7f989fa6c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-03T22:31:55.873 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:55 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:55.520+0000 7f989fa6c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-03T22:31:56.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:55 smithi044 ceph-mon[28604]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:56.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:55 smithi044 ceph-mon[28604]: mgrmap e14: x(active, since 106s), standbys: z 2024-05-03T22:31:56.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:55 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-03T22:31:56.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:55 smithi060 ceph-mon[31721]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:56.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:55 smithi060 ceph-mon[31721]: mgrmap e14: x(active, since 106s), standbys: z 2024-05-03T22:31:56.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:55 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-03T22:31:56.255 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:55 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:55.992+0000 7f989fa6c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-03T22:31:56.255 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:56 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:56.121+0000 7f989fa6c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-03T22:31:56.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:55 smithi160 ceph-mon[32531]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:56.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:55 smithi160 ceph-mon[32531]: mgrmap e14: x(active, since 106s), standbys: z 2024-05-03T22:31:56.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:55 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-03T22:31:56.755 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:56 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:56.455+0000 7f989fa6c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-03T22:31:56.755 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:56 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:56.640+0000 7f989fa6c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-03T22:31:57.309 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:57 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:57.022+0000 7f989fa6c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-03T22:31:57.309 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:57 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:57.179+0000 7f989fa6c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-03T22:31:57.309 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:57 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:57.306+0000 7f989fa6c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-03T22:31:58.065 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:57 smithi044 ceph-mon[28604]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:58.255 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:58 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:58.095+0000 7f989fa6c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-03T22:31:58.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:57 smithi060 ceph-mon[31721]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:58.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:57 smithi160 ceph-mon[32531]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:58.755 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 22:31:58 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y[33107]: 2024-05-03T22:31:58.394+0000 7f989fa6c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-03T22:31:58.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:31:58.897+0000 7f7f86000700 1 -- 172.21.15.44:0/4283977383 <== mon.0 v2:172.21.15.44:3300/0 8 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f7f7400fca0 con 0x7f7f880774d0 2024-05-03T22:31:59.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:58 smithi044 ceph-mon[28604]: Standby manager daemon y started 2024-05-03T22:31:59.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:58 smithi044 ceph-mon[28604]: from='mgr.? 172.21.15.60:0/3213521658' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-03T22:31:59.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:58 smithi044 ceph-mon[28604]: from='mgr.? 172.21.15.60:0/3213521658' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-03T22:31:59.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:58 smithi044 ceph-mon[28604]: from='mgr.? 172.21.15.60:0/3213521658' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-03T22:31:59.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:58 smithi044 ceph-mon[28604]: from='mgr.? 172.21.15.60:0/3213521658' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-03T22:31:59.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:58 smithi060 ceph-mon[31721]: Standby manager daemon y started 2024-05-03T22:31:59.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:58 smithi060 ceph-mon[31721]: from='mgr.? 172.21.15.60:0/3213521658' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-03T22:31:59.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:58 smithi060 ceph-mon[31721]: from='mgr.? 172.21.15.60:0/3213521658' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-03T22:31:59.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:58 smithi060 ceph-mon[31721]: from='mgr.? 172.21.15.60:0/3213521658' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-03T22:31:59.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:58 smithi060 ceph-mon[31721]: from='mgr.? 172.21.15.60:0/3213521658' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-03T22:31:59.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:58 smithi160 ceph-mon[32531]: Standby manager daemon y started 2024-05-03T22:31:59.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:58 smithi160 ceph-mon[32531]: from='mgr.? 172.21.15.60:0/3213521658' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-03T22:31:59.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:58 smithi160 ceph-mon[32531]: from='mgr.? 172.21.15.60:0/3213521658' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-03T22:31:59.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:58 smithi160 ceph-mon[32531]: from='mgr.? 172.21.15.60:0/3213521658' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-03T22:31:59.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:58 smithi160 ceph-mon[32531]: from='mgr.? 172.21.15.60:0/3213521658' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-03T22:31:59.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:59 smithi044 ceph-mon[28604]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:31:59.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:59 smithi044 ceph-mon[28604]: mgrmap e15: x(active, since 110s), standbys: y, z 2024-05-03T22:31:59.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:59 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-03T22:31:59.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:59 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:59.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:59 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:31:59.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:31:59 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:32:00.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:59 smithi060 ceph-mon[31721]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:00.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:59 smithi060 ceph-mon[31721]: mgrmap e15: x(active, since 110s), standbys: y, z 2024-05-03T22:32:00.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:59 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-03T22:32:00.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:59 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:00.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:59 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:00.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:31:59 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:32:00.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:59 smithi160 ceph-mon[32531]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:00.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:59 smithi160 ceph-mon[32531]: mgrmap e15: x(active, since 110s), standbys: y, z 2024-05-03T22:32:00.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:59 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-03T22:32:00.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:59 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:00.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:59 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:00.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:31:59 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:32:01.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:00 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:01.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:00 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:32:01.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:00 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:01.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:00 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:01.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:00 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:32:01.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:00 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:01.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:00 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:01.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:00 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:32:01.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:00 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:02.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:02 smithi044 ceph-mon[28604]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:02.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:02 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-03T22:32:02.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:02 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:02.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:02 smithi060 ceph-mon[31721]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:02.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:02 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-03T22:32:02.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:02 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:02.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:02 smithi160 ceph-mon[32531]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:02.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:02 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-03T22:32:02.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:02 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:03.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:03 smithi044 ceph-mon[28604]: Deploying daemon osd.0 on smithi044 2024-05-03T22:32:03.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:03 smithi060 ceph-mon[31721]: Deploying daemon osd.0 on smithi044 2024-05-03T22:32:03.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:03 smithi160 ceph-mon[32531]: Deploying daemon osd.0 on smithi044 2024-05-03T22:32:04.481 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:04 smithi044 ceph-mon[28604]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:04.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:04 smithi060 ceph-mon[31721]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:04.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:04 smithi160 ceph-mon[32531]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:05.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:05 smithi044 ceph-mon[28604]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:05.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:05 smithi060 ceph-mon[31721]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:05.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:05 smithi160 ceph-mon[32531]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:08.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:07 smithi044 ceph-mon[28604]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:08.208 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:07 smithi060 ceph-mon[31721]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:08.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:07 smithi160 ceph-mon[32531]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:10.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:09 smithi044 ceph-mon[28604]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:10.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:09 smithi060 ceph-mon[31721]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:10.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:09 smithi160 ceph-mon[32531]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:11.242 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:11.243 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:11.243 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:32:11.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:11.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:11.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:32:11.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:11.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:11.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:32:12.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:11 smithi044 ceph-mon[28604]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:12.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:11 smithi060 ceph-mon[31721]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:12.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:11 smithi160 ceph-mon[32531]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:14.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:14 smithi044 ceph-mon[28604]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:14.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:14 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:14.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:14 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:14.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:14 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:14.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:14 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:32:14.238 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:14 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:14.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:14 smithi060 ceph-mon[31721]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:14.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:14 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:14.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:14 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:14.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:14 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:14.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:14 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:32:14.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:14 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:14.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:14 smithi160 ceph-mon[32531]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:14.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:14 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:14.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:14 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:14.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:14 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:14.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:14 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:32:14.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:14 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:14.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:32:14.715+0000 7f7f86000700 1 -- 172.21.15.44:0/4283977383 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7f880638e0 con 0x7f7f7003e750 2024-05-03T22:32:14.720 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 0 on host 'smithi044' 2024-05-03T22:32:14.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:32:14.719+0000 7f7f90000700 1 -- 172.21.15.44:0/4283977383 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7f7003e750 msgr2=0x7f7f70040c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:32:14.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:32:14.719+0000 7f7f90000700 1 --2- 172.21.15.44:0/4283977383 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7f7003e750 0x7f7f70040c10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7f880778b0 tx=0x7f7f7c00b3c0 comp rx=0 tx=0).stop 2024-05-03T22:32:14.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:32:14.719+0000 7f7f90000700 1 -- 172.21.15.44:0/4283977383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f880774d0 msgr2=0x7f7f8819be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:32:14.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:32:14.719+0000 7f7f90000700 1 --2- 172.21.15.44:0/4283977383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f880774d0 0x7f7f8819be10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7f7400ec20 tx=0x7f7f7400ef30 comp rx=0 tx=0).stop 2024-05-03T22:32:14.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:32:14.719+0000 7f7f90000700 1 -- 172.21.15.44:0/4283977383 shutdown_connections 2024-05-03T22:32:14.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:32:14.719+0000 7f7f90000700 1 --2- 172.21.15.44:0/4283977383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f8810b3d0 0x7f7f881a2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:32:14.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:32:14.719+0000 7f7f90000700 1 --2- 172.21.15.44:0/4283977383 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7f7003e750 0x7f7f70040c10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:32:14.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:32:14.719+0000 7f7f90000700 1 --2- 172.21.15.44:0/4283977383 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f88075f00 0x7f7f8819b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:32:14.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:32:14.719+0000 7f7f90000700 1 --2- 172.21.15.44:0/4283977383 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7f880774d0 0x7f7f8819be10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:32:14.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:32:14.719+0000 7f7f90000700 1 -- 172.21.15.44:0/4283977383 >> 172.21.15.44:0/4283977383 conn(0x7f7f880feaa0 msgr2=0x7f7f881072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:32:14.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:32:14.720+0000 7f7f90000700 1 -- 172.21.15.44:0/4283977383 shutdown_connections 2024-05-03T22:32:14.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:32:14.720+0000 7f7f90000700 1 -- 172.21.15.44:0/4283977383 wait complete. 2024-05-03T22:32:15.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:15 smithi160 ceph-mon[32531]: from='osd.0 [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-03T22:32:15.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:15 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:15.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:15 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:32:15.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:15 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:15.460 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:15 smithi044 ceph-mon[28604]: from='osd.0 [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-03T22:32:15.460 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:15 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:15.461 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:15 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:32:15.461 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:15 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:15.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:15 smithi060 ceph-mon[31721]: from='osd.0 [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-03T22:32:15.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:15 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:15.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:15 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:32:15.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:15 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:15.527 DEBUG:teuthology.orchestra.run.smithi044:osd.0> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.0.service 2024-05-03T22:32:15.531 INFO:tasks.cephadm:Deploying osd.1 on smithi060 with /dev/vg_nvme/lv_4... 2024-05-03T22:32:15.532 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-03T22:32:15.983 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T22:32:16.392 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:16 smithi060 ceph-mon[31721]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:16.393 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:16 smithi060 ceph-mon[31721]: from='osd.0 [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-03T22:32:16.393 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:16 smithi060 ceph-mon[31721]: osdmap e6: 1 total, 0 up, 1 in 2024-05-03T22:32:16.393 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:16 smithi060 ceph-mon[31721]: from='osd.0 [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-05-03T22:32:16.393 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:16 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:32:16.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:16 smithi044 ceph-mon[28604]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:16.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:16 smithi044 ceph-mon[28604]: from='osd.0 [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-03T22:32:16.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:16 smithi044 ceph-mon[28604]: osdmap e6: 1 total, 0 up, 1 in 2024-05-03T22:32:16.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:16 smithi044 ceph-mon[28604]: from='osd.0 [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-05-03T22:32:16.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:16 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:32:16.503 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 22:32:16 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-0[43553]: 2024-05-03T22:32:16.040+0000 7fa99b400700 -1 osd.0 0 waiting for initial osdmap 2024-05-03T22:32:16.503 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 22:32:16 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-0[43553]: 2024-05-03T22:32:16.050+0000 7fa996200700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T22:32:16.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:16 smithi160 ceph-mon[32531]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:16.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:16 smithi160 ceph-mon[32531]: from='osd.0 [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-03T22:32:16.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:16 smithi160 ceph-mon[32531]: osdmap e6: 1 total, 0 up, 1 in 2024-05-03T22:32:16.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:16 smithi160 ceph-mon[32531]: from='osd.0 [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-05-03T22:32:16.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:16 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:32:17.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:17 smithi044 ceph-mon[28604]: from='osd.0 [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-05-03T22:32:17.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:17 smithi044 ceph-mon[28604]: osdmap e7: 1 total, 0 up, 1 in 2024-05-03T22:32:17.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:17 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:32:17.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:17 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:32:17.448 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:17 smithi060 ceph-mon[31721]: from='osd.0 [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-05-03T22:32:17.448 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:17 smithi060 ceph-mon[31721]: osdmap e7: 1 total, 0 up, 1 in 2024-05-03T22:32:17.448 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:17 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:32:17.448 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:17 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:32:17.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:17 smithi160 ceph-mon[32531]: from='osd.0 [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-05-03T22:32:17.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:17 smithi160 ceph-mon[32531]: osdmap e7: 1 total, 0 up, 1 in 2024-05-03T22:32:17.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:17 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:32:17.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:17 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:32:18.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:18 smithi044 ceph-mon[28604]: purged_snaps scrub starts 2024-05-03T22:32:18.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:18 smithi044 ceph-mon[28604]: purged_snaps scrub ok 2024-05-03T22:32:18.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:18 smithi044 ceph-mon[28604]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:18.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:18 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:32:18.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:18 smithi044 ceph-mon[28604]: osd.0 [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560] boot 2024-05-03T22:32:18.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:18 smithi044 ceph-mon[28604]: osdmap e8: 1 total, 1 up, 1 in 2024-05-03T22:32:18.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:18 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:32:18.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:18 smithi060 ceph-mon[31721]: purged_snaps scrub starts 2024-05-03T22:32:18.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:18 smithi060 ceph-mon[31721]: purged_snaps scrub ok 2024-05-03T22:32:18.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:18 smithi060 ceph-mon[31721]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:18.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:18 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:32:18.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:18 smithi060 ceph-mon[31721]: osd.0 [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560] boot 2024-05-03T22:32:18.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:18 smithi060 ceph-mon[31721]: osdmap e8: 1 total, 1 up, 1 in 2024-05-03T22:32:18.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:18 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:32:18.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:18 smithi160 ceph-mon[32531]: purged_snaps scrub starts 2024-05-03T22:32:18.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:18 smithi160 ceph-mon[32531]: purged_snaps scrub ok 2024-05-03T22:32:18.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:18 smithi160 ceph-mon[32531]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-03T22:32:18.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:18 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:32:18.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:18 smithi160 ceph-mon[32531]: osd.0 [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560] boot 2024-05-03T22:32:18.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:18 smithi160 ceph-mon[32531]: osdmap e8: 1 total, 1 up, 1 in 2024-05-03T22:32:18.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:18 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-03T22:32:19.026 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-03T22:32:19.026 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-03T22:32:19.026 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2024-05-03T22:32:19.026 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2024-05-03T22:32:19.026 INFO:teuthology.orchestra.run.smithi060.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0390786 s, 268 MB/s 2024-05-03T22:32:19.026 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2024-05-03T22:32:19.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:19 smithi060 ceph-mon[31721]: osdmap e9: 1 total, 1 up, 1 in 2024-05-03T22:32:19.417 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:19 smithi160 ceph-mon[32531]: osdmap e9: 1 total, 1 up, 1 in 2024-05-03T22:32:19.498 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:19 smithi044 ceph-mon[28604]: osdmap e9: 1 total, 1 up, 1 in 2024-05-03T22:32:19.770 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi060:vg_nvme/lv_4 2024-05-03T22:32:20.222 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T22:32:20.239 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:20 smithi044 ceph-mon[28604]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:20.371 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:20 smithi060 ceph-mon[31721]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:20.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:20 smithi160 ceph-mon[32531]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:21.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:21 smithi060 ceph-mon[31721]: Detected new or changed devices on smithi044 2024-05-03T22:32:21.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:21 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:21.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:21 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:21.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:21 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:32:21.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:21 smithi060 ceph-mon[31721]: Adjusting osd_memory_target on smithi044 to 17094M 2024-05-03T22:32:21.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:21 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:21.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:21 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:21.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:21 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:32:21.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:21 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:21.662 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:21 smithi060 ceph-mon[31721]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:21.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:21 smithi044 ceph-mon[28604]: Detected new or changed devices on smithi044 2024-05-03T22:32:21.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:21 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:21.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:21 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:21.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:21 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:32:21.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:21 smithi044 ceph-mon[28604]: Adjusting osd_memory_target on smithi044 to 17094M 2024-05-03T22:32:21.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:21 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:21.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:21 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:21.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:21 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:32:21.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:21 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:21.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:21 smithi044 ceph-mon[28604]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:21.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:21 smithi160 ceph-mon[32531]: Detected new or changed devices on smithi044 2024-05-03T22:32:21.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:21 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:21.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:21 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:21.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:21 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:32:21.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:21 smithi160 ceph-mon[32531]: Adjusting osd_memory_target on smithi044 to 17094M 2024-05-03T22:32:21.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:21 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:21.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:21 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:21.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:21 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:32:21.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:21 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:21.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:21 smithi160 ceph-mon[32531]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:22.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.124+0000 7fa55be00700 1 -- 172.21.15.60:0/3436384367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55410fae0 msgr2=0x7fa554111ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:32:22.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.124+0000 7fa55be00700 1 --2- 172.21.15.60:0/3436384367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55410fae0 0x7fa554111ed0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00b0a0 tx=0x7fa54c00b3b0 comp rx=0 tx=0).stop 2024-05-03T22:32:22.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.124+0000 7fa55be00700 1 -- 172.21.15.60:0/3436384367 shutdown_connections 2024-05-03T22:32:22.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.124+0000 7fa55be00700 1 --2- 172.21.15.60:0/3436384367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55410fae0 0x7fa554111ed0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:32:22.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.124+0000 7fa55be00700 1 --2- 172.21.15.60:0/3436384367 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5540774d0 0x7fa554075930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:32:22.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.124+0000 7fa55be00700 1 --2- 172.21.15.60:0/3436384367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa554075f00 0x7fa554076380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:32:22.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.124+0000 7fa55be00700 1 -- 172.21.15.60:0/3436384367 >> 172.21.15.60:0/3436384367 conn(0x7fa5540feaa0 msgr2=0x7fa554100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:32:22.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.124+0000 7fa55be00700 1 -- 172.21.15.60:0/3436384367 shutdown_connections 2024-05-03T22:32:22.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.124+0000 7fa55be00700 1 -- 172.21.15.60:0/3436384367 wait complete. 2024-05-03T22:32:22.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.125+0000 7fa55be00700 1 Processor -- start 2024-05-03T22:32:22.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.125+0000 7fa55be00700 1 -- start start 2024-05-03T22:32:22.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.126+0000 7fa55be00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa554075f00 0x7fa55419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:32:22.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.126+0000 7fa55be00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5540774d0 0x7fa5541a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:32:22.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.126+0000 7fa55be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55410fae0 0x7fa5541a72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:32:22.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.126+0000 7fa55be00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa554115740 con 0x7fa5540774d0 2024-05-03T22:32:22.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.126+0000 7fa55be00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa5541155c0 con 0x7fa55410fae0 2024-05-03T22:32:22.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.126+0000 7fa55be00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa5541158c0 con 0x7fa554075f00 2024-05-03T22:32:22.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.126+0000 7fa559e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55410fae0 0x7fa5541a72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:32:22.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.126+0000 7fa559e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55410fae0 0x7fa5541a72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37604/0 (socket says 172.21.15.60:37604) 2024-05-03T22:32:22.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.126+0000 7fa559e00700 1 -- 172.21.15.60:0/3700812594 learned_addr learned my addr 172.21.15.60:0/3700812594 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-05-03T22:32:22.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.126+0000 7fa559400700 1 --2- 172.21.15.60:0/3700812594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa554075f00 0x7fa55419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:32:22.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.126+0000 7fa558a00700 1 --2- 172.21.15.60:0/3700812594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5540774d0 0x7fa5541a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:32:22.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.126+0000 7fa559e00700 1 -- 172.21.15.60:0/3700812594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa554075f00 msgr2=0x7fa55419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:32:22.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.127+0000 7fa559e00700 1 --2- 172.21.15.60:0/3700812594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa554075f00 0x7fa55419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:32:22.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.127+0000 7fa559e00700 1 -- 172.21.15.60:0/3700812594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5540774d0 msgr2=0x7fa5541a0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:32:22.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.127+0000 7fa559e00700 1 --2- 172.21.15.60:0/3700812594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5540774d0 0x7fa5541a0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:32:22.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.127+0000 7fa559e00700 1 -- 172.21.15.60:0/3700812594 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5541a7990 con 0x7fa55410fae0 2024-05-03T22:32:22.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.127+0000 7fa558a00700 1 --2- 172.21.15.60:0/3700812594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5540774d0 0x7fa5541a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:32:22.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.127+0000 7fa559e00700 1 --2- 172.21.15.60:0/3700812594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55410fae0 0x7fa5541a72c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009be0 tx=0x7fa54c007dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:32:22.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.127+0000 7fa552000700 1 -- 172.21.15.60:0/3700812594 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c003e10 con 0x7fa55410fae0 2024-05-03T22:32:22.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.127+0000 7fa552000700 1 -- 172.21.15.60:0/3700812594 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fa54c005540 con 0x7fa55410fae0 2024-05-03T22:32:22.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.127+0000 7fa55be00700 1 -- 172.21.15.60:0/3700812594 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5541a7c20 con 0x7fa55410fae0 2024-05-03T22:32:22.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.127+0000 7fa552000700 1 -- 172.21.15.60:0/3700812594 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c01bb20 con 0x7fa55410fae0 2024-05-03T22:32:22.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.128+0000 7fa55be00700 1 -- 172.21.15.60:0/3700812594 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5541a80d0 con 0x7fa55410fae0 2024-05-03T22:32:22.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.129+0000 7fa55be00700 1 -- 172.21.15.60:0/3700812594 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa55406a190 con 0x7fa55410fae0 2024-05-03T22:32:22.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.131+0000 7fa552000700 1 -- 172.21.15.60:0/3700812594 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7fa54c0056f0 con 0x7fa55410fae0 2024-05-03T22:32:22.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.134+0000 7fa552000700 1 --2- 172.21.15.60:0/3700812594 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa53c0b2870 0x7fa53c0b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:32:22.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.134+0000 7fa552000700 1 -- 172.21.15.60:0/3700812594 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7fa54c00f020 con 0x7fa55410fae0 2024-05-03T22:32:22.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.135+0000 7fa559400700 1 --2- 172.21.15.60:0/3700812594 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa53c0b2870 0x7fa53c0b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:32:22.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.136+0000 7fa559400700 1 --2- 172.21.15.60:0/3700812594 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa53c0b2870 0x7fa53c0b4d30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa548005950 tx=0x7fa5480058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:32:22.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.138+0000 7fa552000700 1 -- 172.21.15.60:0/3700812594 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa54c0ab9a0 con 0x7fa55410fae0 2024-05-03T22:32:22.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:22.384+0000 7fa55be00700 1 -- 172.21.15.60:0/3700812594 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa5540638e0 con 0x7fa53c0b2870 2024-05-03T22:32:22.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:22 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:32:22.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:22 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:32:22.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:22 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:22.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:22 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:32:22.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:22 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:32:22.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:22 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:22.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:22 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:32:22.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:22 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:32:22.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:22 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:23.694 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:23 smithi060 ceph-mon[31721]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:32:23.694 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:23 smithi060 ceph-mon[31721]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:23.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:23 smithi044 ceph-mon[28604]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:32:23.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:23 smithi044 ceph-mon[28604]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:23.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:23 smithi160 ceph-mon[32531]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:32:23.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:23 smithi160 ceph-mon[32531]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:26.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:25 smithi160 ceph-mon[32531]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:26.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:25 smithi044 ceph-mon[28604]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:26.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:25 smithi060 ceph-mon[31721]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:27.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:26 smithi060 ceph-mon[31721]: from='client.? 172.21.15.60:0/923595911' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff61ca27-e36b-41c9-898f-1cd7af1d9db5"}]: dispatch 2024-05-03T22:32:27.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:26 smithi060 ceph-mon[31721]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff61ca27-e36b-41c9-898f-1cd7af1d9db5"}]: dispatch 2024-05-03T22:32:27.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:26 smithi060 ceph-mon[31721]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff61ca27-e36b-41c9-898f-1cd7af1d9db5"}]': finished 2024-05-03T22:32:27.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:26 smithi060 ceph-mon[31721]: osdmap e10: 2 total, 1 up, 2 in 2024-05-03T22:32:27.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:26 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:32:27.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:26 smithi044 ceph-mon[28604]: from='client.? 172.21.15.60:0/923595911' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff61ca27-e36b-41c9-898f-1cd7af1d9db5"}]: dispatch 2024-05-03T22:32:27.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:26 smithi044 ceph-mon[28604]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff61ca27-e36b-41c9-898f-1cd7af1d9db5"}]: dispatch 2024-05-03T22:32:27.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:26 smithi044 ceph-mon[28604]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff61ca27-e36b-41c9-898f-1cd7af1d9db5"}]': finished 2024-05-03T22:32:27.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:26 smithi044 ceph-mon[28604]: osdmap e10: 2 total, 1 up, 2 in 2024-05-03T22:32:27.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:26 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:32:27.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:26 smithi160 ceph-mon[32531]: from='client.? 172.21.15.60:0/923595911' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff61ca27-e36b-41c9-898f-1cd7af1d9db5"}]: dispatch 2024-05-03T22:32:27.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:26 smithi160 ceph-mon[32531]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff61ca27-e36b-41c9-898f-1cd7af1d9db5"}]: dispatch 2024-05-03T22:32:27.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:26 smithi160 ceph-mon[32531]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff61ca27-e36b-41c9-898f-1cd7af1d9db5"}]': finished 2024-05-03T22:32:27.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:26 smithi160 ceph-mon[32531]: osdmap e10: 2 total, 1 up, 2 in 2024-05-03T22:32:27.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:26 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:32:28.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:27 smithi044 ceph-mon[28604]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:28.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:27 smithi044 ceph-mon[28604]: from='client.? 172.21.15.60:0/2302002307' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:32:28.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:27 smithi060 ceph-mon[31721]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:28.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:27 smithi060 ceph-mon[31721]: from='client.? 172.21.15.60:0/2302002307' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:32:28.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:27 smithi160 ceph-mon[32531]: pgmap v69: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:28.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:27 smithi160 ceph-mon[32531]: from='client.? 172.21.15.60:0/2302002307' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:32:30.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:29 smithi044 ceph-mon[28604]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:30.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:29 smithi060 ceph-mon[31721]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:30.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:29 smithi160 ceph-mon[32531]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:32.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:31 smithi044 ceph-mon[28604]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:32.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:31 smithi060 ceph-mon[31721]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:32.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:31 smithi160 ceph-mon[32531]: pgmap v71: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:34.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:33 smithi060 ceph-mon[31721]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:34.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:33 smithi044 ceph-mon[28604]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:34.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:33 smithi160 ceph-mon[32531]: pgmap v72: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:36.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:35 smithi044 ceph-mon[28604]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:36.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:35 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-03T22:32:36.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:35 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:35 smithi060 ceph-mon[31721]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:35 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-03T22:32:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:35 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:36.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:35 smithi160 ceph-mon[32531]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:36.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:35 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-03T22:32:36.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:35 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:37.243 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:36 smithi060 ceph-mon[31721]: Deploying daemon osd.1 on smithi060 2024-05-03T22:32:37.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:36 smithi044 ceph-mon[28604]: Deploying daemon osd.1 on smithi060 2024-05-03T22:32:37.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:36 smithi160 ceph-mon[32531]: Deploying daemon osd.1 on smithi060 2024-05-03T22:32:38.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:37 smithi044 ceph-mon[28604]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:38.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:37 smithi060 ceph-mon[31721]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:38.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:37 smithi160 ceph-mon[32531]: pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:40.098 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:39 smithi060 ceph-mon[31721]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:40.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:39 smithi044 ceph-mon[28604]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:40.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:39 smithi160 ceph-mon[32531]: pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:42.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:41 smithi060 ceph-mon[31721]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:42.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:41 smithi044 ceph-mon[28604]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:42.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:41 smithi160 ceph-mon[32531]: pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:44.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:43 smithi060 ceph-mon[31721]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:44.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:43 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:44.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:43 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:32:44.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:43 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:44.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:43 smithi044 ceph-mon[28604]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:44.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:43 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:44.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:43 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:32:44.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:43 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:44.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:43 smithi160 ceph-mon[32531]: pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:44.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:43 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:44.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:43 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:32:44.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:43 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:46.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:45 smithi044 ceph-mon[28604]: pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:46.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:45 smithi060 ceph-mon[31721]: pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:46.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:45 smithi160 ceph-mon[32531]: pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:47.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:47 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:47.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:47 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:47.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:47 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:47.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:47 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:32:47.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:47 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:47.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:47 smithi044 ceph-mon[28604]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:47.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:47 smithi044 ceph-mon[28604]: from='osd.1 [v2:172.21.15.60:6800/563003638,v1:172.21.15.60:6801/563003638]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-03T22:32:47.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:47 smithi044 ceph-mon[28604]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-03T22:32:47.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:47 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:47.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:47 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:47.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:47 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:47.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:47 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:32:47.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:47 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:47.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:47 smithi060 ceph-mon[31721]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:47.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:47 smithi060 ceph-mon[31721]: from='osd.1 [v2:172.21.15.60:6800/563003638,v1:172.21.15.60:6801/563003638]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-03T22:32:47.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:47 smithi060 ceph-mon[31721]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-03T22:32:47.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:47 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:47.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:47 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:47.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:47 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:47.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:47 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:32:47.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:47 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:47.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:47 smithi160 ceph-mon[32531]: pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:47.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:47 smithi160 ceph-mon[32531]: from='osd.1 [v2:172.21.15.60:6800/563003638,v1:172.21.15.60:6801/563003638]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-03T22:32:47.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:47 smithi160 ceph-mon[32531]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-03T22:32:48.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:48.142+0000 7fa552000700 1 -- 172.21.15.60:0/3700812594 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa5540638e0 con 0x7fa53c0b2870 2024-05-03T22:32:48.146 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 1 on host 'smithi060' 2024-05-03T22:32:48.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:48.146+0000 7fa55be00700 1 -- 172.21.15.60:0/3700812594 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa53c0b2870 msgr2=0x7fa53c0b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:32:48.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:48.146+0000 7fa55be00700 1 --2- 172.21.15.60:0/3700812594 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa53c0b2870 0x7fa53c0b4d30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa548005950 tx=0x7fa5480058e0 comp rx=0 tx=0).stop 2024-05-03T22:32:48.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:48.146+0000 7fa55be00700 1 -- 172.21.15.60:0/3700812594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55410fae0 msgr2=0x7fa5541a72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:32:48.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:48.146+0000 7fa55be00700 1 --2- 172.21.15.60:0/3700812594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55410fae0 0x7fa5541a72c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009be0 tx=0x7fa54c007dc0 comp rx=0 tx=0).stop 2024-05-03T22:32:48.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:48.147+0000 7fa55be00700 1 -- 172.21.15.60:0/3700812594 shutdown_connections 2024-05-03T22:32:48.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:48.147+0000 7fa55be00700 1 --2- 172.21.15.60:0/3700812594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55410fae0 0x7fa5541a72c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:32:48.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:48.147+0000 7fa55be00700 1 --2- 172.21.15.60:0/3700812594 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa53c0b2870 0x7fa53c0b4d30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:32:48.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:48.147+0000 7fa55be00700 1 --2- 172.21.15.60:0/3700812594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa554075f00 0x7fa55419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:32:48.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:48.147+0000 7fa55be00700 1 --2- 172.21.15.60:0/3700812594 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa5540774d0 0x7fa5541a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:32:48.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:48.147+0000 7fa55be00700 1 -- 172.21.15.60:0/3700812594 >> 172.21.15.60:0/3700812594 conn(0x7fa5540feaa0 msgr2=0x7fa554102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:32:48.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:48.147+0000 7fa55be00700 1 -- 172.21.15.60:0/3700812594 shutdown_connections 2024-05-03T22:32:48.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:32:48.147+0000 7fa55be00700 1 -- 172.21.15.60:0/3700812594 wait complete. 2024-05-03T22:32:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:48 smithi044 ceph-mon[28604]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-03T22:32:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:48 smithi044 ceph-mon[28604]: osdmap e11: 2 total, 1 up, 2 in 2024-05-03T22:32:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:48 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:32:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:48 smithi044 ceph-mon[28604]: from='osd.1 [v2:172.21.15.60:6800/563003638,v1:172.21.15.60:6801/563003638]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:32:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:48 smithi044 ceph-mon[28604]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:32:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:48 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:48 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:48 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:32:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:48 smithi060 ceph-mon[31721]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-03T22:32:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:48 smithi060 ceph-mon[31721]: osdmap e11: 2 total, 1 up, 2 in 2024-05-03T22:32:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:48 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:32:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:48 smithi060 ceph-mon[31721]: from='osd.1 [v2:172.21.15.60:6800/563003638,v1:172.21.15.60:6801/563003638]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:32:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:48 smithi060 ceph-mon[31721]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:32:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:48 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:48 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:48 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:32:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:48 smithi160 ceph-mon[32531]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-03T22:32:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:48 smithi160 ceph-mon[32531]: osdmap e11: 2 total, 1 up, 2 in 2024-05-03T22:32:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:48 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:32:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:48 smithi160 ceph-mon[32531]: from='osd.1 [v2:172.21.15.60:6800/563003638,v1:172.21.15.60:6801/563003638]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:32:48.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:48 smithi160 ceph-mon[32531]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:32:48.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:48 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:48.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:48 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:48.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:48 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:32:48.927 DEBUG:teuthology.orchestra.run.smithi060:osd.1> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.1.service 2024-05-03T22:32:48.931 INFO:tasks.cephadm:Deploying osd.2 on smithi160 with /dev/vg_nvme/lv_4... 2024-05-03T22:32:48.932 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-03T22:32:49.369 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:32:49.524 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:49 smithi160 ceph-mon[32531]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-03T22:32:49.524 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:49 smithi160 ceph-mon[32531]: osdmap e12: 2 total, 1 up, 2 in 2024-05-03T22:32:49.524 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:49 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:32:49.525 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:49 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:32:49.525 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:49 smithi160 ceph-mon[32531]: pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:49.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:49 smithi044 ceph-mon[28604]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-03T22:32:49.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:49 smithi044 ceph-mon[28604]: osdmap e12: 2 total, 1 up, 2 in 2024-05-03T22:32:49.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:49 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:32:49.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:49 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:32:49.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:49 smithi044 ceph-mon[28604]: pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:49.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:49 smithi060 ceph-mon[31721]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-03T22:32:49.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:49 smithi060 ceph-mon[31721]: osdmap e12: 2 total, 1 up, 2 in 2024-05-03T22:32:49.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:49 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:32:49.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:49 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:32:49.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:49 smithi060 ceph-mon[31721]: pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-05-03T22:32:50.593 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:50 smithi160 ceph-mon[32531]: purged_snaps scrub starts 2024-05-03T22:32:50.594 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:50 smithi160 ceph-mon[32531]: purged_snaps scrub ok 2024-05-03T22:32:50.594 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:50 smithi160 ceph-mon[32531]: osd.1 [v2:172.21.15.60:6800/563003638,v1:172.21.15.60:6801/563003638] boot 2024-05-03T22:32:50.594 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:50 smithi160 ceph-mon[32531]: osdmap e13: 2 total, 2 up, 2 in 2024-05-03T22:32:50.594 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:50 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:32:50.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:50 smithi044 ceph-mon[28604]: purged_snaps scrub starts 2024-05-03T22:32:50.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:50 smithi044 ceph-mon[28604]: purged_snaps scrub ok 2024-05-03T22:32:50.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:50 smithi044 ceph-mon[28604]: osd.1 [v2:172.21.15.60:6800/563003638,v1:172.21.15.60:6801/563003638] boot 2024-05-03T22:32:50.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:50 smithi044 ceph-mon[28604]: osdmap e13: 2 total, 2 up, 2 in 2024-05-03T22:32:50.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:50 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:32:50.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:50 smithi060 ceph-mon[31721]: purged_snaps scrub starts 2024-05-03T22:32:50.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:50 smithi060 ceph-mon[31721]: purged_snaps scrub ok 2024-05-03T22:32:50.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:50 smithi060 ceph-mon[31721]: osd.1 [v2:172.21.15.60:6800/563003638,v1:172.21.15.60:6801/563003638] boot 2024-05-03T22:32:50.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:50 smithi060 ceph-mon[31721]: osdmap e13: 2 total, 2 up, 2 in 2024-05-03T22:32:50.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:50 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-03T22:32:51.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:51 smithi044 ceph-mon[28604]: osdmap e14: 2 total, 2 up, 2 in 2024-05-03T22:32:51.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:51 smithi044 ceph-mon[28604]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:32:51.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:51 smithi060 ceph-mon[31721]: osdmap e14: 2 total, 2 up, 2 in 2024-05-03T22:32:51.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:51 smithi060 ceph-mon[31721]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:32:51.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:51 smithi160 ceph-mon[32531]: osdmap e14: 2 total, 2 up, 2 in 2024-05-03T22:32:51.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:51 smithi160 ceph-mon[32531]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:32:52.162 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-03T22:32:52.162 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-03T22:32:52.162 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2024-05-03T22:32:52.162 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2024-05-03T22:32:52.163 INFO:teuthology.orchestra.run.smithi160.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0354463 s, 296 MB/s 2024-05-03T22:32:52.163 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2024-05-03T22:32:52.826 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi160:vg_nvme/lv_4 2024-05-03T22:32:53.252 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:32:54.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:53 smithi160 ceph-mon[32531]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:32:54.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:53 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:54.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:53 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:54.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:53 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:32:54.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:53 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:54.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:53 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:54.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:53 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:32:54.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:53 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:54.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:53 smithi044 ceph-mon[28604]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:32:54.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:54.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:54.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:32:54.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:54.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:54.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:32:54.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:54.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:53 smithi060 ceph-mon[31721]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:32:54.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:53 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:54.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:53 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:54.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:53 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:32:54.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:53 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:54.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:53 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:54.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:53 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:32:54.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:53 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:32:55.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:54 smithi160 ceph-mon[32531]: Detected new or changed devices on smithi060 2024-05-03T22:32:55.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:54 smithi160 ceph-mon[32531]: Adjusting osd_memory_target on smithi060 to 17094M 2024-05-03T22:32:55.240 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.238+0000 7f0417c00700 1 -- 172.21.15.160:0/324765309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04101017b0 msgr2=0x7f0410101bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:32:55.240 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.238+0000 7f0417c00700 1 --2- 172.21.15.160:0/324765309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04101017b0 0x7f0410101bd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0400009990 tx=0x7f0400009ca0 comp rx=0 tx=0).stop 2024-05-03T22:32:55.240 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.239+0000 7f0417c00700 1 -- 172.21.15.160:0/324765309 shutdown_connections 2024-05-03T22:32:55.240 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.239+0000 7f0417c00700 1 --2- 172.21.15.160:0/324765309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0410102ee0 0x7f0410107780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:32:55.241 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.239+0000 7f0417c00700 1 --2- 172.21.15.160:0/324765309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04101017b0 0x7f0410101bd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:32:55.241 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.239+0000 7f0417c00700 1 --2- 172.21.15.160:0/324765309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0410102520 0x7f04101029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:32:55.241 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.239+0000 7f0417c00700 1 -- 172.21.15.160:0/324765309 >> 172.21.15.160:0/324765309 conn(0x7f04100fd130 msgr2=0x7f04100ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:32:55.241 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.239+0000 7f0417c00700 1 -- 172.21.15.160:0/324765309 shutdown_connections 2024-05-03T22:32:55.241 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.239+0000 7f0417c00700 1 -- 172.21.15.160:0/324765309 wait complete. 2024-05-03T22:32:55.243 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.240+0000 7f0417c00700 1 Processor -- start 2024-05-03T22:32:55.243 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.240+0000 7f0417c00700 1 -- start start 2024-05-03T22:32:55.243 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.240+0000 7f0417c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04101017b0 0x7f041019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:32:55.243 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.240+0000 7f0417c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0410102520 0x7f04101a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:32:55.243 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.240+0000 7f0417c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0410102ee0 0x7f04101a7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:32:55.243 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.240+0000 7f0417c00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0410115730 con 0x7f0410102520 2024-05-03T22:32:55.243 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.240+0000 7f0417c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f04101155b0 con 0x7f0410102ee0 2024-05-03T22:32:55.243 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.240+0000 7f0417c00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f04101158b0 con 0x7f04101017b0 2024-05-03T22:32:55.244 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.241+0000 7f0415200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04101017b0 0x7f041019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:32:55.244 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.241+0000 7f0415200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04101017b0 0x7f041019fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:43724/0 (socket says 172.21.15.160:43724) 2024-05-03T22:32:55.244 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.241+0000 7f0415200700 1 -- 172.21.15.160:0/2409144524 learned_addr learned my addr 172.21.15.160:0/2409144524 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-03T22:32:55.244 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.241+0000 7f0407e00700 1 --2- 172.21.15.160:0/2409144524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0410102520 0x7f04101a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:32:55.244 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.241+0000 7f0415c00700 1 --2- 172.21.15.160:0/2409144524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0410102ee0 0x7f04101a7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:32:55.244 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.241+0000 7f0415200700 1 -- 172.21.15.160:0/2409144524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0410102ee0 msgr2=0x7f04101a7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:32:55.244 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.241+0000 7f0415200700 1 --2- 172.21.15.160:0/2409144524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0410102ee0 0x7f04101a7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:32:55.244 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.241+0000 7f0415200700 1 -- 172.21.15.160:0/2409144524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0410102520 msgr2=0x7f04101a0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:32:55.244 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.241+0000 7f0415200700 1 --2- 172.21.15.160:0/2409144524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0410102520 0x7f04101a0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:32:55.244 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.241+0000 7f0415200700 1 -- 172.21.15.160:0/2409144524 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04101a7950 con 0x7f04101017b0 2024-05-03T22:32:55.244 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.241+0000 7f0407e00700 1 --2- 172.21.15.160:0/2409144524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0410102520 0x7f04101a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:32:55.244 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.241+0000 7f0415c00700 1 --2- 172.21.15.160:0/2409144524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0410102ee0 0x7f04101a7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:32:55.244 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.241+0000 7f0415200700 1 --2- 172.21.15.160:0/2409144524 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04101017b0 0x7f041019fd00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0400000c00 tx=0x7f0400009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:32:55.245 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.242+0000 7f040e000700 1 -- 172.21.15.160:0/2409144524 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400026070 con 0x7f04101017b0 2024-05-03T22:32:55.245 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.242+0000 7f040e000700 1 -- 172.21.15.160:0/2409144524 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f0400004070 con 0x7f04101017b0 2024-05-03T22:32:55.245 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.242+0000 7f040e000700 1 -- 172.21.15.160:0/2409144524 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400021410 con 0x7f04101017b0 2024-05-03T22:32:55.245 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.242+0000 7f0417c00700 1 -- 172.21.15.160:0/2409144524 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04101a7be0 con 0x7f04101017b0 2024-05-03T22:32:55.245 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.242+0000 7f0417c00700 1 -- 172.21.15.160:0/2409144524 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04101a7fe0 con 0x7f04101017b0 2024-05-03T22:32:55.245 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.243+0000 7f0417c00700 1 -- 172.21.15.160:0/2409144524 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f041006a190 con 0x7f04101017b0 2024-05-03T22:32:55.246 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.246+0000 7f040e000700 1 -- 172.21.15.160:0/2409144524 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f0400029070 con 0x7f04101017b0 2024-05-03T22:32:55.248 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.247+0000 7f040e000700 1 --2- 172.21.15.160:0/2409144524 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f03f00b27f0 0x7f03f00b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:32:55.248 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.247+0000 7f040e000700 1 -- 172.21.15.160:0/2409144524 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7f04000e19a0 con 0x7f04101017b0 2024-05-03T22:32:55.248 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.248+0000 7f0407e00700 1 --2- 172.21.15.160:0/2409144524 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f03f00b27f0 0x7f03f00b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:32:55.250 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.249+0000 7f0407e00700 1 --2- 172.21.15.160:0/2409144524 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f03f00b27f0 0x7f03f00b4cb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f03f8005fd0 tx=0x7f03f8005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:32:55.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:54 smithi044 ceph-mon[28604]: Detected new or changed devices on smithi060 2024-05-03T22:32:55.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:54 smithi044 ceph-mon[28604]: Adjusting osd_memory_target on smithi060 to 17094M 2024-05-03T22:32:55.252 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.251+0000 7f040e000700 1 -- 172.21.15.160:0/2409144524 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0400030020 con 0x7f04101017b0 2024-05-03T22:32:55.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:54 smithi060 ceph-mon[31721]: Detected new or changed devices on smithi060 2024-05-03T22:32:55.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:54 smithi060 ceph-mon[31721]: Adjusting osd_memory_target on smithi060 to 17094M 2024-05-03T22:32:55.493 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:32:55.491+0000 7f0417c00700 1 -- 172.21.15.160:0/2409144524 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f04100638e0 con 0x7f03f00b27f0 2024-05-03T22:32:56.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:55 smithi044 ceph-mon[28604]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:32:56.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:55 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:32:56.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:55 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:32:56.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:55 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:56.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:55 smithi060 ceph-mon[31721]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:32:56.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:55 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:32:56.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:55 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:32:56.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:55 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:56.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:55 smithi160 ceph-mon[32531]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:32:56.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:55 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:32:56.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:55 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:32:56.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:55 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:32:57.220 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:56 smithi160 ceph-mon[32531]: from='client.24178 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:32:57.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:56 smithi044 ceph-mon[28604]: from='client.24178 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:32:57.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:56 smithi060 ceph-mon[31721]: from='client.24178 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:32:58.112 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:57 smithi160 ceph-mon[32531]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:32:58.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:57 smithi044 ceph-mon[28604]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:32:58.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:57 smithi060 ceph-mon[31721]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:00.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:59 smithi044 ceph-mon[28604]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:00.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:59 smithi044 ceph-mon[28604]: from='client.? 172.21.15.160:0/1981773288' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e58f96dc-3486-452e-85a1-847a0e2c523a"}]: dispatch 2024-05-03T22:33:00.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:59 smithi044 ceph-mon[28604]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e58f96dc-3486-452e-85a1-847a0e2c523a"}]: dispatch 2024-05-03T22:33:00.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:59 smithi044 ceph-mon[28604]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e58f96dc-3486-452e-85a1-847a0e2c523a"}]': finished 2024-05-03T22:33:00.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:59 smithi044 ceph-mon[28604]: osdmap e15: 3 total, 2 up, 3 in 2024-05-03T22:33:00.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:32:59 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:33:00.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:59 smithi060 ceph-mon[31721]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:00.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:59 smithi060 ceph-mon[31721]: from='client.? 172.21.15.160:0/1981773288' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e58f96dc-3486-452e-85a1-847a0e2c523a"}]: dispatch 2024-05-03T22:33:00.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:59 smithi060 ceph-mon[31721]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e58f96dc-3486-452e-85a1-847a0e2c523a"}]: dispatch 2024-05-03T22:33:00.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:59 smithi060 ceph-mon[31721]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e58f96dc-3486-452e-85a1-847a0e2c523a"}]': finished 2024-05-03T22:33:00.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:59 smithi060 ceph-mon[31721]: osdmap e15: 3 total, 2 up, 3 in 2024-05-03T22:33:00.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:32:59 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:33:00.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:59 smithi160 ceph-mon[32531]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:00.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:59 smithi160 ceph-mon[32531]: from='client.? 172.21.15.160:0/1981773288' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e58f96dc-3486-452e-85a1-847a0e2c523a"}]: dispatch 2024-05-03T22:33:00.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:59 smithi160 ceph-mon[32531]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e58f96dc-3486-452e-85a1-847a0e2c523a"}]: dispatch 2024-05-03T22:33:00.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:59 smithi160 ceph-mon[32531]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e58f96dc-3486-452e-85a1-847a0e2c523a"}]': finished 2024-05-03T22:33:00.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:59 smithi160 ceph-mon[32531]: osdmap e15: 3 total, 2 up, 3 in 2024-05-03T22:33:00.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:32:59 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:33:01.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:00 smithi044 ceph-mon[28604]: from='client.? 172.21.15.160:0/940189761' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:33:01.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:00 smithi060 ceph-mon[31721]: from='client.? 172.21.15.160:0/940189761' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:33:01.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:00 smithi160 ceph-mon[32531]: from='client.? 172.21.15.160:0/940189761' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:33:02.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:01 smithi044 ceph-mon[28604]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:02.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:01 smithi060 ceph-mon[31721]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:02.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:01 smithi160 ceph-mon[32531]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:04.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:03 smithi044 ceph-mon[28604]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:04.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:03 smithi060 ceph-mon[31721]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:04.255 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:03 smithi160 ceph-mon[32531]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:06.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:05 smithi044 ceph-mon[28604]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:06.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:05 smithi060 ceph-mon[31721]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:06.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:05 smithi160 ceph-mon[32531]: pgmap v93: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:08.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:07 smithi044 ceph-mon[28604]: pgmap v94: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:08.118 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:07 smithi160 ceph-mon[32531]: pgmap v94: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:08.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:07 smithi060 ceph-mon[31721]: pgmap v94: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:09.243 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:08 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-03T22:33:09.243 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:08 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:33:09.243 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:08 smithi160 ceph-mon[32531]: Deploying daemon osd.2 on smithi160 2024-05-03T22:33:09.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:08 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-03T22:33:09.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:08 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:33:09.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:08 smithi044 ceph-mon[28604]: Deploying daemon osd.2 on smithi160 2024-05-03T22:33:09.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:08 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-03T22:33:09.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:08 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:33:09.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:08 smithi060 ceph-mon[31721]: Deploying daemon osd.2 on smithi160 2024-05-03T22:33:10.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:09 smithi044 ceph-mon[28604]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:10.252 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:09 smithi160 ceph-mon[32531]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:10.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:09 smithi060 ceph-mon[31721]: pgmap v95: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:12.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:11 smithi044 ceph-mon[28604]: pgmap v96: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:12.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:11 smithi060 ceph-mon[31721]: pgmap v96: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:12.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:11 smithi160 ceph-mon[32531]: pgmap v96: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:14.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:13 smithi044 ceph-mon[28604]: pgmap v97: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:14.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:13 smithi060 ceph-mon[31721]: pgmap v97: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:14.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:13 smithi160 ceph-mon[32531]: pgmap v97: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:16.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:15 smithi160 ceph-mon[32531]: pgmap v98: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:16.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:15 smithi044 ceph-mon[28604]: pgmap v98: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:16.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:15 smithi060 ceph-mon[31721]: pgmap v98: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:17.436 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:17 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:17.436 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:17 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:17.436 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:17 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:33:17.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:17 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:17.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:17 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:17.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:17 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:33:17.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:17 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:17.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:17 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:17.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:17 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:33:18.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:18 smithi160 ceph-mon[32531]: pgmap v99: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:18.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:18 smithi044 ceph-mon[28604]: pgmap v99: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:18.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:18 smithi060 ceph-mon[31721]: pgmap v99: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:20.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:20 smithi044 ceph-mon[28604]: pgmap v100: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:20.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:20 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:20.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:20 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:20.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:20 smithi060 ceph-mon[31721]: pgmap v100: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:20.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:20 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:20.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:20 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:20.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:20 smithi160 ceph-mon[32531]: pgmap v100: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:20.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:20 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:20.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:20 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:20.710 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 2 on host 'smithi160' 2024-05-03T22:33:20.710 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:33:20.707+0000 7f040e000700 1 -- 172.21.15.160:0/2409144524 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f04100638e0 con 0x7f03f00b27f0 2024-05-03T22:33:20.712 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:33:20.710+0000 7f0417c00700 1 -- 172.21.15.160:0/2409144524 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f03f00b27f0 msgr2=0x7f03f00b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:20.712 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:33:20.710+0000 7f0417c00700 1 --2- 172.21.15.160:0/2409144524 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f03f00b27f0 0x7f03f00b4cb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f03f8005fd0 tx=0x7f03f8005ee0 comp rx=0 tx=0).stop 2024-05-03T22:33:20.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:33:20.710+0000 7f0417c00700 1 -- 172.21.15.160:0/2409144524 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04101017b0 msgr2=0x7f041019fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:20.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:33:20.710+0000 7f0417c00700 1 --2- 172.21.15.160:0/2409144524 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04101017b0 0x7f041019fd00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0400000c00 tx=0x7f0400009580 comp rx=0 tx=0).stop 2024-05-03T22:33:20.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:33:20.710+0000 7f0417c00700 1 -- 172.21.15.160:0/2409144524 shutdown_connections 2024-05-03T22:33:20.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:33:20.710+0000 7f0417c00700 1 --2- 172.21.15.160:0/2409144524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0410102ee0 0x7f04101a7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:20.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:33:20.710+0000 7f0417c00700 1 --2- 172.21.15.160:0/2409144524 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f03f00b27f0 0x7f03f00b4cb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:20.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:33:20.710+0000 7f0417c00700 1 --2- 172.21.15.160:0/2409144524 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04101017b0 0x7f041019fd00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:20.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:33:20.710+0000 7f0417c00700 1 --2- 172.21.15.160:0/2409144524 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0410102520 0x7f04101a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:20.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:33:20.710+0000 7f0417c00700 1 -- 172.21.15.160:0/2409144524 >> 172.21.15.160:0/2409144524 conn(0x7f04100fd130 msgr2=0x7f0410103760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:33:20.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:33:20.711+0000 7f0417c00700 1 -- 172.21.15.160:0/2409144524 shutdown_connections 2024-05-03T22:33:20.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:33:20.711+0000 7f0417c00700 1 -- 172.21.15.160:0/2409144524 wait complete. 2024-05-03T22:33:21.418 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:21 smithi160 ceph-mon[32531]: from='osd.2 [v2:172.21.15.160:6800/2524540447,v1:172.21.15.160:6801/2524540447]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-03T22:33:21.418 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:21 smithi160 ceph-mon[32531]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-03T22:33:21.418 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:21 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:21.418 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:21 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:21.468 DEBUG:teuthology.orchestra.run.smithi160:osd.2> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.2.service 2024-05-03T22:33:21.472 INFO:tasks.cephadm:Deploying osd.3 on smithi044 with /dev/vg_nvme/lv_3... 2024-05-03T22:33:21.472 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-03T22:33:21.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:21 smithi044 ceph-mon[28604]: from='osd.2 [v2:172.21.15.160:6800/2524540447,v1:172.21.15.160:6801/2524540447]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-03T22:33:21.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:21 smithi044 ceph-mon[28604]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-03T22:33:21.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:21 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:21.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:21 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:21.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:21 smithi060 ceph-mon[31721]: from='osd.2 [v2:172.21.15.160:6800/2524540447,v1:172.21.15.160:6801/2524540447]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-03T22:33:21.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:21 smithi060 ceph-mon[31721]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-03T22:33:21.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:21 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:21.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:21 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:21.946 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:33:22.354 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:22 smithi044 ceph-mon[28604]: pgmap v101: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:22.354 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:22 smithi044 ceph-mon[28604]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-03T22:33:22.354 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:22 smithi044 ceph-mon[28604]: from='osd.2 [v2:172.21.15.160:6800/2524540447,v1:172.21.15.160:6801/2524540447]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:33:22.354 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:22 smithi044 ceph-mon[28604]: osdmap e16: 3 total, 2 up, 3 in 2024-05-03T22:33:22.354 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:22 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:33:22.354 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:22 smithi044 ceph-mon[28604]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:33:22.354 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:22 smithi044 ceph-mon[28604]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-03T22:33:22.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:22 smithi060 ceph-mon[31721]: pgmap v101: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:22.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:22 smithi060 ceph-mon[31721]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-03T22:33:22.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:22 smithi060 ceph-mon[31721]: from='osd.2 [v2:172.21.15.160:6800/2524540447,v1:172.21.15.160:6801/2524540447]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:33:22.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:22 smithi060 ceph-mon[31721]: osdmap e16: 3 total, 2 up, 3 in 2024-05-03T22:33:22.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:22 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:33:22.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:22 smithi060 ceph-mon[31721]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:33:22.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:22 smithi060 ceph-mon[31721]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-03T22:33:22.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:22 smithi160 ceph-mon[32531]: pgmap v101: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:22.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:22 smithi160 ceph-mon[32531]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-03T22:33:22.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:22 smithi160 ceph-mon[32531]: from='osd.2 [v2:172.21.15.160:6800/2524540447,v1:172.21.15.160:6801/2524540447]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:33:22.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:22 smithi160 ceph-mon[32531]: osdmap e16: 3 total, 2 up, 3 in 2024-05-03T22:33:22.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:22 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:33:22.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:22 smithi160 ceph-mon[32531]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:33:22.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:22 smithi160 ceph-mon[32531]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-03T22:33:23.231 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 22:33:23 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-2[37736]: 2024-05-03T22:33:23.173+0000 7ffb4a200700 -1 osd.2 0 waiting for initial osdmap 2024-05-03T22:33:23.231 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 22:33:23 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-2[37736]: 2024-05-03T22:33:23.192+0000 7ffb40000700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T22:33:23.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:23 smithi044 ceph-mon[28604]: osdmap e17: 3 total, 2 up, 3 in 2024-05-03T22:33:23.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:23 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:33:23.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:23 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:33:23.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:23 smithi044 ceph-mon[28604]: pgmap v104: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:23.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:23 smithi044 ceph-mon[28604]: from='osd.2 ' entity='osd.2' 2024-05-03T22:33:23.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:23 smithi160 ceph-mon[32531]: osdmap e17: 3 total, 2 up, 3 in 2024-05-03T22:33:23.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:23 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:33:23.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:23 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:33:23.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:23 smithi160 ceph-mon[32531]: pgmap v104: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:23.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:23 smithi160 ceph-mon[32531]: from='osd.2 ' entity='osd.2' 2024-05-03T22:33:23.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:23 smithi060 ceph-mon[31721]: osdmap e17: 3 total, 2 up, 3 in 2024-05-03T22:33:23.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:23 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:33:23.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:23 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:33:23.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:23 smithi060 ceph-mon[31721]: pgmap v104: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-05-03T22:33:23.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:23 smithi060 ceph-mon[31721]: from='osd.2 ' entity='osd.2' 2024-05-03T22:33:24.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:24 smithi160 ceph-mon[32531]: purged_snaps scrub starts 2024-05-03T22:33:24.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:24 smithi160 ceph-mon[32531]: purged_snaps scrub ok 2024-05-03T22:33:24.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:24 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:33:24.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:24 smithi160 ceph-mon[32531]: osd.2 [v2:172.21.15.160:6800/2524540447,v1:172.21.15.160:6801/2524540447] boot 2024-05-03T22:33:24.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:24 smithi160 ceph-mon[32531]: osdmap e18: 3 total, 3 up, 3 in 2024-05-03T22:33:24.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:24 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:33:24.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:24 smithi044 ceph-mon[28604]: purged_snaps scrub starts 2024-05-03T22:33:24.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:24 smithi044 ceph-mon[28604]: purged_snaps scrub ok 2024-05-03T22:33:24.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:24 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:33:24.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:24 smithi044 ceph-mon[28604]: osd.2 [v2:172.21.15.160:6800/2524540447,v1:172.21.15.160:6801/2524540447] boot 2024-05-03T22:33:24.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:24 smithi044 ceph-mon[28604]: osdmap e18: 3 total, 3 up, 3 in 2024-05-03T22:33:24.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:24 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:33:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:24 smithi060 ceph-mon[31721]: purged_snaps scrub starts 2024-05-03T22:33:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:24 smithi060 ceph-mon[31721]: purged_snaps scrub ok 2024-05-03T22:33:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:24 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:33:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:24 smithi060 ceph-mon[31721]: osd.2 [v2:172.21.15.160:6800/2524540447,v1:172.21.15.160:6801/2524540447] boot 2024-05-03T22:33:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:24 smithi060 ceph-mon[31721]: osdmap e18: 3 total, 3 up, 3 in 2024-05-03T22:33:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:24 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-03T22:33:24.823 INFO:teuthology.orchestra.run.smithi044.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-03T22:33:24.823 INFO:teuthology.orchestra.run.smithi044.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-03T22:33:24.823 INFO:teuthology.orchestra.run.smithi044.stderr: stderr: 10+0 records in 2024-05-03T22:33:24.823 INFO:teuthology.orchestra.run.smithi044.stderr:10+0 records out 2024-05-03T22:33:24.823 INFO:teuthology.orchestra.run.smithi044.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0400782 s, 262 MB/s 2024-05-03T22:33:24.823 INFO:teuthology.orchestra.run.smithi044.stderr:--> Zapping successful for: 2024-05-03T22:33:25.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:25 smithi044 ceph-mon[28604]: pgmap v106: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:25.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:25 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-03T22:33:25.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:25 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-03T22:33:25.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:25 smithi044 ceph-mon[28604]: osdmap e19: 3 total, 3 up, 3 in 2024-05-03T22:33:25.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:25 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-03T22:33:25.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:25 smithi160 ceph-mon[32531]: pgmap v106: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:25.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:25 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-03T22:33:25.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:25 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-03T22:33:25.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:25 smithi160 ceph-mon[32531]: osdmap e19: 3 total, 3 up, 3 in 2024-05-03T22:33:25.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:25 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-03T22:33:25.677 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_3 2024-05-03T22:33:25.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:25 smithi060 ceph-mon[31721]: pgmap v106: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:25.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-03T22:33:25.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-03T22:33:25.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:25 smithi060 ceph-mon[31721]: osdmap e19: 3 total, 3 up, 3 in 2024-05-03T22:33:25.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-03T22:33:26.155 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:33:26.569 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 22:33:26 smithi044 sudo[48111]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-03T22:33:26.569 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 22:33:26 smithi044 sudo[48111]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:33:26.569 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 22:33:26 smithi044 sudo[48111]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:33:26.569 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 22:33:26 smithi044 sudo[48111]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:33:26.569 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 22:33:26 smithi044 sudo[48137]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-03T22:33:26.570 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 22:33:26 smithi044 sudo[48137]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:33:26.570 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 22:33:26 smithi044 sudo[48137]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:33:26.570 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 22:33:26 smithi044 sudo[48137]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:33:26.756 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 22:33:26 smithi060 sudo[40338]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-03T22:33:26.756 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 22:33:26 smithi060 sudo[40338]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:33:26.756 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 22:33:26 smithi060 sudo[40338]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:33:26.756 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 22:33:26 smithi060 sudo[40338]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:33:26.756 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 22:33:26 smithi060 sudo[40357]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-03T22:33:26.756 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 22:33:26 smithi060 sudo[40357]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:33:26.756 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 22:33:26 smithi060 sudo[40357]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:33:26.756 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 22:33:26 smithi060 sudo[40357]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:33:26.890 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 22:33:26 smithi160 sudo[41534]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-03T22:33:26.890 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 22:33:26 smithi160 sudo[41534]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:33:26.890 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 22:33:26 smithi160 sudo[41534]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:33:26.890 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 22:33:26 smithi160 sudo[41534]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:33:26.890 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 22:33:26 smithi160 sudo[41545]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-03T22:33:26.890 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 22:33:26 smithi160 sudo[41545]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:33:26.890 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 22:33:26 smithi160 sudo[41545]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:33:26.891 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 22:33:26 smithi160 sudo[41545]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:33:27.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:26 smithi044 sudo[48180]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-03T22:33:27.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:26 smithi044 sudo[48180]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:33:27.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:26 smithi044 sudo[48180]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:33:27.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:26 smithi044 sudo[48180]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:33:27.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:26 smithi044 sudo[48194]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-03T22:33:27.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:26 smithi044 sudo[48194]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:33:27.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:26 smithi044 sudo[48194]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:33:27.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:26 smithi044 sudo[48194]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:33:27.196 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:26 smithi160 sudo[41548]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-03T22:33:27.196 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:26 smithi160 sudo[41548]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:33:27.196 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:26 smithi160 sudo[41548]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:33:27.196 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:26 smithi160 sudo[41548]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:33:27.196 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:26 smithi160 sudo[41551]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-03T22:33:27.196 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:26 smithi160 sudo[41551]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:33:27.196 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:26 smithi160 sudo[41551]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:33:27.196 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:26 smithi160 sudo[41551]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:33:27.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:26 smithi060 sudo[40392]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-03T22:33:27.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:26 smithi060 sudo[40392]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:33:27.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:26 smithi060 sudo[40392]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:33:27.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 sudo[40392]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:33:27.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 sudo[40395]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-03T22:33:27.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 sudo[40395]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-03T22:33:27.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 sudo[40395]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-03T22:33:27.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 sudo[40395]: pam_unix(sudo:session): session closed for user root 2024-05-03T22:33:27.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-03T22:33:27.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: osdmap e20: 3 total, 3 up, 3 in 2024-05-03T22:33:27.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:33:27.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:33:27.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:33:27.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:33:27.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:33:27.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:33:27.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T22:33:27.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T22:33:27.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:33:27.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:33:27.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:33:27.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T22:33:27.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:33:27.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:33:27.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:33:27.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T22:33:27.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T22:33:27.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:33:27.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:33:27.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:33:27.259 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:27 smithi060 ceph-mon[31721]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T22:33:27.379 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-03T22:33:27.379 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: osdmap e20: 3 total, 3 up, 3 in 2024-05-03T22:33:27.379 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.379 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.380 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:33:27.380 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.380 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:33:27.380 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:33:27.380 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.380 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.380 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.380 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:33:27.380 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:33:27.380 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:33:27.380 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.380 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.380 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T22:33:27.380 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T22:33:27.381 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:33:27.381 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:33:27.381 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:33:27.381 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T22:33:27.381 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:33:27.381 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:33:27.381 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:33:27.381 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T22:33:27.381 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T22:33:27.381 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:33:27.381 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:33:27.381 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:33:27.381 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:27 smithi044 ceph-mon[28604]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T22:33:27.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-03T22:33:27.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: osdmap e20: 3 total, 3 up, 3 in 2024-05-03T22:33:27.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:33:27.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:33:27.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:33:27.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:33:27.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:33:27.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:33:27.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:27.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T22:33:27.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T22:33:27.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:33:27.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:33:27.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:33:27.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T22:33:27.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:33:27.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:33:27.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:33:27.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T22:33:27.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-03T22:33:27.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-03T22:33:27.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-03T22:33:27.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-03T22:33:27.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:27 smithi160 ceph-mon[32531]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-03T22:33:28.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.424+0000 7fb97fe00700 1 -- 172.21.15.44:0/389324817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb980106840 msgr2=0x7fb980106ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:28.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.424+0000 7fb97fe00700 1 --2- 172.21.15.44:0/389324817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb980106840 0x7fb980106ca0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb9680099c0 tx=0x7fb968009cd0 comp rx=0 tx=0).stop 2024-05-03T22:33:28.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.424+0000 7fb97fe00700 1 -- 172.21.15.44:0/389324817 shutdown_connections 2024-05-03T22:33:28.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.424+0000 7fb97fe00700 1 --2- 172.21.15.44:0/389324817 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9801071e0 0x7fb98010da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:28.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.424+0000 7fb97fe00700 1 --2- 172.21.15.44:0/389324817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb980105640 0x7fb980105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:28.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.424+0000 7fb97fe00700 1 --2- 172.21.15.44:0/389324817 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb980106840 0x7fb980106ca0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:28.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.424+0000 7fb97fe00700 1 -- 172.21.15.44:0/389324817 >> 172.21.15.44:0/389324817 conn(0x7fb980100be0 msgr2=0x7fb980103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:33:28.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.424+0000 7fb97fe00700 1 -- 172.21.15.44:0/389324817 shutdown_connections 2024-05-03T22:33:28.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.424+0000 7fb97fe00700 1 -- 172.21.15.44:0/389324817 wait complete. 2024-05-03T22:33:28.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.425+0000 7fb97fe00700 1 Processor -- start 2024-05-03T22:33:28.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.425+0000 7fb97fe00700 1 -- start start 2024-05-03T22:33:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.426+0000 7fb97fe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb980105640 0x7fb98019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.426+0000 7fb97fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb980106840 0x7fb98019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.426+0000 7fb97fe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9801071e0 0x7fb9801a2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.426+0000 7fb97fe00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb980111270 con 0x7fb980105640 2024-05-03T22:33:28.429 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.426+0000 7fb97fe00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb9801110f0 con 0x7fb980106840 2024-05-03T22:33:28.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.426+0000 7fb97fe00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb9801113f0 con 0x7fb9801071e0 2024-05-03T22:33:28.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.426+0000 7fb97ea00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb980105640 0x7fb98019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:28.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.426+0000 7fb97ea00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb980105640 0x7fb98019b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:35208/0 (socket says 172.21.15.44:35208) 2024-05-03T22:33:28.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.426+0000 7fb97ea00700 1 -- 172.21.15.44:0/2645171860 learned_addr learned my addr 172.21.15.44:0/2645171860 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:33:28.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.426+0000 7fb976000700 1 --2- 172.21.15.44:0/2645171860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb980106840 0x7fb98019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:28.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.426+0000 7fb97f400700 1 --2- 172.21.15.44:0/2645171860 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9801071e0 0x7fb9801a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:28.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.426+0000 7fb97ea00700 1 -- 172.21.15.44:0/2645171860 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9801071e0 msgr2=0x7fb9801a2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:28.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.426+0000 7fb97ea00700 1 --2- 172.21.15.44:0/2645171860 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9801071e0 0x7fb9801a2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:28.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.426+0000 7fb97ea00700 1 -- 172.21.15.44:0/2645171860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb980106840 msgr2=0x7fb98019bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:28.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.426+0000 7fb97ea00700 1 --2- 172.21.15.44:0/2645171860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb980106840 0x7fb98019bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:28.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.427+0000 7fb97ea00700 1 -- 172.21.15.44:0/2645171860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9801a34b0 con 0x7fb980105640 2024-05-03T22:33:28.430 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.427+0000 7fb97f400700 1 --2- 172.21.15.44:0/2645171860 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9801071e0 0x7fb9801a2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:33:28.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.427+0000 7fb97ea00700 1 --2- 172.21.15.44:0/2645171860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb980105640 0x7fb98019b850 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb970007f40 tx=0x7fb97000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:33:28.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.427+0000 7fb977e00700 1 -- 172.21.15.44:0/2645171860 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97000dd50 con 0x7fb980105640 2024-05-03T22:33:28.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.427+0000 7fb977e00700 1 -- 172.21.15.44:0/2645171860 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fb970004020 con 0x7fb980105640 2024-05-03T22:33:28.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.427+0000 7fb97fe00700 1 -- 172.21.15.44:0/2645171860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9801a37a0 con 0x7fb980105640 2024-05-03T22:33:28.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.427+0000 7fb977e00700 1 -- 172.21.15.44:0/2645171860 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb970013650 con 0x7fb980105640 2024-05-03T22:33:28.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.427+0000 7fb97fe00700 1 -- 172.21.15.44:0/2645171860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9801a3ce0 con 0x7fb980105640 2024-05-03T22:33:28.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.428+0000 7fb97fe00700 1 -- 172.21.15.44:0/2645171860 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb98006a190 con 0x7fb980105640 2024-05-03T22:33:28.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.431+0000 7fb977e00700 1 -- 172.21.15.44:0/2645171860 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fb97001a020 con 0x7fb980105640 2024-05-03T22:33:28.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.432+0000 7fb977e00700 1 --2- 172.21.15.44:0/2645171860 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb9640b2880 0x7fb9640b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:33:28.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.432+0000 7fb977e00700 1 -- 172.21.15.44:0/2645171860 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3237+0+0 (secure 0 0 0) 0x7fb9700e0df0 con 0x7fb980105640 2024-05-03T22:33:28.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.433+0000 7fb976000700 1 --2- 172.21.15.44:0/2645171860 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb9640b2880 0x7fb9640b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:33:28.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.433+0000 7fb976000700 1 --2- 172.21.15.44:0/2645171860 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb9640b2880 0x7fb9640b4d40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb968000c00 tx=0x7fb968005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:33:28.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.435+0000 7fb977e00700 1 -- 172.21.15.44:0/2645171860 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb970010070 con 0x7fb980105640 2024-05-03T22:33:28.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:28 smithi044 ceph-mon[28604]: Detected new or changed devices on smithi160 2024-05-03T22:33:28.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:28 smithi044 ceph-mon[28604]: Adjusting osd_memory_target on smithi160 to 17089M 2024-05-03T22:33:28.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:28 smithi044 ceph-mon[28604]: pgmap v109: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:28.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:28 smithi044 ceph-mon[28604]: osdmap e21: 3 total, 3 up, 3 in 2024-05-03T22:33:28.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:28 smithi044 ceph-mon[28604]: mgrmap e16: x(active, since 3m), standbys: y, z 2024-05-03T22:33:28.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:28 smithi060 ceph-mon[31721]: Detected new or changed devices on smithi160 2024-05-03T22:33:28.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:28 smithi060 ceph-mon[31721]: Adjusting osd_memory_target on smithi160 to 17089M 2024-05-03T22:33:28.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:28 smithi060 ceph-mon[31721]: pgmap v109: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:28.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:28 smithi060 ceph-mon[31721]: osdmap e21: 3 total, 3 up, 3 in 2024-05-03T22:33:28.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:28 smithi060 ceph-mon[31721]: mgrmap e16: x(active, since 3m), standbys: y, z 2024-05-03T22:33:28.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:28 smithi160 ceph-mon[32531]: Detected new or changed devices on smithi160 2024-05-03T22:33:28.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:28 smithi160 ceph-mon[32531]: Adjusting osd_memory_target on smithi160 to 17089M 2024-05-03T22:33:28.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:28 smithi160 ceph-mon[32531]: pgmap v109: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:28.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:28 smithi160 ceph-mon[32531]: osdmap e21: 3 total, 3 up, 3 in 2024-05-03T22:33:28.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:28 smithi160 ceph-mon[32531]: mgrmap e16: x(active, since 3m), standbys: y, z 2024-05-03T22:33:28.685 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:28.683+0000 7fb97fe00700 1 -- 172.21.15.44:0/2645171860 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb9800638e0 con 0x7fb9640b2880 2024-05-03T22:33:29.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:29 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:33:29.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:29 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:33:29.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:29 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:33:29.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:29 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:33:29.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:29 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:33:29.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:29 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:33:29.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:29 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:33:29.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:29 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:33:29.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:29 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:33:30.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:30 smithi044 ceph-mon[28604]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:33:30.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:30 smithi044 ceph-mon[28604]: pgmap v111: 1 pgs: 1 creating+peering; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:30.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:30 smithi060 ceph-mon[31721]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:33:30.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:30 smithi060 ceph-mon[31721]: pgmap v111: 1 pgs: 1 creating+peering; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:30 smithi160 ceph-mon[32531]: from='client.14301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:33:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:30 smithi160 ceph-mon[32531]: pgmap v111: 1 pgs: 1 creating+peering; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:31.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:31 smithi044 ceph-mon[28604]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:31.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:31 smithi160 ceph-mon[32531]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:31.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:31 smithi060 ceph-mon[31721]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:33.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:32 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2386837988' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "75c56c3b-5807-4646-885c-1ef16541ff72"}]: dispatch 2024-05-03T22:33:33.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:32 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2386837988' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75c56c3b-5807-4646-885c-1ef16541ff72"}]': finished 2024-05-03T22:33:33.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:32 smithi044 ceph-mon[28604]: osdmap e22: 4 total, 3 up, 4 in 2024-05-03T22:33:33.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:32 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:33:33.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:32 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2386837988' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "75c56c3b-5807-4646-885c-1ef16541ff72"}]: dispatch 2024-05-03T22:33:33.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:32 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2386837988' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75c56c3b-5807-4646-885c-1ef16541ff72"}]': finished 2024-05-03T22:33:33.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:32 smithi060 ceph-mon[31721]: osdmap e22: 4 total, 3 up, 4 in 2024-05-03T22:33:33.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:32 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:33:33.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:32 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2386837988' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "75c56c3b-5807-4646-885c-1ef16541ff72"}]: dispatch 2024-05-03T22:33:33.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:32 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2386837988' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "75c56c3b-5807-4646-885c-1ef16541ff72"}]': finished 2024-05-03T22:33:33.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:32 smithi160 ceph-mon[32531]: osdmap e22: 4 total, 3 up, 4 in 2024-05-03T22:33:33.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:32 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:33:34.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:33 smithi044 ceph-mon[28604]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:34.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:33 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1895073274' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:33:34.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:33 smithi060 ceph-mon[31721]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:34.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:33 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1895073274' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:33:34.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:33 smithi160 ceph-mon[32531]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:34.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:33 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1895073274' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:33:36.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:35 smithi044 ceph-mon[28604]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:36.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:35 smithi060 ceph-mon[31721]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:36.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:35 smithi160 ceph-mon[32531]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:38.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:37 smithi044 ceph-mon[28604]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:38.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:37 smithi060 ceph-mon[31721]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:38.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:37 smithi160 ceph-mon[32531]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:39.980 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:39 smithi060 ceph-mon[31721]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:40.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:39 smithi044 ceph-mon[28604]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:40.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:39 smithi160 ceph-mon[32531]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:42.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:41 smithi044 ceph-mon[28604]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:42.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:41 smithi060 ceph-mon[31721]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:42.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:41 smithi160 ceph-mon[32531]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:43.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:42 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-03T22:33:43.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:42 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:33:43.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:42 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-03T22:33:43.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:42 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:33:43.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:42 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-03T22:33:43.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:42 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:33:44.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:43 smithi044 ceph-mon[28604]: Deploying daemon osd.3 on smithi044 2024-05-03T22:33:44.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:43 smithi044 ceph-mon[28604]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:44.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:43 smithi060 ceph-mon[31721]: Deploying daemon osd.3 on smithi044 2024-05-03T22:33:44.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:43 smithi060 ceph-mon[31721]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:44.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:43 smithi160 ceph-mon[32531]: Deploying daemon osd.3 on smithi044 2024-05-03T22:33:44.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:43 smithi160 ceph-mon[32531]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:46.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:45 smithi044 ceph-mon[28604]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:46.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:45 smithi060 ceph-mon[31721]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:46.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:45 smithi160 ceph-mon[32531]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:48.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:47 smithi044 ceph-mon[28604]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:48.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:47 smithi060 ceph-mon[31721]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:48.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:47 smithi160 ceph-mon[32531]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:50.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:49 smithi044 ceph-mon[28604]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:50.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:49 smithi060 ceph-mon[31721]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:50.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:49 smithi160 ceph-mon[32531]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:52.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:51 smithi044 ceph-mon[28604]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:52.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:51 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:52.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:51 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:33:52.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:51 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:52.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:51 smithi060 ceph-mon[31721]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:52.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:51 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:52.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:51 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:33:52.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:51 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:52.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:51 smithi160 ceph-mon[32531]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:52.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:51 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:52.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:51 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:33:52.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:51 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:53.961 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:53 smithi044 ceph-mon[28604]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:54.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:53 smithi060 ceph-mon[31721]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:54.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:53 smithi160 ceph-mon[32531]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:56.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:56 smithi044 ceph-mon[28604]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:56.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:56 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:56.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:56 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:56.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:56 smithi044 ceph-mon[28604]: from='osd.3 [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-03T22:33:56.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:56.480+0000 7fb977e00700 1 -- 172.21.15.44:0/2645171860 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb9800638e0 con 0x7fb9640b2880 2024-05-03T22:33:56.482 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 3 on host 'smithi044' 2024-05-03T22:33:56.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:56.483+0000 7fb97fe00700 1 -- 172.21.15.44:0/2645171860 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb9640b2880 msgr2=0x7fb9640b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:56.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:56.483+0000 7fb97fe00700 1 --2- 172.21.15.44:0/2645171860 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb9640b2880 0x7fb9640b4d40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb968000c00 tx=0x7fb968005fb0 comp rx=0 tx=0).stop 2024-05-03T22:33:56.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:56.483+0000 7fb97fe00700 1 -- 172.21.15.44:0/2645171860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb980105640 msgr2=0x7fb98019b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:33:56.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:56.483+0000 7fb97fe00700 1 --2- 172.21.15.44:0/2645171860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb980105640 0x7fb98019b850 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb970007f40 tx=0x7fb97000d3b0 comp rx=0 tx=0).stop 2024-05-03T22:33:56.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:56.483+0000 7fb97fe00700 1 -- 172.21.15.44:0/2645171860 shutdown_connections 2024-05-03T22:33:56.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:56.483+0000 7fb97fe00700 1 --2- 172.21.15.44:0/2645171860 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb9640b2880 0x7fb9640b4d40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:56.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:56.483+0000 7fb97fe00700 1 --2- 172.21.15.44:0/2645171860 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9801071e0 0x7fb9801a2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:56.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:56.483+0000 7fb97fe00700 1 --2- 172.21.15.44:0/2645171860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb980105640 0x7fb98019b850 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:56.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:56.483+0000 7fb97fe00700 1 --2- 172.21.15.44:0/2645171860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb980106840 0x7fb98019bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:33:56.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:56.483+0000 7fb97fe00700 1 -- 172.21.15.44:0/2645171860 >> 172.21.15.44:0/2645171860 conn(0x7fb980100be0 msgr2=0x7fb980109b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:33:56.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:56.484+0000 7fb97fe00700 1 -- 172.21.15.44:0/2645171860 shutdown_connections 2024-05-03T22:33:56.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:33:56.484+0000 7fb97fe00700 1 -- 172.21.15.44:0/2645171860 wait complete. 2024-05-03T22:33:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:56 smithi060 ceph-mon[31721]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:56 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:56 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:56 smithi060 ceph-mon[31721]: from='osd.3 [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-03T22:33:56.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:56 smithi160 ceph-mon[32531]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:56.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:56 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:56.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:56 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:56.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:56 smithi160 ceph-mon[32531]: from='osd.3 [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-03T22:33:57.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:57 smithi044 ceph-mon[28604]: from='osd.3 [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-03T22:33:57.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:57 smithi044 ceph-mon[28604]: osdmap e23: 4 total, 3 up, 4 in 2024-05-03T22:33:57.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:57 smithi044 ceph-mon[28604]: from='osd.3 [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-05-03T22:33:57.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:33:57.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:57.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:57.356 DEBUG:teuthology.orchestra.run.smithi044:osd.3> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.3.service 2024-05-03T22:33:57.362 INFO:tasks.cephadm:Deploying osd.4 on smithi060 with /dev/vg_nvme/lv_3... 2024-05-03T22:33:57.362 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-03T22:33:57.446 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:57 smithi060 ceph-mon[31721]: from='osd.3 [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-03T22:33:57.446 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:57 smithi060 ceph-mon[31721]: osdmap e23: 4 total, 3 up, 4 in 2024-05-03T22:33:57.446 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:57 smithi060 ceph-mon[31721]: from='osd.3 [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-05-03T22:33:57.446 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:33:57.446 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:57.447 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:57.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:57 smithi160 ceph-mon[32531]: from='osd.3 [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-03T22:33:57.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:57 smithi160 ceph-mon[32531]: osdmap e23: 4 total, 3 up, 4 in 2024-05-03T22:33:57.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:57 smithi160 ceph-mon[32531]: from='osd.3 [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-05-03T22:33:57.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:33:57.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:57.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:33:57.818 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T22:33:58.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:58 smithi044 ceph-mon[28604]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:58.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:58 smithi044 ceph-mon[28604]: from='osd.3 [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-05-03T22:33:58.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:58 smithi044 ceph-mon[28604]: osdmap e24: 4 total, 3 up, 4 in 2024-05-03T22:33:58.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:58 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:33:58.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:58 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:33:58.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:58 smithi044 ceph-mon[28604]: from='osd.3 [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279]' entity='osd.3' 2024-05-03T22:33:58.253 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 22:33:57 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-3[50497]: 2024-05-03T22:33:57.914+0000 7f9f7f800700 -1 osd.3 0 waiting for initial osdmap 2024-05-03T22:33:58.253 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 22:33:57 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-3[50497]: 2024-05-03T22:33:57.929+0000 7f9f75600700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T22:33:58.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:58 smithi060 ceph-mon[31721]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:58.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:58 smithi060 ceph-mon[31721]: from='osd.3 [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-05-03T22:33:58.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:58 smithi060 ceph-mon[31721]: osdmap e24: 4 total, 3 up, 4 in 2024-05-03T22:33:58.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:58 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:33:58.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:58 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:33:58.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:58 smithi060 ceph-mon[31721]: from='osd.3 [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279]' entity='osd.3' 2024-05-03T22:33:58.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:58 smithi160 ceph-mon[32531]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-05-03T22:33:58.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:58 smithi160 ceph-mon[32531]: from='osd.3 [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-05-03T22:33:58.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:58 smithi160 ceph-mon[32531]: osdmap e24: 4 total, 3 up, 4 in 2024-05-03T22:33:58.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:58 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:33:58.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:58 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:33:58.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:58 smithi160 ceph-mon[32531]: from='osd.3 [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279]' entity='osd.3' 2024-05-03T22:33:59.385 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:59 smithi044 ceph-mon[28604]: purged_snaps scrub starts 2024-05-03T22:33:59.386 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:59 smithi044 ceph-mon[28604]: purged_snaps scrub ok 2024-05-03T22:33:59.386 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:59 smithi044 ceph-mon[28604]: osd.3 [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279] boot 2024-05-03T22:33:59.386 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:59 smithi044 ceph-mon[28604]: osdmap e25: 4 total, 4 up, 4 in 2024-05-03T22:33:59.386 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:59 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:33:59.386 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:33:59 smithi044 ceph-mon[28604]: osdmap e26: 4 total, 4 up, 4 in 2024-05-03T22:33:59.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:59 smithi060 ceph-mon[31721]: purged_snaps scrub starts 2024-05-03T22:33:59.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:59 smithi060 ceph-mon[31721]: purged_snaps scrub ok 2024-05-03T22:33:59.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:59 smithi060 ceph-mon[31721]: osd.3 [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279] boot 2024-05-03T22:33:59.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:59 smithi060 ceph-mon[31721]: osdmap e25: 4 total, 4 up, 4 in 2024-05-03T22:33:59.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:59 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:33:59.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:33:59 smithi060 ceph-mon[31721]: osdmap e26: 4 total, 4 up, 4 in 2024-05-03T22:33:59.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:59 smithi160 ceph-mon[32531]: purged_snaps scrub starts 2024-05-03T22:33:59.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:59 smithi160 ceph-mon[32531]: purged_snaps scrub ok 2024-05-03T22:33:59.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:59 smithi160 ceph-mon[32531]: osd.3 [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279] boot 2024-05-03T22:33:59.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:59 smithi160 ceph-mon[32531]: osdmap e25: 4 total, 4 up, 4 in 2024-05-03T22:33:59.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:59 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-03T22:33:59.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:33:59 smithi160 ceph-mon[32531]: osdmap e26: 4 total, 4 up, 4 in 2024-05-03T22:34:00.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:00 smithi060 ceph-mon[31721]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 512 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:00.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:00 smithi060 ceph-mon[31721]: osdmap e27: 4 total, 4 up, 4 in 2024-05-03T22:34:00.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:00 smithi044 ceph-mon[28604]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 512 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:00.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:00 smithi044 ceph-mon[28604]: osdmap e27: 4 total, 4 up, 4 in 2024-05-03T22:34:00.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:00 smithi160 ceph-mon[32531]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 512 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:00.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:00 smithi160 ceph-mon[32531]: osdmap e27: 4 total, 4 up, 4 in 2024-05-03T22:34:00.895 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-03T22:34:00.895 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-03T22:34:00.895 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2024-05-03T22:34:00.895 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2024-05-03T22:34:00.895 INFO:teuthology.orchestra.run.smithi060.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0333504 s, 314 MB/s 2024-05-03T22:34:00.895 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2024-05-03T22:34:01.713 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi060:vg_nvme/lv_3 2024-05-03T22:34:02.143 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T22:34:02.425 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:02 smithi060 ceph-mon[31721]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 512 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-03T22:34:02.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:02 smithi044 ceph-mon[28604]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 512 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-03T22:34:02.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:02 smithi160 ceph-mon[32531]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 512 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-03T22:34:03.468 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:03 smithi060 ceph-mon[31721]: Detected new or changed devices on smithi044 2024-05-03T22:34:03.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:03 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:03.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:03 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:03.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:03 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:34:03.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:03 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:34:03.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:03 smithi060 ceph-mon[31721]: Adjusting osd_memory_target on smithi044 to 8547M 2024-05-03T22:34:03.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:03 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:03.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:03 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:03.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:03 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:34:03.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:03 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:03.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:03 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:34:03.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:03 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:03.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:03 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:34:03.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:03 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:03.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:03 smithi044 ceph-mon[28604]: Detected new or changed devices on smithi044 2024-05-03T22:34:03.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:03 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:03.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:03 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:03.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:03 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:34:03.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:03 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:34:03.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:03 smithi044 ceph-mon[28604]: Adjusting osd_memory_target on smithi044 to 8547M 2024-05-03T22:34:03.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:03 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:03.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:03 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:03.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:03 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:34:03.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:03 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:03.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:03 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:34:03.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:03 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:03.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:03 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:34:03.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:03 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:03.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:03 smithi160 ceph-mon[32531]: Detected new or changed devices on smithi044 2024-05-03T22:34:03.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:03 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:03.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:03 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:03.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:03 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:34:03.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:03 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:34:03.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:03 smithi160 ceph-mon[32531]: Adjusting osd_memory_target on smithi044 to 8547M 2024-05-03T22:34:03.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:03 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:03.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:03 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:03.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:03 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:34:03.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:03 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:03.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:03 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:34:03.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:03 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:03.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:03 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:34:03.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:03 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:04.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.265+0000 7f3890800700 1 -- 172.21.15.60:0/870536019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3888103500 msgr2=0x7f3888103920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:34:04.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.265+0000 7f3890800700 1 --2- 172.21.15.60:0/870536019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3888103500 0x7f3888103920 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f387c0099c0 tx=0x7f387c009cd0 comp rx=0 tx=0).stop 2024-05-03T22:34:04.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.265+0000 7f3890800700 1 -- 172.21.15.60:0/870536019 shutdown_connections 2024-05-03T22:34:04.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.265+0000 7f3890800700 1 --2- 172.21.15.60:0/870536019 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f38881050a0 0x7f388810b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:04.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.265+0000 7f3890800700 1 --2- 172.21.15.60:0/870536019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3888103500 0x7f3888103920 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:04.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.265+0000 7f3890800700 1 --2- 172.21.15.60:0/870536019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3888104700 0x7f3888104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:04.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.265+0000 7f3890800700 1 -- 172.21.15.60:0/870536019 >> 172.21.15.60:0/870536019 conn(0x7f38880feaa0 msgr2=0x7f3888100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:34:04.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.265+0000 7f3890800700 1 -- 172.21.15.60:0/870536019 shutdown_connections 2024-05-03T22:34:04.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.265+0000 7f3890800700 1 -- 172.21.15.60:0/870536019 wait complete. 2024-05-03T22:34:04.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.267+0000 7f3890800700 1 Processor -- start 2024-05-03T22:34:04.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.267+0000 7f3890800700 1 -- start start 2024-05-03T22:34:04.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.268+0000 7f3890800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3888103500 0x7f38881997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:34:04.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.268+0000 7f3890800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3888104700 0x7f3888199ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:34:04.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.268+0000 7f3890800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38881050a0 0x7f38881a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:34:04.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.268+0000 7f3890800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f388810f130 con 0x7f3888104700 2024-05-03T22:34:04.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.268+0000 7f3890800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f388810efb0 con 0x7f38881050a0 2024-05-03T22:34:04.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.268+0000 7f3890800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f388810f2b0 con 0x7f3888103500 2024-05-03T22:34:04.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.268+0000 7f388e800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38881050a0 0x7f38881a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:34:04.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.268+0000 7f388e800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38881050a0 0x7f38881a0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55524/0 (socket says 172.21.15.60:55524) 2024-05-03T22:34:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.268+0000 7f388e800700 1 -- 172.21.15.60:0/3117451186 learned_addr learned my addr 172.21.15.60:0/3117451186 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-05-03T22:34:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.268+0000 7f388de00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3888103500 0x7f38881997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:34:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.269+0000 7f388d400700 1 --2- 172.21.15.60:0/3117451186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3888104700 0x7f3888199ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:34:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.269+0000 7f388e800700 1 -- 172.21.15.60:0/3117451186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3888103500 msgr2=0x7f38881997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:34:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.269+0000 7f388e800700 1 --2- 172.21.15.60:0/3117451186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3888103500 0x7f38881997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.269+0000 7f388e800700 1 -- 172.21.15.60:0/3117451186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3888104700 msgr2=0x7f3888199ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:34:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.269+0000 7f388e800700 1 --2- 172.21.15.60:0/3117451186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3888104700 0x7f3888199ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.269+0000 7f388e800700 1 -- 172.21.15.60:0/3117451186 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38881a1400 con 0x7f38881050a0 2024-05-03T22:34:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.269+0000 7f388e800700 1 --2- 172.21.15.60:0/3117451186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38881050a0 0x7f38881a0d60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f388400ef30 tx=0x7f388400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:34:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.269+0000 7f3882a00700 1 -- 172.21.15.60:0/3117451186 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38840092e0 con 0x7f38881050a0 2024-05-03T22:34:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.270+0000 7f3890800700 1 -- 172.21.15.60:0/3117451186 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38881a1690 con 0x7f38881050a0 2024-05-03T22:34:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.270+0000 7f3882a00700 1 -- 172.21.15.60:0/3117451186 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f3884004bb0 con 0x7f38881050a0 2024-05-03T22:34:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.270+0000 7f3882a00700 1 -- 172.21.15.60:0/3117451186 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388400cea0 con 0x7f38881050a0 2024-05-03T22:34:04.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.270+0000 7f3890800700 1 -- 172.21.15.60:0/3117451186 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38881a1b80 con 0x7f38881050a0 2024-05-03T22:34:04.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.271+0000 7f3890800700 1 -- 172.21.15.60:0/3117451186 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f388806a190 con 0x7f38881050a0 2024-05-03T22:34:04.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.274+0000 7f3882a00700 1 -- 172.21.15.60:0/3117451186 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f388401b030 con 0x7f38881050a0 2024-05-03T22:34:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.275+0000 7f3882a00700 1 --2- 172.21.15.60:0/3117451186 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f38700b2880 0x7f38700b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:34:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.275+0000 7f3882a00700 1 -- 172.21.15.60:0/3117451186 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3669+0+0 (secure 0 0 0) 0x7f38840e1560 con 0x7f38881050a0 2024-05-03T22:34:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.276+0000 7f388de00700 1 --2- 172.21.15.60:0/3117451186 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f38700b2880 0x7f38700b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:34:04.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.277+0000 7f388de00700 1 --2- 172.21.15.60:0/3117451186 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f38700b2880 0x7f38700b4d40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f387c00b580 tx=0x7f387c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:34:04.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.278+0000 7f3882a00700 1 -- 172.21.15.60:0/3117451186 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f3884022020 con 0x7f38881050a0 2024-05-03T22:34:04.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:04 smithi044 ceph-mon[28604]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 512 MiB used, 357 GiB / 358 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-05-03T22:34:04.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:04 smithi060 ceph-mon[31721]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 512 MiB used, 357 GiB / 358 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-05-03T22:34:04.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:04 smithi160 ceph-mon[32531]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 512 MiB used, 357 GiB / 358 GiB avail; 100 KiB/s, 0 objects/s recovering 2024-05-03T22:34:04.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:04.529+0000 7f3890800700 1 -- 172.21.15.60:0/3117451186 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f38880639a0 con 0x7f38700b2880 2024-05-03T22:34:05.436 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:34:05.436 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:34:05.436 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:05.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:34:05.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:34:05.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:05.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:34:05.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:34:05.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:06.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:06 smithi044 ceph-mon[28604]: from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:34:06.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:06 smithi044 ceph-mon[28604]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-03T22:34:06.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:06 smithi060 ceph-mon[31721]: from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:34:06.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:06 smithi060 ceph-mon[31721]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-03T22:34:06.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:06 smithi160 ceph-mon[32531]: from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:34:06.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:06 smithi160 ceph-mon[32531]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-03T22:34:08.422 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:08 smithi060 ceph-mon[31721]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T22:34:08.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:08 smithi044 ceph-mon[28604]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T22:34:08.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:08 smithi160 ceph-mon[32531]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T22:34:09.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:09 smithi044 ceph-mon[28604]: from='client.? 172.21.15.60:0/2104604314' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8a322e4-6ca1-4727-8b41-5ff523acc591"}]: dispatch 2024-05-03T22:34:09.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:09 smithi044 ceph-mon[28604]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8a322e4-6ca1-4727-8b41-5ff523acc591"}]: dispatch 2024-05-03T22:34:09.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:09 smithi044 ceph-mon[28604]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8a322e4-6ca1-4727-8b41-5ff523acc591"}]': finished 2024-05-03T22:34:09.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:09 smithi044 ceph-mon[28604]: osdmap e28: 5 total, 4 up, 5 in 2024-05-03T22:34:09.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:09 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:34:09.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:09 smithi060 ceph-mon[31721]: from='client.? 172.21.15.60:0/2104604314' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8a322e4-6ca1-4727-8b41-5ff523acc591"}]: dispatch 2024-05-03T22:34:09.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:09 smithi060 ceph-mon[31721]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8a322e4-6ca1-4727-8b41-5ff523acc591"}]: dispatch 2024-05-03T22:34:09.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:09 smithi060 ceph-mon[31721]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8a322e4-6ca1-4727-8b41-5ff523acc591"}]': finished 2024-05-03T22:34:09.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:09 smithi060 ceph-mon[31721]: osdmap e28: 5 total, 4 up, 5 in 2024-05-03T22:34:09.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:09 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:34:09.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:09 smithi160 ceph-mon[32531]: from='client.? 172.21.15.60:0/2104604314' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8a322e4-6ca1-4727-8b41-5ff523acc591"}]: dispatch 2024-05-03T22:34:09.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:09 smithi160 ceph-mon[32531]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a8a322e4-6ca1-4727-8b41-5ff523acc591"}]: dispatch 2024-05-03T22:34:09.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:09 smithi160 ceph-mon[32531]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a8a322e4-6ca1-4727-8b41-5ff523acc591"}]': finished 2024-05-03T22:34:09.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:09 smithi160 ceph-mon[32531]: osdmap e28: 5 total, 4 up, 5 in 2024-05-03T22:34:09.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:09 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:34:10.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:10 smithi044 ceph-mon[28604]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-03T22:34:10.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:10 smithi044 ceph-mon[28604]: from='client.? 172.21.15.60:0/1195356842' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:34:10.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:10 smithi060 ceph-mon[31721]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-03T22:34:10.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:10 smithi060 ceph-mon[31721]: from='client.? 172.21.15.60:0/1195356842' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:34:10.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:10 smithi160 ceph-mon[32531]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-05-03T22:34:10.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:10 smithi160 ceph-mon[32531]: from='client.? 172.21.15.60:0/1195356842' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:34:12.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:12 smithi044 ceph-mon[28604]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:12.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:12 smithi060 ceph-mon[31721]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:12.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:12 smithi160 ceph-mon[32531]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:14.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:14 smithi044 ceph-mon[28604]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:14.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:14 smithi060 ceph-mon[31721]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:14.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:14 smithi160 ceph-mon[32531]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:16.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:16 smithi060 ceph-mon[31721]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:16.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:16 smithi044 ceph-mon[28604]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:16.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:16 smithi160 ceph-mon[32531]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:18.467 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:18 smithi060 ceph-mon[31721]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:18.468 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:18 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-03T22:34:18.468 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:18 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:18.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:18 smithi044 ceph-mon[28604]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:18.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:18 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-03T22:34:18.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:18 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:18.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:18 smithi160 ceph-mon[32531]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:18.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:18 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-03T22:34:18.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:18 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:19.321 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:19 smithi060 ceph-mon[31721]: Deploying daemon osd.4 on smithi060 2024-05-03T22:34:19.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:19 smithi044 ceph-mon[28604]: Deploying daemon osd.4 on smithi060 2024-05-03T22:34:19.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:19 smithi160 ceph-mon[32531]: Deploying daemon osd.4 on smithi060 2024-05-03T22:34:20.444 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:20 smithi060 ceph-mon[31721]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:20.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:20 smithi044 ceph-mon[28604]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:20.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:20 smithi160 ceph-mon[32531]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:22.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:22 smithi044 ceph-mon[28604]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:22.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:22 smithi060 ceph-mon[31721]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:22.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:22 smithi160 ceph-mon[32531]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:24.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:24 smithi044 ceph-mon[28604]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:24.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:24 smithi060 ceph-mon[31721]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:24.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:24 smithi160 ceph-mon[32531]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:26.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:26 smithi044 ceph-mon[28604]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:26.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:26 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:34:26.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:26 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:26.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:26 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:26.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:26 smithi060 ceph-mon[31721]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:26.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:26 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:34:26.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:26 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:26.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:26 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:26.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:26 smithi160 ceph-mon[32531]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:26.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:26 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:34:26.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:26 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:26.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:26 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:28.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:28 smithi044 ceph-mon[28604]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:28.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:28 smithi060 ceph-mon[31721]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:28.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:28 smithi160 ceph-mon[32531]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:30.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:30 smithi044 ceph-mon[28604]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:30.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:30.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:30.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:30 smithi060 ceph-mon[31721]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:30.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:30.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:30 smithi160 ceph-mon[32531]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:31.042 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 4 on host 'smithi060' 2024-05-03T22:34:31.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:31.040+0000 7f3882a00700 1 -- 172.21.15.60:0/3117451186 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f38880639a0 con 0x7f38700b2880 2024-05-03T22:34:31.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:31.044+0000 7f3890800700 1 -- 172.21.15.60:0/3117451186 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f38700b2880 msgr2=0x7f38700b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:34:31.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:31.044+0000 7f3890800700 1 --2- 172.21.15.60:0/3117451186 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f38700b2880 0x7f38700b4d40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f387c00b580 tx=0x7f387c005fb0 comp rx=0 tx=0).stop 2024-05-03T22:34:31.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:31.044+0000 7f3890800700 1 -- 172.21.15.60:0/3117451186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38881050a0 msgr2=0x7f38881a0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:34:31.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:31.044+0000 7f3890800700 1 --2- 172.21.15.60:0/3117451186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38881050a0 0x7f38881a0d60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f388400ef30 tx=0x7f388400c3a0 comp rx=0 tx=0).stop 2024-05-03T22:34:31.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:31.045+0000 7f3890800700 1 -- 172.21.15.60:0/3117451186 shutdown_connections 2024-05-03T22:34:31.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:31.045+0000 7f3890800700 1 --2- 172.21.15.60:0/3117451186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38881050a0 0x7f38881a0d60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:31.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:31.045+0000 7f3890800700 1 --2- 172.21.15.60:0/3117451186 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f38700b2880 0x7f38700b4d40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:31.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:31.045+0000 7f3890800700 1 --2- 172.21.15.60:0/3117451186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3888103500 0x7f38881997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:31.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:31.045+0000 7f3890800700 1 --2- 172.21.15.60:0/3117451186 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3888104700 0x7f3888199ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:31.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:31.045+0000 7f3890800700 1 -- 172.21.15.60:0/3117451186 >> 172.21.15.60:0/3117451186 conn(0x7f38880feaa0 msgr2=0x7f3888107b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:34:31.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:31.045+0000 7f3890800700 1 -- 172.21.15.60:0/3117451186 shutdown_connections 2024-05-03T22:34:31.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:34:31.045+0000 7f3890800700 1 -- 172.21.15.60:0/3117451186 wait complete. 2024-05-03T22:34:31.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:31 smithi060 ceph-mon[31721]: from='osd.4 [v2:172.21.15.60:6808/3794821539,v1:172.21.15.60:6809/3794821539]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-03T22:34:31.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:31 smithi060 ceph-mon[31721]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-03T22:34:31.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:31 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:31.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:31 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:34:31.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:31 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:31.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:31 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:31.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:31 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:31.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:31 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:34:31.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:31 smithi044 ceph-mon[28604]: from='osd.4 [v2:172.21.15.60:6808/3794821539,v1:172.21.15.60:6809/3794821539]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-03T22:34:31.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:31 smithi044 ceph-mon[28604]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-03T22:34:31.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:31 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:31.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:31 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:34:31.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:31 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:31.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:31 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:31.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:31 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:31.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:31 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:34:31.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:31 smithi160 ceph-mon[32531]: from='osd.4 [v2:172.21.15.60:6808/3794821539,v1:172.21.15.60:6809/3794821539]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-03T22:34:31.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:31 smithi160 ceph-mon[32531]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-03T22:34:31.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:31 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:31.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:31 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:34:31.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:31 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:31.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:31 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:31.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:31 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:31.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:31 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:34:31.855 DEBUG:teuthology.orchestra.run.smithi060:osd.4> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.4.service 2024-05-03T22:34:31.860 INFO:tasks.cephadm:Deploying osd.5 on smithi160 with /dev/vg_nvme/lv_3... 2024-05-03T22:34:31.860 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-03T22:34:32.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:32 smithi160 ceph-mon[32531]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:32.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:32 smithi160 ceph-mon[32531]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-03T22:34:32.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:32 smithi160 ceph-mon[32531]: from='osd.4 [v2:172.21.15.60:6808/3794821539,v1:172.21.15.60:6809/3794821539]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:34:32.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:32 smithi160 ceph-mon[32531]: osdmap e29: 5 total, 4 up, 5 in 2024-05-03T22:34:32.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:32 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:34:32.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:32 smithi160 ceph-mon[32531]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:34:32.306 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:34:32.427 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:32 smithi060 ceph-mon[31721]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:32.427 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:32 smithi060 ceph-mon[31721]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-03T22:34:32.427 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:32 smithi060 ceph-mon[31721]: from='osd.4 [v2:172.21.15.60:6808/3794821539,v1:172.21.15.60:6809/3794821539]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:34:32.427 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:32 smithi060 ceph-mon[31721]: osdmap e29: 5 total, 4 up, 5 in 2024-05-03T22:34:32.427 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:32 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:34:32.427 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:32 smithi060 ceph-mon[31721]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:34:32.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:32 smithi044 ceph-mon[28604]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:32.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:32 smithi044 ceph-mon[28604]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-03T22:34:32.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:32 smithi044 ceph-mon[28604]: from='osd.4 [v2:172.21.15.60:6808/3794821539,v1:172.21.15.60:6809/3794821539]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:34:32.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:32 smithi044 ceph-mon[28604]: osdmap e29: 5 total, 4 up, 5 in 2024-05-03T22:34:32.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:32 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:34:32.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:32 smithi044 ceph-mon[28604]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:34:33.113 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 22:34:32 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-4[43103]: 2024-05-03T22:34:32.903+0000 7f3ff1400700 -1 osd.4 0 waiting for initial osdmap 2024-05-03T22:34:33.114 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 22:34:32 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-4[43103]: 2024-05-03T22:34:32.928+0000 7f3fe7200700 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T22:34:33.471 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:33 smithi160 ceph-mon[32531]: purged_snaps scrub starts 2024-05-03T22:34:33.471 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:33 smithi160 ceph-mon[32531]: purged_snaps scrub ok 2024-05-03T22:34:33.471 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:33 smithi160 ceph-mon[32531]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-03T22:34:33.471 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:33 smithi160 ceph-mon[32531]: osdmap e30: 5 total, 4 up, 5 in 2024-05-03T22:34:33.472 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:33 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:34:33.472 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:33 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:34:33.472 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:33 smithi160 ceph-mon[32531]: from='osd.4 ' entity='osd.4' 2024-05-03T22:34:33.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:33 smithi044 ceph-mon[28604]: purged_snaps scrub starts 2024-05-03T22:34:33.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:33 smithi044 ceph-mon[28604]: purged_snaps scrub ok 2024-05-03T22:34:33.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:33 smithi044 ceph-mon[28604]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-03T22:34:33.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:33 smithi044 ceph-mon[28604]: osdmap e30: 5 total, 4 up, 5 in 2024-05-03T22:34:33.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:33 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:34:33.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:33 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:34:33.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:33 smithi044 ceph-mon[28604]: from='osd.4 ' entity='osd.4' 2024-05-03T22:34:33.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:33 smithi060 ceph-mon[31721]: purged_snaps scrub starts 2024-05-03T22:34:33.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:33 smithi060 ceph-mon[31721]: purged_snaps scrub ok 2024-05-03T22:34:33.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:33 smithi060 ceph-mon[31721]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-03T22:34:33.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:33 smithi060 ceph-mon[31721]: osdmap e30: 5 total, 4 up, 5 in 2024-05-03T22:34:33.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:33 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:34:33.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:33 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:34:33.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:33 smithi060 ceph-mon[31721]: from='osd.4 ' entity='osd.4' 2024-05-03T22:34:34.371 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:34 smithi160 ceph-mon[32531]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:34.371 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:34:34.371 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:34 smithi160 ceph-mon[32531]: osd.4 [v2:172.21.15.60:6808/3794821539,v1:172.21.15.60:6809/3794821539] boot 2024-05-03T22:34:34.371 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:34 smithi160 ceph-mon[32531]: osdmap e31: 5 total, 5 up, 5 in 2024-05-03T22:34:34.371 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:34:34.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:34 smithi044 ceph-mon[28604]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:34.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:34:34.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:34 smithi044 ceph-mon[28604]: osd.4 [v2:172.21.15.60:6808/3794821539,v1:172.21.15.60:6809/3794821539] boot 2024-05-03T22:34:34.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:34 smithi044 ceph-mon[28604]: osdmap e31: 5 total, 5 up, 5 in 2024-05-03T22:34:34.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:34:34.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:34 smithi060 ceph-mon[31721]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-05-03T22:34:34.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:34:34.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:34 smithi060 ceph-mon[31721]: osd.4 [v2:172.21.15.60:6808/3794821539,v1:172.21.15.60:6809/3794821539] boot 2024-05-03T22:34:34.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:34 smithi060 ceph-mon[31721]: osdmap e31: 5 total, 5 up, 5 in 2024-05-03T22:34:34.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-03T22:34:35.279 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-03T22:34:35.279 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-03T22:34:35.279 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2024-05-03T22:34:35.279 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2024-05-03T22:34:35.279 INFO:teuthology.orchestra.run.smithi160.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0360133 s, 291 MB/s 2024-05-03T22:34:35.279 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2024-05-03T22:34:36.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:35 smithi160 ceph-mon[32531]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:36.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:35 smithi160 ceph-mon[32531]: osdmap e32: 5 total, 5 up, 5 in 2024-05-03T22:34:36.138 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi160:vg_nvme/lv_3 2024-05-03T22:34:36.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:35 smithi044 ceph-mon[28604]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:36.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:35 smithi044 ceph-mon[28604]: osdmap e32: 5 total, 5 up, 5 in 2024-05-03T22:34:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:35 smithi060 ceph-mon[31721]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:35 smithi060 ceph-mon[31721]: osdmap e32: 5 total, 5 up, 5 in 2024-05-03T22:34:36.574 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:34:37.871 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:37 smithi160 ceph-mon[32531]: Detected new or changed devices on smithi060 2024-05-03T22:34:37.871 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:37 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:37.871 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:37 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:37.871 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:37 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:34:37.871 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:37 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:34:37.871 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:37 smithi160 ceph-mon[32531]: Adjusting osd_memory_target on smithi060 to 8547M 2024-05-03T22:34:37.871 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:37 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:37.871 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:37 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:37.871 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:37 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:34:37.871 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:37 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:37.871 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:37 smithi160 ceph-mon[32531]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:38.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:37 smithi044 ceph-mon[28604]: Detected new or changed devices on smithi060 2024-05-03T22:34:38.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:37 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:38.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:37 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:38.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:37 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:34:38.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:37 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:34:38.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:37 smithi044 ceph-mon[28604]: Adjusting osd_memory_target on smithi060 to 8547M 2024-05-03T22:34:38.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:37 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:38.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:37 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:38.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:37 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:34:38.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:37 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:38.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:37 smithi044 ceph-mon[28604]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:38.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:37 smithi060 ceph-mon[31721]: Detected new or changed devices on smithi060 2024-05-03T22:34:38.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:37 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:38.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:37 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:38.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:37 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:34:38.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:37 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:34:38.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:37 smithi060 ceph-mon[31721]: Adjusting osd_memory_target on smithi060 to 8547M 2024-05-03T22:34:38.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:37 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:38.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:37 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:38.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:37 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:34:38.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:37 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:34:38.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:37 smithi060 ceph-mon[31721]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:38.662 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.659+0000 7f9b34e00700 1 -- 172.21.15.160:0/2116879907 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b300774d0 msgr2=0x7f9b30075930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:34:38.662 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.659+0000 7f9b34e00700 1 --2- 172.21.15.160:0/2116879907 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b300774d0 0x7f9b30075930 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000b0a0 tx=0x7f9b2000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:34:38.662 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.659+0000 7f9b34e00700 1 -- 172.21.15.160:0/2116879907 shutdown_connections 2024-05-03T22:34:38.662 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.659+0000 7f9b34e00700 1 --2- 172.21.15.160:0/2116879907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b3010b3e0 0x7f9b3010d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:38.662 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.659+0000 7f9b34e00700 1 --2- 172.21.15.160:0/2116879907 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b300774d0 0x7f9b30075930 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:38.662 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.659+0000 7f9b34e00700 1 --2- 172.21.15.160:0/2116879907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b30075f00 0x7f9b30076380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:38.662 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.659+0000 7f9b34e00700 1 -- 172.21.15.160:0/2116879907 >> 172.21.15.160:0/2116879907 conn(0x7f9b300fea70 msgr2=0x7f9b30100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:34:38.662 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.659+0000 7f9b34e00700 1 -- 172.21.15.160:0/2116879907 shutdown_connections 2024-05-03T22:34:38.662 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.659+0000 7f9b34e00700 1 -- 172.21.15.160:0/2116879907 wait complete. 2024-05-03T22:34:38.664 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.660+0000 7f9b34e00700 1 Processor -- start 2024-05-03T22:34:38.664 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.661+0000 7f9b34e00700 1 -- start start 2024-05-03T22:34:38.664 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.661+0000 7f9b34e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b30075f00 0x7f9b3019b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:34:38.664 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.661+0000 7f9b34e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b300774d0 0x7f9b3019bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:34:38.664 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.661+0000 7f9b34e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b3010b3e0 0x7f9b301a2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:34:38.664 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.661+0000 7f9b34e00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9b30111330 con 0x7f9b300774d0 2024-05-03T22:34:38.664 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.661+0000 7f9b34e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9b301111b0 con 0x7f9b30075f00 2024-05-03T22:34:38.664 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.661+0000 7f9b34e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9b301114b0 con 0x7f9b3010b3e0 2024-05-03T22:34:38.665 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.661+0000 7f9b2e800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b3010b3e0 0x7f9b301a2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:34:38.665 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.661+0000 7f9b2e800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b3010b3e0 0x7f9b301a2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:36500/0 (socket says 172.21.15.160:36500) 2024-05-03T22:34:38.665 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.661+0000 7f9b2e800700 1 -- 172.21.15.160:0/3480799887 learned_addr learned my addr 172.21.15.160:0/3480799887 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-03T22:34:38.665 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.662+0000 7f9b25400700 1 --2- 172.21.15.160:0/3480799887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b300774d0 0x7f9b3019bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:34:38.665 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.662+0000 7f9b2de00700 1 --2- 172.21.15.160:0/3480799887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b30075f00 0x7f9b3019b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:34:38.665 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.662+0000 7f9b2e800700 1 -- 172.21.15.160:0/3480799887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b30075f00 msgr2=0x7f9b3019b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:34:38.665 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.662+0000 7f9b2e800700 1 --2- 172.21.15.160:0/3480799887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b30075f00 0x7f9b3019b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:38.665 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.662+0000 7f9b2e800700 1 -- 172.21.15.160:0/3480799887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b300774d0 msgr2=0x7f9b3019bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:34:38.665 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.662+0000 7f9b2e800700 1 --2- 172.21.15.160:0/3480799887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b300774d0 0x7f9b3019bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:34:38.665 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.662+0000 7f9b2e800700 1 -- 172.21.15.160:0/3480799887 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b301a3600 con 0x7f9b3010b3e0 2024-05-03T22:34:38.665 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.662+0000 7f9b25400700 1 --2- 172.21.15.160:0/3480799887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b300774d0 0x7f9b3019bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:34:38.665 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.662+0000 7f9b2e800700 1 --2- 172.21.15.160:0/3480799887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b3010b3e0 0x7f9b301a2f60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800d9b0 tx=0x7f9b2800dd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:34:38.666 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.662+0000 7f9b27400700 1 -- 172.21.15.160:0/3480799887 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b28017070 con 0x7f9b3010b3e0 2024-05-03T22:34:38.666 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.662+0000 7f9b34e00700 1 -- 172.21.15.160:0/3480799887 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b301a38f0 con 0x7f9b3010b3e0 2024-05-03T22:34:38.666 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.662+0000 7f9b27400700 1 -- 172.21.15.160:0/3480799887 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f9b28009e10 con 0x7f9b3010b3e0 2024-05-03T22:34:38.666 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.663+0000 7f9b27400700 1 -- 172.21.15.160:0/3480799887 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b28005440 con 0x7f9b3010b3e0 2024-05-03T22:34:38.666 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.663+0000 7f9b34e00700 1 -- 172.21.15.160:0/3480799887 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b301a3e30 con 0x7f9b3010b3e0 2024-05-03T22:34:38.666 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.664+0000 7f9b34e00700 1 -- 172.21.15.160:0/3480799887 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3006a190 con 0x7f9b3010b3e0 2024-05-03T22:34:38.668 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.666+0000 7f9b27400700 1 -- 172.21.15.160:0/3480799887 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9b280055e0 con 0x7f9b3010b3e0 2024-05-03T22:34:38.669 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.667+0000 7f9b27400700 1 --2- 172.21.15.160:0/3480799887 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9b140b2880 0x7f9b140b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:34:38.669 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.668+0000 7f9b27400700 1 -- 172.21.15.160:0/3480799887 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4101+0+0 (secure 0 0 0) 0x7f9b280e14e0 con 0x7f9b3010b3e0 2024-05-03T22:34:38.670 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.668+0000 7f9b2de00700 1 --2- 172.21.15.160:0/3480799887 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9b140b2880 0x7f9b140b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:34:38.671 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.669+0000 7f9b2de00700 1 --2- 172.21.15.160:0/3480799887 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9b140b2880 0x7f9b140b4d40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9b20009be0 tx=0x7f9b20006000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:34:38.672 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.671+0000 7f9b27400700 1 -- 172.21.15.160:0/3480799887 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f9b28020020 con 0x7f9b3010b3e0 2024-05-03T22:34:38.914 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:34:38.912+0000 7f9b34e00700 1 -- 172.21.15.160:0/3480799887 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9b300638e0 con 0x7f9b140b2880 2024-05-03T22:34:40.161 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:39 smithi160 ceph-mon[32531]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:40.161 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:39 smithi160 ceph-mon[32531]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:34:40.161 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:39 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:34:40.161 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:39 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:34:40.161 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:39 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:40.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:39 smithi044 ceph-mon[28604]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:40.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:39 smithi044 ceph-mon[28604]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:34:40.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:39 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:34:40.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:39 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:34:40.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:39 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:40.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:39 smithi060 ceph-mon[31721]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:40.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:39 smithi060 ceph-mon[31721]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:34:40.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:39 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:34:40.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:39 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:34:40.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:39 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:42.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:41 smithi160 ceph-mon[32531]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:42.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:41 smithi044 ceph-mon[28604]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:42.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:41 smithi060 ceph-mon[31721]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:43.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:42 smithi044 ceph-mon[28604]: from='client.? 172.21.15.160:0/2023270870' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc718527-bacd-4d1b-90c6-758cbd859e86"}]: dispatch 2024-05-03T22:34:43.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:42 smithi044 ceph-mon[28604]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc718527-bacd-4d1b-90c6-758cbd859e86"}]: dispatch 2024-05-03T22:34:43.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:42 smithi044 ceph-mon[28604]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc718527-bacd-4d1b-90c6-758cbd859e86"}]': finished 2024-05-03T22:34:43.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:42 smithi044 ceph-mon[28604]: osdmap e33: 6 total, 5 up, 6 in 2024-05-03T22:34:43.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:42 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:34:43.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:42 smithi060 ceph-mon[31721]: from='client.? 172.21.15.160:0/2023270870' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc718527-bacd-4d1b-90c6-758cbd859e86"}]: dispatch 2024-05-03T22:34:43.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:42 smithi060 ceph-mon[31721]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc718527-bacd-4d1b-90c6-758cbd859e86"}]: dispatch 2024-05-03T22:34:43.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:42 smithi060 ceph-mon[31721]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc718527-bacd-4d1b-90c6-758cbd859e86"}]': finished 2024-05-03T22:34:43.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:42 smithi060 ceph-mon[31721]: osdmap e33: 6 total, 5 up, 6 in 2024-05-03T22:34:43.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:42 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:34:43.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:42 smithi160 ceph-mon[32531]: from='client.? 172.21.15.160:0/2023270870' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc718527-bacd-4d1b-90c6-758cbd859e86"}]: dispatch 2024-05-03T22:34:43.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:42 smithi160 ceph-mon[32531]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc718527-bacd-4d1b-90c6-758cbd859e86"}]: dispatch 2024-05-03T22:34:43.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:42 smithi160 ceph-mon[32531]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc718527-bacd-4d1b-90c6-758cbd859e86"}]': finished 2024-05-03T22:34:43.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:42 smithi160 ceph-mon[32531]: osdmap e33: 6 total, 5 up, 6 in 2024-05-03T22:34:43.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:42 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:34:44.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:43 smithi044 ceph-mon[28604]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:44.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:43 smithi044 ceph-mon[28604]: from='client.? 172.21.15.160:0/2713859629' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:34:44.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:43 smithi060 ceph-mon[31721]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:44.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:43 smithi060 ceph-mon[31721]: from='client.? 172.21.15.160:0/2713859629' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:34:44.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:43 smithi160 ceph-mon[32531]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:44.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:43 smithi160 ceph-mon[32531]: from='client.? 172.21.15.160:0/2713859629' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:34:46.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:45 smithi044 ceph-mon[28604]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:46.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:45 smithi060 ceph-mon[31721]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:46.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:45 smithi160 ceph-mon[32531]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:48.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:47 smithi044 ceph-mon[28604]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:48.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:47 smithi060 ceph-mon[31721]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:48.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:47 smithi160 ceph-mon[32531]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:50.140 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:49 smithi160 ceph-mon[32531]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:50.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:49 smithi044 ceph-mon[28604]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:50.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:49 smithi060 ceph-mon[31721]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:52.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:51 smithi160 ceph-mon[32531]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:52.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:51 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-03T22:34:52.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:51 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:52.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:51 smithi044 ceph-mon[28604]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:52.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:51 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-03T22:34:52.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:51 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:52.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:51 smithi060 ceph-mon[31721]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:52.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:51 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-03T22:34:52.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:51 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:34:53.055 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:52 smithi160 ceph-mon[32531]: Deploying daemon osd.5 on smithi160 2024-05-03T22:34:53.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:52 smithi044 ceph-mon[28604]: Deploying daemon osd.5 on smithi160 2024-05-03T22:34:53.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:52 smithi060 ceph-mon[31721]: Deploying daemon osd.5 on smithi160 2024-05-03T22:34:54.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:53 smithi044 ceph-mon[28604]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:54.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:53 smithi060 ceph-mon[31721]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:54.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:53 smithi160 ceph-mon[32531]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:56.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:55 smithi044 ceph-mon[28604]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:56.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:55 smithi060 ceph-mon[31721]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:56.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:55 smithi160 ceph-mon[32531]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:58.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:57 smithi044 ceph-mon[28604]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:58.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:57 smithi060 ceph-mon[31721]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:34:58.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:57 smithi160 ceph-mon[32531]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:35:00.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:59 smithi044 ceph-mon[28604]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:35:00.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:59 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:00.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:59 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:35:00.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:34:59 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:00.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:59 smithi060 ceph-mon[31721]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:35:00.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:59 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:00.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:59 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:35:00.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:34:59 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:00.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:59 smithi160 ceph-mon[32531]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:35:00.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:59 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:00.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:59 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:35:00.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:34:59 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:02.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:01 smithi044 ceph-mon[28604]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:35:02.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:01 smithi060 ceph-mon[31721]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:35:02.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:01 smithi160 ceph-mon[32531]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:35:04.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:04 smithi044 ceph-mon[28604]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:35:04.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:04 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:04.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:04 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:04.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:04 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:04.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:04 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:35:04.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:04 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:04.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:04 smithi044 ceph-mon[28604]: from='osd.5 [v2:172.21.15.160:6808/429142335,v1:172.21.15.160:6809/429142335]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-03T22:35:04.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:04 smithi044 ceph-mon[28604]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-03T22:35:04.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:04 smithi060 ceph-mon[31721]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:35:04.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:04 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:04.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:04 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:04.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:04 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:04.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:04 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:35:04.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:04 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:04.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:04 smithi060 ceph-mon[31721]: from='osd.5 [v2:172.21.15.160:6808/429142335,v1:172.21.15.160:6809/429142335]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-03T22:35:04.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:04 smithi060 ceph-mon[31721]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-03T22:35:04.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:04 smithi160 ceph-mon[32531]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:35:04.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:04 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:04.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:04 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:04.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:04 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:04.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:04 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:35:04.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:04 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:04.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:04 smithi160 ceph-mon[32531]: from='osd.5 [v2:172.21.15.160:6808/429142335,v1:172.21.15.160:6809/429142335]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-03T22:35:04.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:04 smithi160 ceph-mon[32531]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-03T22:35:04.733 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:35:04.732+0000 7f9b27400700 1 -- 172.21.15.160:0/3480799887 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9b300638e0 con 0x7f9b140b2880 2024-05-03T22:35:04.733 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 5 on host 'smithi160' 2024-05-03T22:35:04.737 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:35:04.736+0000 7f9b34e00700 1 -- 172.21.15.160:0/3480799887 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9b140b2880 msgr2=0x7f9b140b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:35:04.737 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:35:04.736+0000 7f9b34e00700 1 --2- 172.21.15.160:0/3480799887 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9b140b2880 0x7f9b140b4d40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9b20009be0 tx=0x7f9b20006000 comp rx=0 tx=0).stop 2024-05-03T22:35:04.737 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:35:04.736+0000 7f9b34e00700 1 -- 172.21.15.160:0/3480799887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b3010b3e0 msgr2=0x7f9b301a2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:35:04.737 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:35:04.736+0000 7f9b34e00700 1 --2- 172.21.15.160:0/3480799887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b3010b3e0 0x7f9b301a2f60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800d9b0 tx=0x7f9b2800dd70 comp rx=0 tx=0).stop 2024-05-03T22:35:04.738 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:35:04.736+0000 7f9b34e00700 1 -- 172.21.15.160:0/3480799887 shutdown_connections 2024-05-03T22:35:04.738 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:35:04.736+0000 7f9b34e00700 1 --2- 172.21.15.160:0/3480799887 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9b140b2880 0x7f9b140b4d40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:35:04.738 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:35:04.736+0000 7f9b34e00700 1 --2- 172.21.15.160:0/3480799887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b3010b3e0 0x7f9b301a2f60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:35:04.738 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:35:04.736+0000 7f9b34e00700 1 --2- 172.21.15.160:0/3480799887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b30075f00 0x7f9b3019b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:35:04.738 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:35:04.736+0000 7f9b34e00700 1 --2- 172.21.15.160:0/3480799887 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b300774d0 0x7f9b3019bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:35:04.738 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:35:04.736+0000 7f9b34e00700 1 -- 172.21.15.160:0/3480799887 >> 172.21.15.160:0/3480799887 conn(0x7f9b300fea70 msgr2=0x7f9b301072e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:35:04.738 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:35:04.736+0000 7f9b34e00700 1 -- 172.21.15.160:0/3480799887 shutdown_connections 2024-05-03T22:35:04.738 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:35:04.736+0000 7f9b34e00700 1 -- 172.21.15.160:0/3480799887 wait complete. 2024-05-03T22:35:05.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:05 smithi044 ceph-mon[28604]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-03T22:35:05.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:05 smithi044 ceph-mon[28604]: osdmap e34: 6 total, 5 up, 6 in 2024-05-03T22:35:05.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:05 smithi044 ceph-mon[28604]: from='osd.5 [v2:172.21.15.160:6808/429142335,v1:172.21.15.160:6809/429142335]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:35:05.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:35:05.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:05 smithi044 ceph-mon[28604]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:35:05.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:05.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:05.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:35:05.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:05 smithi060 ceph-mon[31721]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-03T22:35:05.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:05 smithi060 ceph-mon[31721]: osdmap e34: 6 total, 5 up, 6 in 2024-05-03T22:35:05.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:05 smithi060 ceph-mon[31721]: from='osd.5 [v2:172.21.15.160:6808/429142335,v1:172.21.15.160:6809/429142335]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:35:05.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:35:05.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:05 smithi060 ceph-mon[31721]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:35:05.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:05.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:05.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:35:05.508 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:05 smithi160 ceph-mon[32531]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-03T22:35:05.508 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:05 smithi160 ceph-mon[32531]: osdmap e34: 6 total, 5 up, 6 in 2024-05-03T22:35:05.509 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:05 smithi160 ceph-mon[32531]: from='osd.5 [v2:172.21.15.160:6808/429142335,v1:172.21.15.160:6809/429142335]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:35:05.509 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:35:05.509 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:05 smithi160 ceph-mon[32531]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:35:05.509 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:05.509 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:05.509 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:35:05.562 DEBUG:teuthology.orchestra.run.smithi160:osd.5> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.5.service 2024-05-03T22:35:05.567 INFO:tasks.cephadm:Deploying osd.6 on smithi044 with /dev/vg_nvme/lv_2... 2024-05-03T22:35:05.567 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-03T22:35:06.013 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:35:06.105 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 22:35:05 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T22:35:05.995+0000 7fbdf3800700 -1 osd.5 0 waiting for initial osdmap 2024-05-03T22:35:06.105 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 22:35:06 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T22:35:06.017+0000 7fbde8c00700 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T22:35:06.335 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:06 smithi044 ceph-mon[28604]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:35:06.335 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:06 smithi044 ceph-mon[28604]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-03T22:35:06.335 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:06 smithi044 ceph-mon[28604]: osdmap e35: 6 total, 5 up, 6 in 2024-05-03T22:35:06.335 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:06 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:35:06.335 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:06 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:35:06.335 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:06 smithi044 ceph-mon[28604]: from='osd.5 ' entity='osd.5' 2024-05-03T22:35:06.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:06 smithi060 ceph-mon[31721]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:35:06.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:06 smithi060 ceph-mon[31721]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-03T22:35:06.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:06 smithi060 ceph-mon[31721]: osdmap e35: 6 total, 5 up, 6 in 2024-05-03T22:35:06.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:06 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:35:06.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:06 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:35:06.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:06 smithi060 ceph-mon[31721]: from='osd.5 ' entity='osd.5' 2024-05-03T22:35:06.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:06 smithi160 ceph-mon[32531]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-05-03T22:35:06.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:06 smithi160 ceph-mon[32531]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-03T22:35:06.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:06 smithi160 ceph-mon[32531]: osdmap e35: 6 total, 5 up, 6 in 2024-05-03T22:35:06.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:06 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:35:06.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:06 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:35:06.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:06 smithi160 ceph-mon[32531]: from='osd.5 ' entity='osd.5' 2024-05-03T22:35:07.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:07 smithi044 ceph-mon[28604]: purged_snaps scrub starts 2024-05-03T22:35:07.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:07 smithi044 ceph-mon[28604]: purged_snaps scrub ok 2024-05-03T22:35:07.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:07 smithi044 ceph-mon[28604]: osd.5 [v2:172.21.15.160:6808/429142335,v1:172.21.15.160:6809/429142335] boot 2024-05-03T22:35:07.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:07 smithi044 ceph-mon[28604]: osdmap e36: 6 total, 6 up, 6 in 2024-05-03T22:35:07.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:07 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:35:07.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:07 smithi044 ceph-mon[28604]: osdmap e37: 6 total, 6 up, 6 in 2024-05-03T22:35:07.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:07 smithi060 ceph-mon[31721]: purged_snaps scrub starts 2024-05-03T22:35:07.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:07 smithi060 ceph-mon[31721]: purged_snaps scrub ok 2024-05-03T22:35:07.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:07 smithi060 ceph-mon[31721]: osd.5 [v2:172.21.15.160:6808/429142335,v1:172.21.15.160:6809/429142335] boot 2024-05-03T22:35:07.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:07 smithi060 ceph-mon[31721]: osdmap e36: 6 total, 6 up, 6 in 2024-05-03T22:35:07.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:07 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:35:07.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:07 smithi060 ceph-mon[31721]: osdmap e37: 6 total, 6 up, 6 in 2024-05-03T22:35:07.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:07 smithi160 ceph-mon[32531]: purged_snaps scrub starts 2024-05-03T22:35:07.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:07 smithi160 ceph-mon[32531]: purged_snaps scrub ok 2024-05-03T22:35:07.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:07 smithi160 ceph-mon[32531]: osd.5 [v2:172.21.15.160:6808/429142335,v1:172.21.15.160:6809/429142335] boot 2024-05-03T22:35:07.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:07 smithi160 ceph-mon[32531]: osdmap e36: 6 total, 6 up, 6 in 2024-05-03T22:35:07.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:07 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-03T22:35:07.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:07 smithi160 ceph-mon[32531]: osdmap e37: 6 total, 6 up, 6 in 2024-05-03T22:35:08.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:08 smithi160 ceph-mon[32531]: pgmap v176: 1 pgs: 1 peering; 577 KiB data, 578 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:08.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:08 smithi160 ceph-mon[32531]: osdmap e38: 6 total, 6 up, 6 in 2024-05-03T22:35:08.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:08 smithi044 ceph-mon[28604]: pgmap v176: 1 pgs: 1 peering; 577 KiB data, 578 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:08.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:08 smithi044 ceph-mon[28604]: osdmap e38: 6 total, 6 up, 6 in 2024-05-03T22:35:08.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:08 smithi060 ceph-mon[31721]: pgmap v176: 1 pgs: 1 peering; 577 KiB data, 578 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:08.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:08 smithi060 ceph-mon[31721]: osdmap e38: 6 total, 6 up, 6 in 2024-05-03T22:35:09.103 INFO:teuthology.orchestra.run.smithi044.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-03T22:35:09.103 INFO:teuthology.orchestra.run.smithi044.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-03T22:35:09.103 INFO:teuthology.orchestra.run.smithi044.stderr: stderr: 10+0 records in 2024-05-03T22:35:09.103 INFO:teuthology.orchestra.run.smithi044.stderr:10+0 records out 2024-05-03T22:35:09.103 INFO:teuthology.orchestra.run.smithi044.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.046357 s, 226 MB/s 2024-05-03T22:35:09.103 INFO:teuthology.orchestra.run.smithi044.stderr:--> Zapping successful for: 2024-05-03T22:35:09.971 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_2 2024-05-03T22:35:10.398 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:35:10.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:10 smithi044 ceph-mon[28604]: pgmap v178: 1 pgs: 1 peering; 577 KiB data, 578 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:10.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:10 smithi060 ceph-mon[31721]: pgmap v178: 1 pgs: 1 peering; 577 KiB data, 578 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:10.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:10 smithi160 ceph-mon[32531]: pgmap v178: 1 pgs: 1 peering; 577 KiB data, 578 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:12.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:11 smithi044 ceph-mon[28604]: Detected new or changed devices on smithi160 2024-05-03T22:35:12.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:11 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:12.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:11 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:12.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:11 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:35:12.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:11 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:35:12.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:11 smithi044 ceph-mon[28604]: Adjusting osd_memory_target on smithi160 to 8544M 2024-05-03T22:35:12.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:11 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:12.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:11 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:12.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:11 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:35:12.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:11 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:12.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:11 smithi044 ceph-mon[28604]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 578 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-03T22:35:12.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:11 smithi160 ceph-mon[32531]: Detected new or changed devices on smithi160 2024-05-03T22:35:12.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:11 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:12.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:11 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:12.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:11 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:35:12.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:11 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:35:12.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:11 smithi160 ceph-mon[32531]: Adjusting osd_memory_target on smithi160 to 8544M 2024-05-03T22:35:12.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:11 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:12.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:11 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:12.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:11 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:35:12.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:11 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:12.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:11 smithi160 ceph-mon[32531]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 578 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-03T22:35:12.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:11 smithi060 ceph-mon[31721]: Detected new or changed devices on smithi160 2024-05-03T22:35:12.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:11 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:12.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:11 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:12.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:11 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:35:12.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:11 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:35:12.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:11 smithi060 ceph-mon[31721]: Adjusting osd_memory_target on smithi160 to 8544M 2024-05-03T22:35:12.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:11 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:12.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:11 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:12.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:11 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:35:12.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:11 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:12.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:11 smithi060 ceph-mon[31721]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 578 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-03T22:35:12.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.570+0000 7feb94000700 1 -- 172.21.15.44:0/846421341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb8c103510 msgr2=0x7feb8c103930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:35:12.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.570+0000 7feb94000700 1 --2- 172.21.15.44:0/846421341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb8c103510 0x7feb8c103930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7feb800099c0 tx=0x7feb80009cd0 comp rx=0 tx=0).stop 2024-05-03T22:35:12.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.570+0000 7feb94000700 1 -- 172.21.15.44:0/846421341 shutdown_connections 2024-05-03T22:35:12.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.570+0000 7feb94000700 1 --2- 172.21.15.44:0/846421341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb8c1050b0 0x7feb8c10b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:35:12.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.570+0000 7feb94000700 1 --2- 172.21.15.44:0/846421341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb8c103510 0x7feb8c103930 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:35:12.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.570+0000 7feb94000700 1 --2- 172.21.15.44:0/846421341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c104710 0x7feb8c104b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:35:12.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.570+0000 7feb94000700 1 -- 172.21.15.44:0/846421341 >> 172.21.15.44:0/846421341 conn(0x7feb8c0fea70 msgr2=0x7feb8c100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:35:12.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.570+0000 7feb94000700 1 -- 172.21.15.44:0/846421341 shutdown_connections 2024-05-03T22:35:12.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.570+0000 7feb94000700 1 -- 172.21.15.44:0/846421341 wait complete. 2024-05-03T22:35:12.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.571+0000 7feb94000700 1 Processor -- start 2024-05-03T22:35:12.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.572+0000 7feb94000700 1 -- start start 2024-05-03T22:35:12.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.572+0000 7feb94000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb8c103510 0x7feb8c19b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:35:12.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.572+0000 7feb94000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb8c104710 0x7feb8c19beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:35:12.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.572+0000 7feb94000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c1050b0 0x7feb8c1a2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:35:12.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.572+0000 7feb94000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c10f140 con 0x7feb8c103510 2024-05-03T22:35:12.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.572+0000 7feb94000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c10efc0 con 0x7feb8c1050b0 2024-05-03T22:35:12.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.572+0000 7feb94000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c10f2c0 con 0x7feb8c104710 2024-05-03T22:35:12.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.572+0000 7feb91600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb8c103510 0x7feb8c19b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:35:12.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.573+0000 7feb91600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb8c103510 0x7feb8c19b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59614/0 (socket says 172.21.15.44:59614) 2024-05-03T22:35:12.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.573+0000 7feb91600700 1 -- 172.21.15.44:0/1123142254 learned_addr learned my addr 172.21.15.44:0/1123142254 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:35:12.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.573+0000 7feb90c00700 1 --2- 172.21.15.44:0/1123142254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb8c104710 0x7feb8c19beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:35:12.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.573+0000 7feb92000700 1 --2- 172.21.15.44:0/1123142254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c1050b0 0x7feb8c1a2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:35:12.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.573+0000 7feb91600700 1 -- 172.21.15.44:0/1123142254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb8c104710 msgr2=0x7feb8c19beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:35:12.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.573+0000 7feb91600700 1 --2- 172.21.15.44:0/1123142254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb8c104710 0x7feb8c19beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:35:12.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.573+0000 7feb91600700 1 -- 172.21.15.44:0/1123142254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c1050b0 msgr2=0x7feb8c1a2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:35:12.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.573+0000 7feb91600700 1 --2- 172.21.15.44:0/1123142254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c1050b0 0x7feb8c1a2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:35:12.576 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.573+0000 7feb91600700 1 -- 172.21.15.44:0/1123142254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c1a35d0 con 0x7feb8c103510 2024-05-03T22:35:12.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.573+0000 7feb90c00700 1 --2- 172.21.15.44:0/1123142254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb8c104710 0x7feb8c19beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:35:12.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.573+0000 7feb91600700 1 --2- 172.21.15.44:0/1123142254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb8c103510 0x7feb8c19b970 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feb800057c0 tx=0x7feb80009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:35:12.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.574+0000 7feb8a000700 1 -- 172.21.15.44:0/1123142254 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80026070 con 0x7feb8c103510 2024-05-03T22:35:12.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.574+0000 7feb8a000700 1 -- 172.21.15.44:0/1123142254 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7feb800041e0 con 0x7feb8c103510 2024-05-03T22:35:12.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.574+0000 7feb94000700 1 -- 172.21.15.44:0/1123142254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8c1a3860 con 0x7feb8c103510 2024-05-03T22:35:12.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.574+0000 7feb8a000700 1 -- 172.21.15.44:0/1123142254 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80021410 con 0x7feb8c103510 2024-05-03T22:35:12.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.574+0000 7feb94000700 1 -- 172.21.15.44:0/1123142254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb8c1a3cb0 con 0x7feb8c103510 2024-05-03T22:35:12.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.576+0000 7feb94000700 1 -- 172.21.15.44:0/1123142254 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb8c06a1c0 con 0x7feb8c103510 2024-05-03T22:35:12.580 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.578+0000 7feb8a000700 1 -- 172.21.15.44:0/1123142254 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7feb80029070 con 0x7feb8c103510 2024-05-03T22:35:12.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.581+0000 7feb8a000700 1 --2- 172.21.15.44:0/1123142254 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7feb740b2880 0x7feb740b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:35:12.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.581+0000 7feb8a000700 1 -- 172.21.15.44:0/1123142254 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4533+0+0 (secure 0 0 0) 0x7feb800e1fe0 con 0x7feb8c103510 2024-05-03T22:35:12.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.581+0000 7feb90c00700 1 --2- 172.21.15.44:0/1123142254 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7feb740b2880 0x7feb740b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:35:12.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.582+0000 7feb90c00700 1 --2- 172.21.15.44:0/1123142254 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7feb740b2880 0x7feb740b4d40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feb78005950 tx=0x7feb780058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:35:12.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.586+0000 7feb8a000700 1 -- 172.21.15.44:0/1123142254 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7feb8c06a1c0 con 0x7feb8c103510 2024-05-03T22:35:12.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:12.839+0000 7feb94000700 1 -- 172.21.15.44:0/1123142254 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7feb8c076df0 con 0x7feb740b2880 2024-05-03T22:35:13.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:35:13.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:35:13.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:13.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:35:13.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:35:13.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:13.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:35:13.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:35:13.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:14.118 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:13 smithi044 ceph-mon[28604]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:35:14.118 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:13 smithi044 ceph-mon[28604]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-05-03T22:35:14.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:13 smithi060 ceph-mon[31721]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:35:14.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:13 smithi060 ceph-mon[31721]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-05-03T22:35:14.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:13 smithi160 ceph-mon[32531]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:35:14.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:13 smithi160 ceph-mon[32531]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 179 MiB used, 536 GiB / 536 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-05-03T22:35:16.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:15 smithi044 ceph-mon[28604]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-03T22:35:16.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:15 smithi060 ceph-mon[31721]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-03T22:35:16.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:15 smithi160 ceph-mon[32531]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-03T22:35:17.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:16 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2655287803' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f95a1d05-a958-4e5c-a90a-6b0c3d9fad43"}]: dispatch 2024-05-03T22:35:17.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:16 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2655287803' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f95a1d05-a958-4e5c-a90a-6b0c3d9fad43"}]': finished 2024-05-03T22:35:17.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:16 smithi044 ceph-mon[28604]: osdmap e39: 7 total, 6 up, 7 in 2024-05-03T22:35:17.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:16 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:35:17.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:16 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2655287803' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f95a1d05-a958-4e5c-a90a-6b0c3d9fad43"}]: dispatch 2024-05-03T22:35:17.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:16 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2655287803' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f95a1d05-a958-4e5c-a90a-6b0c3d9fad43"}]': finished 2024-05-03T22:35:17.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:16 smithi060 ceph-mon[31721]: osdmap e39: 7 total, 6 up, 7 in 2024-05-03T22:35:17.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:16 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:35:17.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:16 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2655287803' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f95a1d05-a958-4e5c-a90a-6b0c3d9fad43"}]: dispatch 2024-05-03T22:35:17.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:16 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2655287803' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f95a1d05-a958-4e5c-a90a-6b0c3d9fad43"}]': finished 2024-05-03T22:35:17.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:16 smithi160 ceph-mon[32531]: osdmap e39: 7 total, 6 up, 7 in 2024-05-03T22:35:17.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:16 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:35:18.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:17 smithi044 ceph-mon[28604]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:35:18.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:17 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2935346027' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:35:18.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:17 smithi060 ceph-mon[31721]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:35:18.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:17 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2935346027' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:35:18.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:17 smithi160 ceph-mon[32531]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:35:18.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:17 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2935346027' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:35:20.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:19 smithi044 ceph-mon[28604]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:35:20.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:19 smithi060 ceph-mon[31721]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:35:20.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:19 smithi160 ceph-mon[32531]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:35:22.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:21 smithi044 ceph-mon[28604]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:22.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:21 smithi060 ceph-mon[31721]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:22.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:21 smithi160 ceph-mon[32531]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:24.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:23 smithi044 ceph-mon[28604]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:24.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:23 smithi060 ceph-mon[31721]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:24.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:23 smithi160 ceph-mon[32531]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:26.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:25 smithi044 ceph-mon[28604]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:26.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:25 smithi060 ceph-mon[31721]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:26.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:25 smithi160 ceph-mon[32531]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:27.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:26 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-03T22:35:27.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:26 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:27.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:26 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-03T22:35:27.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:26 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:27.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:26 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-03T22:35:27.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:26 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:28.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:27 smithi044 ceph-mon[28604]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:28.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:27 smithi044 ceph-mon[28604]: Deploying daemon osd.6 on smithi044 2024-05-03T22:35:28.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:27 smithi060 ceph-mon[31721]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:28.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:27 smithi060 ceph-mon[31721]: Deploying daemon osd.6 on smithi044 2024-05-03T22:35:28.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:27 smithi160 ceph-mon[32531]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:28.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:27 smithi160 ceph-mon[32531]: Deploying daemon osd.6 on smithi044 2024-05-03T22:35:30.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:29 smithi044 ceph-mon[28604]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:30.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:29 smithi060 ceph-mon[31721]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:30.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:29 smithi160 ceph-mon[32531]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:32.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:31 smithi044 ceph-mon[28604]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:32.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:31 smithi060 ceph-mon[31721]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:32.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:31 smithi160 ceph-mon[32531]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:34.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:33 smithi044 ceph-mon[28604]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:34.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:33 smithi060 ceph-mon[31721]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:34.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:33 smithi160 ceph-mon[32531]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:36.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:35 smithi044 ceph-mon[28604]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:36.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:35 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:36.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:35 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:36.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:35 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:35:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:35 smithi060 ceph-mon[31721]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:35 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:35 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:35 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:35:36.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:35 smithi160 ceph-mon[32531]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:36.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:35 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:36.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:35 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:36.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:35 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:35:38.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:37 smithi044 ceph-mon[28604]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:38.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:38 smithi060 ceph-mon[31721]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:38.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:38 smithi160 ceph-mon[32531]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:40.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:40 smithi044 ceph-mon[28604]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:40.253 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:40 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:40.253 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:40 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:40.253 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:40 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:40.253 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:40 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:35:40.253 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:40 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:40.253 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:40 smithi044 ceph-mon[28604]: from='osd.6 [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-03T22:35:40.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:40 smithi160 ceph-mon[32531]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:40.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:40 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:40.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:40 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:40.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:40 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:40.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:40 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:35:40.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:40 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:40.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:40 smithi160 ceph-mon[32531]: from='osd.6 [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-03T22:35:40.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:40 smithi060 ceph-mon[31721]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:40.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:40 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:40.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:40 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:40.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:40 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:40.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:40 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:35:40.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:40 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:40.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:40 smithi060 ceph-mon[31721]: from='osd.6 [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-03T22:35:41.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:41.053+0000 7feb8a000700 1 -- 172.21.15.44:0/1123142254 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7feb8c076df0 con 0x7feb740b2880 2024-05-03T22:35:41.056 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 6 on host 'smithi044' 2024-05-03T22:35:41.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:41.057+0000 7feb94000700 1 -- 172.21.15.44:0/1123142254 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7feb740b2880 msgr2=0x7feb740b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:35:41.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:41.057+0000 7feb94000700 1 --2- 172.21.15.44:0/1123142254 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7feb740b2880 0x7feb740b4d40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7feb78005950 tx=0x7feb780058e0 comp rx=0 tx=0).stop 2024-05-03T22:35:41.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:41.057+0000 7feb94000700 1 -- 172.21.15.44:0/1123142254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb8c103510 msgr2=0x7feb8c19b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:35:41.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:41.057+0000 7feb94000700 1 --2- 172.21.15.44:0/1123142254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb8c103510 0x7feb8c19b970 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feb800057c0 tx=0x7feb80009580 comp rx=0 tx=0).stop 2024-05-03T22:35:41.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:41.058+0000 7feb94000700 1 -- 172.21.15.44:0/1123142254 shutdown_connections 2024-05-03T22:35:41.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:41.058+0000 7feb94000700 1 --2- 172.21.15.44:0/1123142254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb8c1050b0 0x7feb8c1a2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:35:41.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:41.058+0000 7feb94000700 1 --2- 172.21.15.44:0/1123142254 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7feb8c103510 0x7feb8c19b970 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:35:41.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:41.058+0000 7feb94000700 1 --2- 172.21.15.44:0/1123142254 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7feb740b2880 0x7feb740b4d40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:35:41.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:41.058+0000 7feb94000700 1 --2- 172.21.15.44:0/1123142254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb8c104710 0x7feb8c19beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:35:41.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:41.058+0000 7feb94000700 1 -- 172.21.15.44:0/1123142254 >> 172.21.15.44:0/1123142254 conn(0x7feb8c0fea70 msgr2=0x7feb8c0756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:35:41.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:41.058+0000 7feb94000700 1 -- 172.21.15.44:0/1123142254 shutdown_connections 2024-05-03T22:35:41.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:35:41.058+0000 7feb94000700 1 -- 172.21.15.44:0/1123142254 wait complete. 2024-05-03T22:35:41.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:41 smithi044 ceph-mon[28604]: from='osd.6 [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-03T22:35:41.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:41 smithi044 ceph-mon[28604]: osdmap e40: 7 total, 6 up, 7 in 2024-05-03T22:35:41.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:41 smithi044 ceph-mon[28604]: from='osd.6 [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-05-03T22:35:41.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:35:41.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:41 smithi044 ceph-mon[28604]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:41.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:41.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:41.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:35:41.893 DEBUG:teuthology.orchestra.run.smithi044:osd.6> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.6.service 2024-05-03T22:35:41.898 INFO:tasks.cephadm:Deploying osd.7 on smithi060 with /dev/vg_nvme/lv_2... 2024-05-03T22:35:41.898 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-03T22:35:41.985 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:41 smithi060 ceph-mon[31721]: from='osd.6 [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-03T22:35:41.985 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:41 smithi060 ceph-mon[31721]: osdmap e40: 7 total, 6 up, 7 in 2024-05-03T22:35:41.985 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:41 smithi060 ceph-mon[31721]: from='osd.6 [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-05-03T22:35:41.985 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:35:41.985 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:41 smithi060 ceph-mon[31721]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:41.986 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:41.986 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:41.986 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:35:42.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:41 smithi160 ceph-mon[32531]: from='osd.6 [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-03T22:35:42.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:41 smithi160 ceph-mon[32531]: osdmap e40: 7 total, 6 up, 7 in 2024-05-03T22:35:42.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:41 smithi160 ceph-mon[32531]: from='osd.6 [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-05-03T22:35:42.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:35:42.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:41 smithi160 ceph-mon[32531]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:42.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:42.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:42.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:35:42.371 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T22:35:42.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:42 smithi044 ceph-mon[28604]: from='osd.6 [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-05-03T22:35:42.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:42 smithi044 ceph-mon[28604]: osdmap e41: 7 total, 6 up, 7 in 2024-05-03T22:35:42.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:42 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:35:42.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:42 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:35:42.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:42 smithi044 ceph-mon[28604]: from='osd.6 [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764]' entity='osd.6' 2024-05-03T22:35:42.752 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 22:35:42 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T22:35:42.463+0000 7f749bc00700 -1 osd.6 0 waiting for initial osdmap 2024-05-03T22:35:42.753 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 22:35:42 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T22:35:42.493+0000 7f7491a00700 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T22:35:42.906 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:42 smithi060 ceph-mon[31721]: from='osd.6 [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-05-03T22:35:42.906 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:42 smithi060 ceph-mon[31721]: osdmap e41: 7 total, 6 up, 7 in 2024-05-03T22:35:42.906 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:42 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:35:42.906 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:42 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:35:42.906 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:42 smithi060 ceph-mon[31721]: from='osd.6 [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764]' entity='osd.6' 2024-05-03T22:35:43.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:42 smithi160 ceph-mon[32531]: from='osd.6 [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-05-03T22:35:43.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:42 smithi160 ceph-mon[32531]: osdmap e41: 7 total, 6 up, 7 in 2024-05-03T22:35:43.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:42 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:35:43.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:42 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:35:43.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:42 smithi160 ceph-mon[32531]: from='osd.6 [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764]' entity='osd.6' 2024-05-03T22:35:43.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:43 smithi060 ceph-mon[31721]: purged_snaps scrub starts 2024-05-03T22:35:43.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:43 smithi060 ceph-mon[31721]: purged_snaps scrub ok 2024-05-03T22:35:43.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:43 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:35:43.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:43 smithi060 ceph-mon[31721]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:43.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:43 smithi060 ceph-mon[31721]: osd.6 [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764] boot 2024-05-03T22:35:43.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:43 smithi060 ceph-mon[31721]: osdmap e42: 7 total, 7 up, 7 in 2024-05-03T22:35:43.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:43 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:35:44.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:43 smithi044 ceph-mon[28604]: purged_snaps scrub starts 2024-05-03T22:35:44.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:43 smithi044 ceph-mon[28604]: purged_snaps scrub ok 2024-05-03T22:35:44.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:43 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:35:44.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:43 smithi044 ceph-mon[28604]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:44.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:43 smithi044 ceph-mon[28604]: osd.6 [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764] boot 2024-05-03T22:35:44.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:43 smithi044 ceph-mon[28604]: osdmap e42: 7 total, 7 up, 7 in 2024-05-03T22:35:44.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:43 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:35:44.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:43 smithi160 ceph-mon[32531]: purged_snaps scrub starts 2024-05-03T22:35:44.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:43 smithi160 ceph-mon[32531]: purged_snaps scrub ok 2024-05-03T22:35:44.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:43 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:35:44.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:43 smithi160 ceph-mon[32531]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-05-03T22:35:44.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:43 smithi160 ceph-mon[32531]: osd.6 [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764] boot 2024-05-03T22:35:44.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:43 smithi160 ceph-mon[32531]: osdmap e42: 7 total, 7 up, 7 in 2024-05-03T22:35:44.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:43 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-03T22:35:45.328 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-03T22:35:45.328 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-03T22:35:45.329 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2024-05-03T22:35:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2024-05-03T22:35:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0337053 s, 311 MB/s 2024-05-03T22:35:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2024-05-03T22:35:45.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:45 smithi044 ceph-mon[28604]: osdmap e43: 7 total, 7 up, 7 in 2024-05-03T22:35:45.991 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:45 smithi044 ceph-mon[28604]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:46.004 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:45 smithi060 ceph-mon[31721]: osdmap e43: 7 total, 7 up, 7 in 2024-05-03T22:35:46.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:45 smithi060 ceph-mon[31721]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:46.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:45 smithi160 ceph-mon[32531]: osdmap e43: 7 total, 7 up, 7 in 2024-05-03T22:35:46.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:45 smithi160 ceph-mon[32531]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:46.380 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi060:vg_nvme/lv_2 2024-05-03T22:35:46.831 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T22:35:48.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:47 smithi044 ceph-mon[28604]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:48.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:47 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:48.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:47 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:48.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:47 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:35:48.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:47 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:35:48.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:47 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:35:48.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:47 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:48.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:47 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:48.253 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:47 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:35:48.253 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:47 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:48.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:47 smithi060 ceph-mon[31721]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:48.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:47 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:48.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:47 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:48.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:47 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:35:48.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:47 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:35:48.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:47 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:35:48.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:47 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:48.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:47 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:48.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:47 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:35:48.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:47 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:48.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:47 smithi160 ceph-mon[32531]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:48.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:47 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:48.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:47 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:48.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:47 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:35:48.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:47 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:35:48.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:47 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:35:48.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:47 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:48.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:47 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:48.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:47 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:35:48.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:47 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:35:49.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.152+0000 7fb7f0000700 1 -- 172.21.15.60:0/1338739997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e8109250 msgr2=0x7fb7e810b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:35:49.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.152+0000 7fb7f0000700 1 --2- 172.21.15.60:0/1338739997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e8109250 0x7fb7e810b660 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000b0a0 tx=0x7fb7e000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:35:49.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.152+0000 7fb7f0000700 1 -- 172.21.15.60:0/1338739997 shutdown_connections 2024-05-03T22:35:49.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.152+0000 7fb7f0000700 1 --2- 172.21.15.60:0/1338739997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e8109250 0x7fb7e810b660 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:35:49.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.152+0000 7fb7f0000700 1 --2- 172.21.15.60:0/1338739997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7e8103ff0 0x7fb7e81063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:35:49.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.152+0000 7fb7f0000700 1 --2- 172.21.15.60:0/1338739997 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7e8106920 0x7fb7e8108d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:35:49.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.152+0000 7fb7f0000700 1 -- 172.21.15.60:0/1338739997 >> 172.21.15.60:0/1338739997 conn(0x7fb7e80fd9a0 msgr2=0x7fb7e80ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:35:49.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.152+0000 7fb7f0000700 1 -- 172.21.15.60:0/1338739997 shutdown_connections 2024-05-03T22:35:49.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.152+0000 7fb7f0000700 1 -- 172.21.15.60:0/1338739997 wait complete. 2024-05-03T22:35:49.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.154+0000 7fb7f0000700 1 Processor -- start 2024-05-03T22:35:49.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.154+0000 7fb7f0000700 1 -- start start 2024-05-03T22:35:49.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.154+0000 7fb7f0000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7e8103ff0 0x7fb7e81996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:35:49.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.154+0000 7fb7f0000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7e8106920 0x7fb7e8199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:35:49.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.154+0000 7fb7f0000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e8109250 0x7fb7e81a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:35:49.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.154+0000 7fb7f0000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e810f0f0 con 0x7fb7e8103ff0 2024-05-03T22:35:49.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.154+0000 7fb7f0000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e810ef70 con 0x7fb7e8109250 2024-05-03T22:35:49.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.154+0000 7fb7f0000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e810f270 con 0x7fb7e8106920 2024-05-03T22:35:49.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.155+0000 7fb7ee000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e8109250 0x7fb7e81a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:35:49.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.155+0000 7fb7ee000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e8109250 0x7fb7e81a0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51308/0 (socket says 172.21.15.60:51308) 2024-05-03T22:35:49.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.155+0000 7fb7ee000700 1 -- 172.21.15.60:0/456360891 learned_addr learned my addr 172.21.15.60:0/456360891 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-05-03T22:35:49.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.155+0000 7fb7ed600700 1 --2- 172.21.15.60:0/456360891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7e8103ff0 0x7fb7e81996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:35:49.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.155+0000 7fb7ecc00700 1 --2- 172.21.15.60:0/456360891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7e8106920 0x7fb7e8199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:35:49.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.155+0000 7fb7ee000700 1 -- 172.21.15.60:0/456360891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7e8106920 msgr2=0x7fb7e8199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:35:49.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.155+0000 7fb7ee000700 1 --2- 172.21.15.60:0/456360891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7e8106920 0x7fb7e8199c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:35:49.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.155+0000 7fb7ee000700 1 -- 172.21.15.60:0/456360891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7e8103ff0 msgr2=0x7fb7e81996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:35:49.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.155+0000 7fb7ee000700 1 --2- 172.21.15.60:0/456360891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7e8103ff0 0x7fb7e81996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:35:49.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.155+0000 7fb7ee000700 1 -- 172.21.15.60:0/456360891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e81a1320 con 0x7fb7e8109250 2024-05-03T22:35:49.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.155+0000 7fb7ecc00700 1 --2- 172.21.15.60:0/456360891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7e8106920 0x7fb7e8199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:35:49.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.155+0000 7fb7ee000700 1 --2- 172.21.15.60:0/456360891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e8109250 0x7fb7e81a0c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000b070 tx=0x7fb7e0007dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:35:49.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.156+0000 7fb7e6000700 1 -- 172.21.15.60:0/456360891 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0003e10 con 0x7fb7e8109250 2024-05-03T22:35:49.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.156+0000 7fb7e6000700 1 -- 172.21.15.60:0/456360891 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fb7e001d940 con 0x7fb7e8109250 2024-05-03T22:35:49.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.156+0000 7fb7e6000700 1 -- 172.21.15.60:0/456360891 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e00056c0 con 0x7fb7e8109250 2024-05-03T22:35:49.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.156+0000 7fb7f0000700 1 -- 172.21.15.60:0/456360891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e81a15b0 con 0x7fb7e8109250 2024-05-03T22:35:49.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.156+0000 7fb7f0000700 1 -- 172.21.15.60:0/456360891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e81a19b0 con 0x7fb7e8109250 2024-05-03T22:35:49.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.157+0000 7fb7f0000700 1 -- 172.21.15.60:0/456360891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e806a190 con 0x7fb7e8109250 2024-05-03T22:35:49.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.160+0000 7fb7e6000700 1 -- 172.21.15.60:0/456360891 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fb7e0005860 con 0x7fb7e8109250 2024-05-03T22:35:49.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.162+0000 7fb7e6000700 1 --2- 172.21.15.60:0/456360891 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb7d00b2880 0x7fb7d00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:35:49.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.162+0000 7fb7e6000700 1 -- 172.21.15.60:0/456360891 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4965+0+0 (secure 0 0 0) 0x7fb7e00e29d0 con 0x7fb7e8109250 2024-05-03T22:35:49.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.162+0000 7fb7ed600700 1 --2- 172.21.15.60:0/456360891 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb7d00b2880 0x7fb7d00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:35:49.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.163+0000 7fb7ed600700 1 --2- 172.21.15.60:0/456360891 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb7d00b2880 0x7fb7d00b4d40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc005ea0 tx=0x7fb7dc005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:35:49.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.165+0000 7fb7e6000700 1 -- 172.21.15.60:0/456360891 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb7e00ab3f0 con 0x7fb7e8109250 2024-05-03T22:35:49.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:48 smithi044 ceph-mon[28604]: Detected new or changed devices on smithi044 2024-05-03T22:35:49.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:48 smithi044 ceph-mon[28604]: Adjusting osd_memory_target on smithi044 to 5698M 2024-05-03T22:35:49.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:48 smithi060 ceph-mon[31721]: Detected new or changed devices on smithi044 2024-05-03T22:35:49.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:48 smithi060 ceph-mon[31721]: Adjusting osd_memory_target on smithi044 to 5698M 2024-05-03T22:35:49.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:48 smithi160 ceph-mon[32531]: Detected new or changed devices on smithi044 2024-05-03T22:35:49.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:48 smithi160 ceph-mon[32531]: Adjusting osd_memory_target on smithi044 to 5698M 2024-05-03T22:35:49.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:35:49.411+0000 7fb7f0000700 1 -- 172.21.15.60:0/456360891 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fb7e80639a0 con 0x7fb7d00b2880 2024-05-03T22:35:50.201 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:49 smithi160 ceph-mon[32531]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:50.202 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:49 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:35:50.202 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:49 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:35:50.202 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:49 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:50.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:49 smithi044 ceph-mon[28604]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:50.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:49 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:35:50.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:49 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:35:50.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:49 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:50.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:49 smithi060 ceph-mon[31721]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:50.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:49 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:35:50.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:49 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:35:50.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:49 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:35:51.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:50 smithi060 ceph-mon[31721]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:35:51.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:50 smithi044 ceph-mon[28604]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:35:51.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:50 smithi160 ceph-mon[32531]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:35:52.197 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:51 smithi060 ceph-mon[31721]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:52.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:51 smithi044 ceph-mon[28604]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:52.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:51 smithi160 ceph-mon[32531]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:54.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:53 smithi044 ceph-mon[28604]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:54.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:53 smithi044 ceph-mon[28604]: from='client.? 172.21.15.60:0/1175262233' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a515e4be-c607-4f4a-96bb-c3d395d7ecfe"}]: dispatch 2024-05-03T22:35:54.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:53 smithi044 ceph-mon[28604]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a515e4be-c607-4f4a-96bb-c3d395d7ecfe"}]: dispatch 2024-05-03T22:35:54.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:53 smithi044 ceph-mon[28604]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a515e4be-c607-4f4a-96bb-c3d395d7ecfe"}]': finished 2024-05-03T22:35:54.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:53 smithi044 ceph-mon[28604]: osdmap e44: 8 total, 7 up, 8 in 2024-05-03T22:35:54.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:35:54.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:53 smithi060 ceph-mon[31721]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:54.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:53 smithi060 ceph-mon[31721]: from='client.? 172.21.15.60:0/1175262233' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a515e4be-c607-4f4a-96bb-c3d395d7ecfe"}]: dispatch 2024-05-03T22:35:54.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:53 smithi060 ceph-mon[31721]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a515e4be-c607-4f4a-96bb-c3d395d7ecfe"}]: dispatch 2024-05-03T22:35:54.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:53 smithi060 ceph-mon[31721]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a515e4be-c607-4f4a-96bb-c3d395d7ecfe"}]': finished 2024-05-03T22:35:54.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:53 smithi060 ceph-mon[31721]: osdmap e44: 8 total, 7 up, 8 in 2024-05-03T22:35:54.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:53 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:35:54.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:53 smithi160 ceph-mon[32531]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:54.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:53 smithi160 ceph-mon[32531]: from='client.? 172.21.15.60:0/1175262233' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a515e4be-c607-4f4a-96bb-c3d395d7ecfe"}]: dispatch 2024-05-03T22:35:54.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:53 smithi160 ceph-mon[32531]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a515e4be-c607-4f4a-96bb-c3d395d7ecfe"}]: dispatch 2024-05-03T22:35:54.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:53 smithi160 ceph-mon[32531]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a515e4be-c607-4f4a-96bb-c3d395d7ecfe"}]': finished 2024-05-03T22:35:54.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:53 smithi160 ceph-mon[32531]: osdmap e44: 8 total, 7 up, 8 in 2024-05-03T22:35:54.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:53 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:35:55.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:54 smithi044 ceph-mon[28604]: from='client.? 172.21.15.60:0/327048443' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:35:55.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:54 smithi060 ceph-mon[31721]: from='client.? 172.21.15.60:0/327048443' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:35:55.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:54 smithi160 ceph-mon[32531]: from='client.? 172.21.15.60:0/327048443' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:35:56.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:55 smithi044 ceph-mon[28604]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:56.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:55 smithi060 ceph-mon[31721]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:56.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:55 smithi160 ceph-mon[32531]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:58.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:57 smithi044 ceph-mon[28604]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:58.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:57 smithi060 ceph-mon[31721]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:35:58.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:57 smithi160 ceph-mon[32531]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:00.225 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:35:59 smithi060 ceph-mon[31721]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:00.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:35:59 smithi044 ceph-mon[28604]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:00.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:35:59 smithi160 ceph-mon[32531]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:02.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:01 smithi044 ceph-mon[28604]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:02.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:01 smithi060 ceph-mon[31721]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:02.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:01 smithi160 ceph-mon[32531]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:04.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:04 smithi060 ceph-mon[31721]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:04.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:04 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-03T22:36:04.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:04 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:04.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:04 smithi060 ceph-mon[31721]: Deploying daemon osd.7 on smithi060 2024-05-03T22:36:04.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:04 smithi160 ceph-mon[32531]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:04.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:04 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-03T22:36:04.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:04 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:04.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:04 smithi160 ceph-mon[32531]: Deploying daemon osd.7 on smithi060 2024-05-03T22:36:04.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:04 smithi044 ceph-mon[28604]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:04.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:04 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-03T22:36:04.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:04 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:04.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:04 smithi044 ceph-mon[28604]: Deploying daemon osd.7 on smithi060 2024-05-03T22:36:06.154 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:06 smithi060 ceph-mon[31721]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:06.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:06 smithi160 ceph-mon[32531]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:06.304 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:06 smithi044 ceph-mon[28604]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:08.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:08 smithi160 ceph-mon[32531]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:08.418 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:08 smithi060 ceph-mon[31721]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:08.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:08 smithi044 ceph-mon[28604]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:10.407 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:10 smithi060 ceph-mon[31721]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:10.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:10 smithi044 ceph-mon[28604]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:10.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:10 smithi160 ceph-mon[32531]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:12.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:12 smithi044 ceph-mon[28604]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:12.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:12.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:12.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:36:12.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:12 smithi060 ceph-mon[31721]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:12.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:12.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:12.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:36:12.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:12 smithi160 ceph-mon[32531]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:12.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:12.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:12.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:36:14.218 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:14 smithi060 ceph-mon[31721]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:14.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:14 smithi044 ceph-mon[28604]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:14.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:14 smithi160 ceph-mon[32531]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:16.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:16 smithi060 ceph-mon[31721]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:16.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:16 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:16.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:16 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:16.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:16 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:16.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:16 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:36:16.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:16 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:16.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:16 smithi060 ceph-mon[31721]: from='osd.7 [v2:172.21.15.60:6816/693512829,v1:172.21.15.60:6817/693512829]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-03T22:36:16.041 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:16 smithi060 ceph-mon[31721]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-03T22:36:16.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:16 smithi044 ceph-mon[28604]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:16.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:16 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:16.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:16 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:16.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:16 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:16.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:16 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:36:16.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:16 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:16.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:16 smithi044 ceph-mon[28604]: from='osd.7 [v2:172.21.15.60:6816/693512829,v1:172.21.15.60:6817/693512829]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-03T22:36:16.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:16 smithi044 ceph-mon[28604]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-03T22:36:16.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:16 smithi160 ceph-mon[32531]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:16.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:16 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:16.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:16 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:16.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:16 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:16.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:16 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:36:16.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:16 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:16.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:16 smithi160 ceph-mon[32531]: from='osd.7 [v2:172.21.15.60:6816/693512829,v1:172.21.15.60:6817/693512829]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-03T22:36:16.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:16 smithi160 ceph-mon[32531]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-03T22:36:16.628 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 7 on host 'smithi060' 2024-05-03T22:36:16.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:36:16.625+0000 7fb7e6000700 1 -- 172.21.15.60:0/456360891 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb7e80639a0 con 0x7fb7d00b2880 2024-05-03T22:36:16.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:36:16.629+0000 7fb7f0000700 1 -- 172.21.15.60:0/456360891 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb7d00b2880 msgr2=0x7fb7d00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:36:16.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:36:16.629+0000 7fb7f0000700 1 --2- 172.21.15.60:0/456360891 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb7d00b2880 0x7fb7d00b4d40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc005ea0 tx=0x7fb7dc005e30 comp rx=0 tx=0).stop 2024-05-03T22:36:16.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:36:16.629+0000 7fb7f0000700 1 -- 172.21.15.60:0/456360891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e8109250 msgr2=0x7fb7e81a0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:36:16.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:36:16.629+0000 7fb7f0000700 1 --2- 172.21.15.60:0/456360891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e8109250 0x7fb7e81a0c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000b070 tx=0x7fb7e0007dc0 comp rx=0 tx=0).stop 2024-05-03T22:36:16.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:36:16.629+0000 7fb7f0000700 1 -- 172.21.15.60:0/456360891 shutdown_connections 2024-05-03T22:36:16.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:36:16.629+0000 7fb7f0000700 1 --2- 172.21.15.60:0/456360891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e8109250 0x7fb7e81a0c80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:36:16.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:36:16.629+0000 7fb7f0000700 1 --2- 172.21.15.60:0/456360891 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb7e8103ff0 0x7fb7e81996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:36:16.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:36:16.629+0000 7fb7f0000700 1 --2- 172.21.15.60:0/456360891 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb7d00b2880 0x7fb7d00b4d40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:36:16.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:36:16.629+0000 7fb7f0000700 1 --2- 172.21.15.60:0/456360891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7e8106920 0x7fb7e8199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:36:16.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:36:16.629+0000 7fb7f0000700 1 -- 172.21.15.60:0/456360891 >> 172.21.15.60:0/456360891 conn(0x7fb7e80fd9a0 msgr2=0x7fb7e81048b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:36:16.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:36:16.629+0000 7fb7f0000700 1 -- 172.21.15.60:0/456360891 shutdown_connections 2024-05-03T22:36:16.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:36:16.630+0000 7fb7f0000700 1 -- 172.21.15.60:0/456360891 wait complete. 2024-05-03T22:36:17.431 DEBUG:teuthology.orchestra.run.smithi060:osd.7> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.7.service 2024-05-03T22:36:17.437 INFO:tasks.cephadm:Deploying osd.8 on smithi160 with /dev/vg_nvme/lv_2... 2024-05-03T22:36:17.437 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-03T22:36:17.680 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:17 smithi060 ceph-mon[31721]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-03T22:36:17.680 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:17 smithi060 ceph-mon[31721]: osdmap e45: 8 total, 7 up, 8 in 2024-05-03T22:36:17.680 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:17 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:36:17.680 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:17 smithi060 ceph-mon[31721]: from='osd.7 [v2:172.21.15.60:6816/693512829,v1:172.21.15.60:6817/693512829]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:36:17.680 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:17 smithi060 ceph-mon[31721]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:36:17.680 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:17 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:17.681 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:17 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:17.681 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:17 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:36:17.681 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:17 smithi060 ceph-mon[31721]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:17.681 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 22:36:17 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T22:36:17.570+0000 7fdee4400700 -1 osd.7 0 waiting for initial osdmap 2024-05-03T22:36:17.681 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 22:36:17 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T22:36:17.592+0000 7fdedf200700 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T22:36:17.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:17 smithi160 ceph-mon[32531]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-03T22:36:17.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:17 smithi160 ceph-mon[32531]: osdmap e45: 8 total, 7 up, 8 in 2024-05-03T22:36:17.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:17 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:36:17.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:17 smithi160 ceph-mon[32531]: from='osd.7 [v2:172.21.15.60:6816/693512829,v1:172.21.15.60:6817/693512829]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:36:17.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:17 smithi160 ceph-mon[32531]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:36:17.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:17 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:17.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:17 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:17.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:17 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:36:17.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:17 smithi160 ceph-mon[32531]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:17.873 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:36:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:17 smithi044 ceph-mon[28604]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-03T22:36:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:17 smithi044 ceph-mon[28604]: osdmap e45: 8 total, 7 up, 8 in 2024-05-03T22:36:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:17 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:36:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:17 smithi044 ceph-mon[28604]: from='osd.7 [v2:172.21.15.60:6816/693512829,v1:172.21.15.60:6817/693512829]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:36:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:17 smithi044 ceph-mon[28604]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:36:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:17 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:17 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:17 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:36:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:17 smithi044 ceph-mon[28604]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:18.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:18 smithi044 ceph-mon[28604]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-03T22:36:18.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:18 smithi044 ceph-mon[28604]: osdmap e46: 8 total, 7 up, 8 in 2024-05-03T22:36:18.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:18 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:36:18.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:18 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:36:18.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:18 smithi160 ceph-mon[32531]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-03T22:36:18.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:18 smithi160 ceph-mon[32531]: osdmap e46: 8 total, 7 up, 8 in 2024-05-03T22:36:18.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:18 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:36:18.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:18 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:36:18.866 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:18 smithi060 ceph-mon[31721]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-03T22:36:18.867 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:18 smithi060 ceph-mon[31721]: osdmap e46: 8 total, 7 up, 8 in 2024-05-03T22:36:18.867 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:18 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:36:18.867 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:18 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:36:19.853 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:19 smithi160 ceph-mon[32531]: purged_snaps scrub starts 2024-05-03T22:36:19.853 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:19 smithi160 ceph-mon[32531]: purged_snaps scrub ok 2024-05-03T22:36:19.853 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:19 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:36:19.854 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:19 smithi160 ceph-mon[32531]: osd.7 [v2:172.21.15.60:6816/693512829,v1:172.21.15.60:6817/693512829] boot 2024-05-03T22:36:19.854 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:19 smithi160 ceph-mon[32531]: osdmap e47: 8 total, 8 up, 8 in 2024-05-03T22:36:19.854 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:19 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:36:19.854 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:19 smithi160 ceph-mon[32531]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:20.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:19 smithi044 ceph-mon[28604]: purged_snaps scrub starts 2024-05-03T22:36:20.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:19 smithi044 ceph-mon[28604]: purged_snaps scrub ok 2024-05-03T22:36:20.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:19 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:36:20.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:19 smithi044 ceph-mon[28604]: osd.7 [v2:172.21.15.60:6816/693512829,v1:172.21.15.60:6817/693512829] boot 2024-05-03T22:36:20.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:19 smithi044 ceph-mon[28604]: osdmap e47: 8 total, 8 up, 8 in 2024-05-03T22:36:20.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:19 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:36:20.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:19 smithi044 ceph-mon[28604]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:20.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:19 smithi060 ceph-mon[31721]: purged_snaps scrub starts 2024-05-03T22:36:20.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:19 smithi060 ceph-mon[31721]: purged_snaps scrub ok 2024-05-03T22:36:20.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:19 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:36:20.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:19 smithi060 ceph-mon[31721]: osd.7 [v2:172.21.15.60:6816/693512829,v1:172.21.15.60:6817/693512829] boot 2024-05-03T22:36:20.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:19 smithi060 ceph-mon[31721]: osdmap e47: 8 total, 8 up, 8 in 2024-05-03T22:36:20.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:19 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-03T22:36:20.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:19 smithi060 ceph-mon[31721]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-05-03T22:36:20.947 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-03T22:36:20.948 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-03T22:36:20.948 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2024-05-03T22:36:20.948 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2024-05-03T22:36:20.948 INFO:teuthology.orchestra.run.smithi160.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0355935 s, 295 MB/s 2024-05-03T22:36:20.948 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2024-05-03T22:36:20.948 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:20 smithi160 ceph-mon[32531]: osdmap e48: 8 total, 8 up, 8 in 2024-05-03T22:36:21.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:20 smithi044 ceph-mon[28604]: osdmap e48: 8 total, 8 up, 8 in 2024-05-03T22:36:21.004 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:20 smithi060 ceph-mon[31721]: osdmap e48: 8 total, 8 up, 8 in 2024-05-03T22:36:21.866 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi160:vg_nvme/lv_2 2024-05-03T22:36:21.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:21 smithi160 ceph-mon[32531]: osdmap e49: 8 total, 8 up, 8 in 2024-05-03T22:36:21.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:21 smithi160 ceph-mon[32531]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:22.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:21 smithi044 ceph-mon[28604]: osdmap e49: 8 total, 8 up, 8 in 2024-05-03T22:36:22.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:21 smithi044 ceph-mon[28604]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:22.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:21 smithi060 ceph-mon[31721]: osdmap e49: 8 total, 8 up, 8 in 2024-05-03T22:36:22.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:21 smithi060 ceph-mon[31721]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:22.302 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:36:23.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:23 smithi160 ceph-mon[32531]: Detected new or changed devices on smithi060 2024-05-03T22:36:23.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:23 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:23.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:23 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:23.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:23 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:36:23.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:23 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:36:23.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:23 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:36:23.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:23 smithi160 ceph-mon[32531]: Adjusting osd_memory_target on smithi060 to 5698M 2024-05-03T22:36:23.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:23 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:23.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:23 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:23.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:23 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:36:23.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:23 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:23.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:23 smithi160 ceph-mon[32531]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:24.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:23 smithi044 ceph-mon[28604]: Detected new or changed devices on smithi060 2024-05-03T22:36:24.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:23 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:24.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:23 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:24.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:23 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:36:24.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:23 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:36:24.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:23 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:36:24.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:23 smithi044 ceph-mon[28604]: Adjusting osd_memory_target on smithi060 to 5698M 2024-05-03T22:36:24.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:23 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:24.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:23 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:24.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:23 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:36:24.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:23 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:24.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:23 smithi044 ceph-mon[28604]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:24.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:23 smithi060 ceph-mon[31721]: Detected new or changed devices on smithi060 2024-05-03T22:36:24.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:23 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:24.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:23 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:24.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:23 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:36:24.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:23 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:36:24.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:23 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:36:24.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:23 smithi060 ceph-mon[31721]: Adjusting osd_memory_target on smithi060 to 5698M 2024-05-03T22:36:24.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:23 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:24.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:23 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:24.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:23 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:36:24.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:23 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:24.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:23 smithi060 ceph-mon[31721]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:24.445 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.443+0000 7f916b200700 1 -- 172.21.15.160:0/155113791 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f916c109150 msgr2=0x7f916c10b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:36:24.446 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.443+0000 7f916b200700 1 --2- 172.21.15.160:0/155113791 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f916c109150 0x7f916c10b580 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f916400b0a0 tx=0x7f916400b3b0 comp rx=0 tx=0).stop 2024-05-03T22:36:24.446 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.443+0000 7f916b200700 1 -- 172.21.15.160:0/155113791 shutdown_connections 2024-05-03T22:36:24.446 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.443+0000 7f916b200700 1 --2- 172.21.15.160:0/155113791 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f916c109150 0x7f916c10b580 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:36:24.446 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.443+0000 7f916b200700 1 --2- 172.21.15.160:0/155113791 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f916c103ef0 0x7f916c1062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:36:24.446 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.443+0000 7f916b200700 1 --2- 172.21.15.160:0/155113791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f916c106820 0x7f916c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:36:24.446 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.443+0000 7f916b200700 1 -- 172.21.15.160:0/155113791 >> 172.21.15.160:0/155113791 conn(0x7f916c0fd8c0 msgr2=0x7f916c0ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:36:24.446 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.443+0000 7f916b200700 1 -- 172.21.15.160:0/155113791 shutdown_connections 2024-05-03T22:36:24.446 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.443+0000 7f916b200700 1 -- 172.21.15.160:0/155113791 wait complete. 2024-05-03T22:36:24.448 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.445+0000 7f916b200700 1 Processor -- start 2024-05-03T22:36:24.448 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.445+0000 7f916b200700 1 -- start start 2024-05-03T22:36:24.448 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.445+0000 7f916b200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f916c103ef0 0x7f916c199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:36:24.448 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.445+0000 7f916b200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f916c106820 0x7f916c199a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:36:24.449 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.445+0000 7f916b200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f916c109150 0x7f916c1a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:36:24.449 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.445+0000 7f916b200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f916c10f000 con 0x7f916c106820 2024-05-03T22:36:24.449 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.445+0000 7f916b200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f916c10ee80 con 0x7f916c109150 2024-05-03T22:36:24.449 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.445+0000 7f916b200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f916c10f180 con 0x7f916c103ef0 2024-05-03T22:36:24.449 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.446+0000 7f9169e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f916c103ef0 0x7f916c199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:36:24.449 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.446+0000 7f9169e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f916c103ef0 0x7f916c199510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:44348/0 (socket says 172.21.15.160:44348) 2024-05-03T22:36:24.449 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.446+0000 7f9169e00700 1 -- 172.21.15.160:0/4272686105 learned_addr learned my addr 172.21.15.160:0/4272686105 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-03T22:36:24.449 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.446+0000 7f9169400700 1 --2- 172.21.15.160:0/4272686105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f916c106820 0x7f916c199a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:36:24.449 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.446+0000 7f916a800700 1 --2- 172.21.15.160:0/4272686105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f916c109150 0x7f916c1a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:36:24.449 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.446+0000 7f9169e00700 1 -- 172.21.15.160:0/4272686105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f916c109150 msgr2=0x7f916c1a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:36:24.449 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.446+0000 7f9169e00700 1 --2- 172.21.15.160:0/4272686105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f916c109150 0x7f916c1a0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:36:24.449 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.446+0000 7f9169e00700 1 -- 172.21.15.160:0/4272686105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f916c106820 msgr2=0x7f916c199a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:36:24.449 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.446+0000 7f9169e00700 1 --2- 172.21.15.160:0/4272686105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f916c106820 0x7f916c199a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:36:24.450 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.446+0000 7f9169e00700 1 -- 172.21.15.160:0/4272686105 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916c1a1120 con 0x7f916c103ef0 2024-05-03T22:36:24.450 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.447+0000 7f9169e00700 1 --2- 172.21.15.160:0/4272686105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f916c103ef0 0x7f916c199510 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f915c00c9e0 tx=0x7f915c00cda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:36:24.450 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.447+0000 7f9162a00700 1 -- 172.21.15.160:0/4272686105 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c007ac0 con 0x7f916c103ef0 2024-05-03T22:36:24.451 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.447+0000 7f9162a00700 1 -- 172.21.15.160:0/4272686105 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f915c007c60 con 0x7f916c103ef0 2024-05-03T22:36:24.451 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.447+0000 7f916b200700 1 -- 172.21.15.160:0/4272686105 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f916c1a1410 con 0x7f916c103ef0 2024-05-03T22:36:24.451 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.447+0000 7f9162a00700 1 -- 172.21.15.160:0/4272686105 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f915c0186d0 con 0x7f916c103ef0 2024-05-03T22:36:24.451 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.447+0000 7f916b200700 1 -- 172.21.15.160:0/4272686105 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f916c1a19a0 con 0x7f916c103ef0 2024-05-03T22:36:24.451 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.448+0000 7f916b200700 1 -- 172.21.15.160:0/4272686105 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f916c06a190 con 0x7f916c103ef0 2024-05-03T22:36:24.452 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.451+0000 7f9162a00700 1 -- 172.21.15.160:0/4272686105 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f915c00f450 con 0x7f916c103ef0 2024-05-03T22:36:24.454 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.452+0000 7f9162a00700 1 --2- 172.21.15.160:0/4272686105 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f91500b2900 0x7f91500b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:36:24.454 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.452+0000 7f9162a00700 1 -- 172.21.15.160:0/4272686105 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5397+0+0 (secure 0 0 0) 0x7f915c0e1850 con 0x7f916c103ef0 2024-05-03T22:36:24.455 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.453+0000 7f9169400700 1 --2- 172.21.15.160:0/4272686105 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f91500b2900 0x7f91500b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:36:24.456 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.454+0000 7f9169400700 1 --2- 172.21.15.160:0/4272686105 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f91500b2900 0x7f91500b4dc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9158005fd0 tx=0x7f915800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:36:24.457 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.455+0000 7f9162a00700 1 -- 172.21.15.160:0/4272686105 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f915c054d70 con 0x7f916c103ef0 2024-05-03T22:36:24.698 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:24.696+0000 7f916b200700 1 -- 172.21.15.160:0/4272686105 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f916c0638e0 con 0x7f91500b2900 2024-05-03T22:36:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:24 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:36:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:24 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:36:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:24 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:25.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:24 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:36:25.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:24 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:36:25.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:24 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:25.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:24 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:36:25.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:24 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:36:25.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:24 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:26.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:25 smithi044 ceph-mon[28604]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:36:26.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:25 smithi044 ceph-mon[28604]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-05-03T22:36:26.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:25 smithi060 ceph-mon[31721]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:36:26.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:25 smithi060 ceph-mon[31721]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-05-03T22:36:26.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:25 smithi160 ceph-mon[32531]: from='client.24301 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:36:26.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:25 smithi160 ceph-mon[32531]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-05-03T22:36:28.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:27 smithi044 ceph-mon[28604]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T22:36:28.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:27 smithi060 ceph-mon[31721]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T22:36:28.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:27 smithi160 ceph-mon[32531]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T22:36:29.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:28 smithi044 ceph-mon[28604]: from='client.? 172.21.15.160:0/3334376266' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "717aeffb-6c51-4e4e-8344-fba70ac2c295"}]: dispatch 2024-05-03T22:36:29.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:28 smithi044 ceph-mon[28604]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "717aeffb-6c51-4e4e-8344-fba70ac2c295"}]: dispatch 2024-05-03T22:36:29.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:28 smithi044 ceph-mon[28604]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "717aeffb-6c51-4e4e-8344-fba70ac2c295"}]': finished 2024-05-03T22:36:29.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:28 smithi044 ceph-mon[28604]: osdmap e50: 9 total, 8 up, 9 in 2024-05-03T22:36:29.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:28 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:36:29.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:28 smithi060 ceph-mon[31721]: from='client.? 172.21.15.160:0/3334376266' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "717aeffb-6c51-4e4e-8344-fba70ac2c295"}]: dispatch 2024-05-03T22:36:29.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:28 smithi060 ceph-mon[31721]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "717aeffb-6c51-4e4e-8344-fba70ac2c295"}]: dispatch 2024-05-03T22:36:29.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:28 smithi060 ceph-mon[31721]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "717aeffb-6c51-4e4e-8344-fba70ac2c295"}]': finished 2024-05-03T22:36:29.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:28 smithi060 ceph-mon[31721]: osdmap e50: 9 total, 8 up, 9 in 2024-05-03T22:36:29.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:28 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:36:29.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:28 smithi160 ceph-mon[32531]: from='client.? 172.21.15.160:0/3334376266' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "717aeffb-6c51-4e4e-8344-fba70ac2c295"}]: dispatch 2024-05-03T22:36:29.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:28 smithi160 ceph-mon[32531]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "717aeffb-6c51-4e4e-8344-fba70ac2c295"}]: dispatch 2024-05-03T22:36:29.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:28 smithi160 ceph-mon[32531]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "717aeffb-6c51-4e4e-8344-fba70ac2c295"}]': finished 2024-05-03T22:36:29.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:28 smithi160 ceph-mon[32531]: osdmap e50: 9 total, 8 up, 9 in 2024-05-03T22:36:29.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:28 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:36:30.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:29 smithi044 ceph-mon[28604]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-03T22:36:30.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:29 smithi044 ceph-mon[28604]: from='client.? 172.21.15.160:0/4146282307' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:36:30.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:29 smithi060 ceph-mon[31721]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-03T22:36:30.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:29 smithi060 ceph-mon[31721]: from='client.? 172.21.15.160:0/4146282307' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:36:30.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:29 smithi160 ceph-mon[32531]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-03T22:36:30.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:29 smithi160 ceph-mon[32531]: from='client.? 172.21.15.160:0/4146282307' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:36:32.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:31 smithi044 ceph-mon[28604]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:36:32.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:31 smithi060 ceph-mon[31721]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:36:32.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:31 smithi160 ceph-mon[32531]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:36:34.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:33 smithi044 ceph-mon[28604]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:36:34.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:33 smithi060 ceph-mon[31721]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:36:34.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:33 smithi160 ceph-mon[32531]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:36:36.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:35 smithi044 ceph-mon[28604]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:35 smithi060 ceph-mon[31721]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:36.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:35 smithi160 ceph-mon[32531]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:38.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:37 smithi044 ceph-mon[28604]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:38.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:37 smithi060 ceph-mon[31721]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:38.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:37 smithi160 ceph-mon[32531]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:39.246 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:38 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-03T22:36:39.246 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:38 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:39.246 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:38 smithi160 ceph-mon[32531]: Deploying daemon osd.8 on smithi160 2024-05-03T22:36:39.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:38 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-03T22:36:39.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:38 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:39.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:38 smithi044 ceph-mon[28604]: Deploying daemon osd.8 on smithi160 2024-05-03T22:36:39.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:38 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-03T22:36:39.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:38 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:39.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:38 smithi060 ceph-mon[31721]: Deploying daemon osd.8 on smithi160 2024-05-03T22:36:40.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:39 smithi044 ceph-mon[28604]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:40.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:39 smithi060 ceph-mon[31721]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:40.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:39 smithi160 ceph-mon[32531]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:42.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:42 smithi060 ceph-mon[31721]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:42.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:42 smithi160 ceph-mon[32531]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:42.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:42 smithi044 ceph-mon[28604]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:44.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:44 smithi160 ceph-mon[32531]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:44.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:44 smithi044 ceph-mon[28604]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:44.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:44 smithi060 ceph-mon[31721]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:46.383 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:46 smithi160 ceph-mon[32531]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:46.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:46 smithi044 ceph-mon[28604]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:46.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:46 smithi060 ceph-mon[31721]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:47.891 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:47 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:47.891 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:47 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:47.891 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:47 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:36:47.891 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:47 smithi160 ceph-mon[32531]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:48.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:47 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:48.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:47 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:48.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:47 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:36:48.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:47 smithi044 ceph-mon[28604]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:48.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:47 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:48.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:47 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:48.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:47 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:36:48.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:47 smithi060 ceph-mon[31721]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:50.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:49 smithi044 ceph-mon[28604]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:50.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:49 smithi060 ceph-mon[31721]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:50.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:49 smithi160 ceph-mon[32531]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:51.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:51 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:51.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:51 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:51.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:51 smithi060 ceph-mon[31721]: from='osd.8 [v2:172.21.15.160:6816/2920554498,v1:172.21.15.160:6817/2920554498]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-03T22:36:51.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:51 smithi060 ceph-mon[31721]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-03T22:36:51.571 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:51 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:51.571 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:51 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:51.571 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:51 smithi160 ceph-mon[32531]: from='osd.8 [v2:172.21.15.160:6816/2920554498,v1:172.21.15.160:6817/2920554498]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-03T22:36:51.571 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:51 smithi160 ceph-mon[32531]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-03T22:36:51.572 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:51.568+0000 7f9162a00700 1 -- 172.21.15.160:0/4272686105 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f916c0638e0 con 0x7f91500b2900 2024-05-03T22:36:51.572 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 8 on host 'smithi160' 2024-05-03T22:36:51.574 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:51.571+0000 7f916b200700 1 -- 172.21.15.160:0/4272686105 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f91500b2900 msgr2=0x7f91500b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:36:51.574 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:51.571+0000 7f916b200700 1 --2- 172.21.15.160:0/4272686105 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f91500b2900 0x7f91500b4dc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9158005fd0 tx=0x7f915800a560 comp rx=0 tx=0).stop 2024-05-03T22:36:51.574 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:51.571+0000 7f916b200700 1 -- 172.21.15.160:0/4272686105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f916c103ef0 msgr2=0x7f916c199510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:36:51.574 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:51.571+0000 7f916b200700 1 --2- 172.21.15.160:0/4272686105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f916c103ef0 0x7f916c199510 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f915c00c9e0 tx=0x7f915c00cda0 comp rx=0 tx=0).stop 2024-05-03T22:36:51.574 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:51.571+0000 7f916b200700 1 -- 172.21.15.160:0/4272686105 shutdown_connections 2024-05-03T22:36:51.574 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:51.571+0000 7f916b200700 1 --2- 172.21.15.160:0/4272686105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f916c109150 0x7f916c1a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:36:51.574 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:51.571+0000 7f916b200700 1 --2- 172.21.15.160:0/4272686105 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f91500b2900 0x7f91500b4dc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:36:51.575 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:51.571+0000 7f916b200700 1 --2- 172.21.15.160:0/4272686105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f916c103ef0 0x7f916c199510 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:36:51.575 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:51.571+0000 7f916b200700 1 --2- 172.21.15.160:0/4272686105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f916c106820 0x7f916c199a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:36:51.575 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:51.571+0000 7f916b200700 1 -- 172.21.15.160:0/4272686105 >> 172.21.15.160:0/4272686105 conn(0x7f916c0fd8c0 msgr2=0x7f916c104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:36:51.575 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:51.572+0000 7f916b200700 1 -- 172.21.15.160:0/4272686105 shutdown_connections 2024-05-03T22:36:51.575 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:36:51.572+0000 7f916b200700 1 -- 172.21.15.160:0/4272686105 wait complete. 2024-05-03T22:36:51.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:51 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:51.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:51 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:51.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:51 smithi044 ceph-mon[28604]: from='osd.8 [v2:172.21.15.160:6816/2920554498,v1:172.21.15.160:6817/2920554498]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-03T22:36:51.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:51 smithi044 ceph-mon[28604]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-03T22:36:52.446 DEBUG:teuthology.orchestra.run.smithi160:osd.8> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.8.service 2024-05-03T22:36:52.450 INFO:tasks.cephadm:Deploying osd.9 on smithi044 with /dev/vg_nvme/lv_1... 2024-05-03T22:36:52.450 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-03T22:36:52.534 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:52 smithi044 ceph-mon[28604]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:52.534 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:52 smithi044 ceph-mon[28604]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-03T22:36:52.534 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:52 smithi044 ceph-mon[28604]: osdmap e51: 9 total, 8 up, 9 in 2024-05-03T22:36:52.534 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:52 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:36:52.534 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:52 smithi044 ceph-mon[28604]: from='osd.8 [v2:172.21.15.160:6816/2920554498,v1:172.21.15.160:6817/2920554498]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:36:52.534 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:52 smithi044 ceph-mon[28604]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:36:52.534 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:52 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:52.534 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:52 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:52.645 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:52 smithi160 ceph-mon[32531]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:52.645 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:52 smithi160 ceph-mon[32531]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-03T22:36:52.645 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:52 smithi160 ceph-mon[32531]: osdmap e51: 9 total, 8 up, 9 in 2024-05-03T22:36:52.646 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:52 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:36:52.646 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:52 smithi160 ceph-mon[32531]: from='osd.8 [v2:172.21.15.160:6816/2920554498,v1:172.21.15.160:6817/2920554498]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:36:52.646 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:52 smithi160 ceph-mon[32531]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:36:52.646 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:52 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:52.646 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:52 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:52.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:52 smithi060 ceph-mon[31721]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:52.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:52 smithi060 ceph-mon[31721]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-03T22:36:52.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:52 smithi060 ceph-mon[31721]: osdmap e51: 9 total, 8 up, 9 in 2024-05-03T22:36:52.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:52 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:36:52.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:52 smithi060 ceph-mon[31721]: from='osd.8 [v2:172.21.15.160:6816/2920554498,v1:172.21.15.160:6817/2920554498]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:36:52.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:52 smithi060 ceph-mon[31721]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:36:52.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:52 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:52.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:52 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:52.907 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:36:53.266 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 22:36:53 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T22:36:53.146+0000 7f7b22200700 -1 osd.8 0 waiting for initial osdmap 2024-05-03T22:36:53.266 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 22:36:53 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T22:36:53.179+0000 7f7b17600700 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T22:36:53.647 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:53 smithi044 ceph-mon[28604]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-03T22:36:53.647 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:53 smithi044 ceph-mon[28604]: osdmap e52: 9 total, 8 up, 9 in 2024-05-03T22:36:53.647 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:36:53.647 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:36:53.648 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:53 smithi044 ceph-mon[28604]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:53.648 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:53 smithi044 ceph-mon[28604]: from='osd.8 ' entity='osd.8' 2024-05-03T22:36:53.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:53 smithi060 ceph-mon[31721]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-03T22:36:53.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:53 smithi060 ceph-mon[31721]: osdmap e52: 9 total, 8 up, 9 in 2024-05-03T22:36:53.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:53 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:36:53.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:53 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:36:53.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:53 smithi060 ceph-mon[31721]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:53.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:53 smithi060 ceph-mon[31721]: from='osd.8 ' entity='osd.8' 2024-05-03T22:36:53.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:53 smithi160 ceph-mon[32531]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-03T22:36:53.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:53 smithi160 ceph-mon[32531]: osdmap e52: 9 total, 8 up, 9 in 2024-05-03T22:36:53.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:53 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:36:53.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:53 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:36:53.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:53 smithi160 ceph-mon[32531]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-05-03T22:36:53.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:53 smithi160 ceph-mon[32531]: from='osd.8 ' entity='osd.8' 2024-05-03T22:36:54.423 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:54 smithi160 ceph-mon[32531]: purged_snaps scrub starts 2024-05-03T22:36:54.423 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:54 smithi160 ceph-mon[32531]: purged_snaps scrub ok 2024-05-03T22:36:54.423 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:54 smithi160 ceph-mon[32531]: osd.8 [v2:172.21.15.160:6816/2920554498,v1:172.21.15.160:6817/2920554498] boot 2024-05-03T22:36:54.423 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:54 smithi160 ceph-mon[32531]: osdmap e53: 9 total, 9 up, 9 in 2024-05-03T22:36:54.423 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:54 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:36:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:54 smithi044 ceph-mon[28604]: purged_snaps scrub starts 2024-05-03T22:36:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:54 smithi044 ceph-mon[28604]: purged_snaps scrub ok 2024-05-03T22:36:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:54 smithi044 ceph-mon[28604]: osd.8 [v2:172.21.15.160:6816/2920554498,v1:172.21.15.160:6817/2920554498] boot 2024-05-03T22:36:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:54 smithi044 ceph-mon[28604]: osdmap e53: 9 total, 9 up, 9 in 2024-05-03T22:36:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:54 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:36:54.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:54 smithi060 ceph-mon[31721]: purged_snaps scrub starts 2024-05-03T22:36:54.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:54 smithi060 ceph-mon[31721]: purged_snaps scrub ok 2024-05-03T22:36:54.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:54 smithi060 ceph-mon[31721]: osd.8 [v2:172.21.15.160:6816/2920554498,v1:172.21.15.160:6817/2920554498] boot 2024-05-03T22:36:54.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:54 smithi060 ceph-mon[31721]: osdmap e53: 9 total, 9 up, 9 in 2024-05-03T22:36:54.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:54 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-03T22:36:55.467 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:55 smithi044 ceph-mon[28604]: osdmap e54: 9 total, 9 up, 9 in 2024-05-03T22:36:55.468 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:55 smithi044 ceph-mon[28604]: pgmap v247: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:36:55.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:55 smithi060 ceph-mon[31721]: osdmap e54: 9 total, 9 up, 9 in 2024-05-03T22:36:55.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:55 smithi060 ceph-mon[31721]: pgmap v247: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:36:55.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:55 smithi160 ceph-mon[32531]: osdmap e54: 9 total, 9 up, 9 in 2024-05-03T22:36:55.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:55 smithi160 ceph-mon[32531]: pgmap v247: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:36:56.150 INFO:teuthology.orchestra.run.smithi044.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-03T22:36:56.150 INFO:teuthology.orchestra.run.smithi044.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-03T22:36:56.150 INFO:teuthology.orchestra.run.smithi044.stderr: stderr: 10+0 records in 2024-05-03T22:36:56.150 INFO:teuthology.orchestra.run.smithi044.stderr:10+0 records out 2024-05-03T22:36:56.150 INFO:teuthology.orchestra.run.smithi044.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0347046 s, 302 MB/s 2024-05-03T22:36:56.151 INFO:teuthology.orchestra.run.smithi044.stderr:--> Zapping successful for: 2024-05-03T22:36:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:56 smithi044 ceph-mon[28604]: osdmap e55: 9 total, 9 up, 9 in 2024-05-03T22:36:56.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:56 smithi060 ceph-mon[31721]: osdmap e55: 9 total, 9 up, 9 in 2024-05-03T22:36:56.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:56 smithi160 ceph-mon[32531]: osdmap e55: 9 total, 9 up, 9 in 2024-05-03T22:36:57.103 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi044:vg_nvme/lv_1 2024-05-03T22:36:57.560 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:36:57.963 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:57 smithi044 ceph-mon[28604]: pgmap v249: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:36:57.964 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:57 smithi044 ceph-mon[28604]: Detected new or changed devices on smithi160 2024-05-03T22:36:57.964 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:57.964 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:57.964 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:36:57.964 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:36:57.964 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:36:57.964 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:57 smithi044 ceph-mon[28604]: Adjusting osd_memory_target on smithi160 to 5696M 2024-05-03T22:36:57.964 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:57.964 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:57.964 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:36:57.964 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:57.964 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:36:57.965 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:57.965 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:36:57.965 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:58.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:57 smithi060 ceph-mon[31721]: pgmap v249: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:36:58.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:57 smithi060 ceph-mon[31721]: Detected new or changed devices on smithi160 2024-05-03T22:36:58.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:58.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:58.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:36:58.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:36:58.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:36:58.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:57 smithi060 ceph-mon[31721]: Adjusting osd_memory_target on smithi160 to 5696M 2024-05-03T22:36:58.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:58.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:58.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:36:58.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:58.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:36:58.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:58.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:36:58.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:58.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:57 smithi160 ceph-mon[32531]: pgmap v249: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:36:58.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:57 smithi160 ceph-mon[32531]: Detected new or changed devices on smithi160 2024-05-03T22:36:58.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:58.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:58.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:36:58.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:36:58.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:36:58.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:57 smithi160 ceph-mon[32531]: Adjusting osd_memory_target on smithi160 to 5696M 2024-05-03T22:36:58.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:58.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:58.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:36:58.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:36:58.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:36:58.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:36:58.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:36:58.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:00.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.023+0000 7f6217800700 1 -- 172.21.15.44:0/3065763442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6210109b40 msgr2=0x7f6210109f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:37:00.025 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.023+0000 7f6217800700 1 --2- 172.21.15.44:0/3065763442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6210109b40 0x7f6210109f60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f620000b0d0 tx=0x7f620000b3e0 comp rx=0 tx=0).stop 2024-05-03T22:37:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.023+0000 7f6217800700 1 -- 172.21.15.44:0/3065763442 shutdown_connections 2024-05-03T22:37:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.023+0000 7f6217800700 1 --2- 172.21.15.44:0/3065763442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f621010b6e0 0x7f6210111f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:37:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.023+0000 7f6217800700 1 --2- 172.21.15.44:0/3065763442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6210109b40 0x7f6210109f60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:37:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.023+0000 7f6217800700 1 --2- 172.21.15.44:0/3065763442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f621010ad40 0x7f621010b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:37:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.023+0000 7f6217800700 1 -- 172.21.15.44:0/3065763442 >> 172.21.15.44:0/3065763442 conn(0x7f6210078b10 msgr2=0x7f621007af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:37:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.023+0000 7f6217800700 1 -- 172.21.15.44:0/3065763442 shutdown_connections 2024-05-03T22:37:00.026 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.023+0000 7f6217800700 1 -- 172.21.15.44:0/3065763442 wait complete. 2024-05-03T22:37:00.027 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.024+0000 7f6217800700 1 Processor -- start 2024-05-03T22:37:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.025+0000 7f6217800700 1 -- start start 2024-05-03T22:37:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.025+0000 7f6217800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6210109b40 0x7f621019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:37:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.025+0000 7f6217800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f621010ad40 0x7f62101a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:37:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.025+0000 7f6217800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f621010b6e0 0x7f62101a7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:37:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.025+0000 7f6217800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6210115710 con 0x7f621010b6e0 2024-05-03T22:37:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.025+0000 7f6217800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6210115590 con 0x7f621010ad40 2024-05-03T22:37:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.025+0000 7f6217800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6210115890 con 0x7f6210109b40 2024-05-03T22:37:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.026+0000 7f6215800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f621010b6e0 0x7f62101a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:37:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.026+0000 7f6215800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f621010b6e0 0x7f62101a7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48368/0 (socket says 172.21.15.44:48368) 2024-05-03T22:37:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.026+0000 7f6215800700 1 -- 172.21.15.44:0/2264533361 learned_addr learned my addr 172.21.15.44:0/2264533361 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:37:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.026+0000 7f6214e00700 1 --2- 172.21.15.44:0/2264533361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6210109b40 0x7f621019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:37:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.026+0000 7f6207e00700 1 --2- 172.21.15.44:0/2264533361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f621010ad40 0x7f62101a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:37:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.026+0000 7f6215800700 1 -- 172.21.15.44:0/2264533361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6210109b40 msgr2=0x7f621019fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:37:00.028 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.026+0000 7f6215800700 1 --2- 172.21.15.44:0/2264533361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6210109b40 0x7f621019fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:37:00.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.026+0000 7f6215800700 1 -- 172.21.15.44:0/2264533361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f621010ad40 msgr2=0x7f62101a0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:37:00.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.026+0000 7f6215800700 1 --2- 172.21.15.44:0/2264533361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f621010ad40 0x7f62101a0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:37:00.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.026+0000 7f6215800700 1 -- 172.21.15.44:0/2264533361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62101a7960 con 0x7f621010b6e0 2024-05-03T22:37:00.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.026+0000 7f6215800700 1 --2- 172.21.15.44:0/2264533361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f621010b6e0 0x7f62101a7290 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f620800c900 tx=0x7f620800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:37:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.027+0000 7f620e000700 1 -- 172.21.15.44:0/2264533361 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208007b00 con 0x7f621010b6e0 2024-05-03T22:37:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.027+0000 7f620e000700 1 -- 172.21.15.44:0/2264533361 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f620800ce50 con 0x7f621010b6e0 2024-05-03T22:37:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.027+0000 7f6217800700 1 -- 172.21.15.44:0/2264533361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62101a7c50 con 0x7f621010b6e0 2024-05-03T22:37:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.027+0000 7f620e000700 1 -- 172.21.15.44:0/2264533361 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6208018660 con 0x7f621010b6e0 2024-05-03T22:37:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.027+0000 7f6217800700 1 -- 172.21.15.44:0/2264533361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62101a8140 con 0x7f621010b6e0 2024-05-03T22:37:00.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.028+0000 7f6217800700 1 -- 172.21.15.44:0/2264533361 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f621006a190 con 0x7f621010b6e0 2024-05-03T22:37:00.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.031+0000 7f620e000700 1 -- 172.21.15.44:0/2264533361 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f620800f450 con 0x7f621010b6e0 2024-05-03T22:37:00.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.032+0000 7f620e000700 1 --2- 172.21.15.44:0/2264533361 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f61f40b2880 0x7f61f40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:37:00.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.033+0000 7f620e000700 1 -- 172.21.15.44:0/2264533361 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5829+0+0 (secure 0 0 0) 0x7f62080e1850 con 0x7f621010b6e0 2024-05-03T22:37:00.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.033+0000 7f6214e00700 1 --2- 172.21.15.44:0/2264533361 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f61f40b2880 0x7f61f40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:37:00.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.033+0000 7f6214e00700 1 --2- 172.21.15.44:0/2264533361 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f61f40b2880 0x7f61f40b4d40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6200009fd0 tx=0x7f620000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:37:00.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.035+0000 7f620e000700 1 -- 172.21.15.44:0/2264533361 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f6208014030 con 0x7f621010b6e0 2024-05-03T22:37:00.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:36:59 smithi044 ceph-mon[28604]: pgmap v250: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:00.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:36:59 smithi060 ceph-mon[31721]: pgmap v250: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:00.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:36:59 smithi160 ceph-mon[32531]: pgmap v250: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:00.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:00.285+0000 7f6217800700 1 -- 172.21.15.44:0/2264533361 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f62100638e0 con 0x7f61f40b2880 2024-05-03T22:37:01.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:00 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:37:01.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:00 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:37:01.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:00 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:37:01.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:00 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:37:01.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:00 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:37:01.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:00 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:37:01.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:00 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:37:01.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:00 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:37:01.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:00 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:37:02.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:01 smithi044 ceph-mon[28604]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:37:02.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:01 smithi044 ceph-mon[28604]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-05-03T22:37:02.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:01 smithi060 ceph-mon[31721]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:37:02.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:01 smithi060 ceph-mon[31721]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-05-03T22:37:02.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:01 smithi160 ceph-mon[32531]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:37:02.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:01 smithi160 ceph-mon[32531]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-05-03T22:37:04.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:03 smithi044 ceph-mon[28604]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-05-03T22:37:04.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:03 smithi060 ceph-mon[31721]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-05-03T22:37:04.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:03 smithi160 ceph-mon[32531]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-05-03T22:37:05.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:04 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3228264233' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ade31284-1246-42c8-9cee-e60dacc58a8a"}]: dispatch 2024-05-03T22:37:05.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:04 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3228264233' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ade31284-1246-42c8-9cee-e60dacc58a8a"}]': finished 2024-05-03T22:37:05.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:04 smithi044 ceph-mon[28604]: osdmap e56: 10 total, 9 up, 10 in 2024-05-03T22:37:05.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:04 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:37:05.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:04 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3228264233' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ade31284-1246-42c8-9cee-e60dacc58a8a"}]: dispatch 2024-05-03T22:37:05.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:04 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3228264233' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ade31284-1246-42c8-9cee-e60dacc58a8a"}]': finished 2024-05-03T22:37:05.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:04 smithi060 ceph-mon[31721]: osdmap e56: 10 total, 9 up, 10 in 2024-05-03T22:37:05.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:04 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:37:05.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:04 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3228264233' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ade31284-1246-42c8-9cee-e60dacc58a8a"}]: dispatch 2024-05-03T22:37:05.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:04 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3228264233' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ade31284-1246-42c8-9cee-e60dacc58a8a"}]': finished 2024-05-03T22:37:05.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:04 smithi160 ceph-mon[32531]: osdmap e56: 10 total, 9 up, 10 in 2024-05-03T22:37:05.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:04 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:37:06.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:05 smithi044 ceph-mon[28604]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-03T22:37:06.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:05 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3007682221' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:37:06.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:05 smithi060 ceph-mon[31721]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-03T22:37:06.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:05 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3007682221' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:37:06.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:05 smithi160 ceph-mon[32531]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-03T22:37:06.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:05 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3007682221' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:37:08.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:07 smithi044 ceph-mon[28604]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:37:08.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:07 smithi060 ceph-mon[31721]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:37:08.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:07 smithi160 ceph-mon[32531]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:37:10.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:09 smithi044 ceph-mon[28604]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:37:10.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:09 smithi060 ceph-mon[31721]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:37:10.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:09 smithi160 ceph-mon[32531]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:37:12.245 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:11 smithi044 ceph-mon[28604]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:12.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:11 smithi060 ceph-mon[31721]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:12.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:11 smithi160 ceph-mon[32531]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:14.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:13 smithi044 ceph-mon[28604]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:14.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:13 smithi060 ceph-mon[31721]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:14.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:13 smithi160 ceph-mon[32531]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:16.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:15 smithi044 ceph-mon[28604]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:16.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:15 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-03T22:37:16.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:15 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:37:16.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:15 smithi044 ceph-mon[28604]: Deploying daemon osd.9 on smithi044 2024-05-03T22:37:16.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:15 smithi060 ceph-mon[31721]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:16.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:15 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-03T22:37:16.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:15 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:37:16.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:15 smithi060 ceph-mon[31721]: Deploying daemon osd.9 on smithi044 2024-05-03T22:37:16.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:15 smithi160 ceph-mon[32531]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:16.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:15 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-03T22:37:16.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:15 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:37:16.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:15 smithi160 ceph-mon[32531]: Deploying daemon osd.9 on smithi044 2024-05-03T22:37:18.060 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:17 smithi044 ceph-mon[28604]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:18.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:17 smithi060 ceph-mon[31721]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:18.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:17 smithi160 ceph-mon[32531]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:20.243 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:19 smithi044 ceph-mon[28604]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:20.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:19 smithi060 ceph-mon[31721]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:20.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:19 smithi160 ceph-mon[32531]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:22.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:21 smithi160 ceph-mon[32531]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:22.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:21 smithi044 ceph-mon[28604]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:22.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:21 smithi060 ceph-mon[31721]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:24.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:23 smithi044 ceph-mon[28604]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:24.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:23 smithi060 ceph-mon[31721]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:24.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:23 smithi160 ceph-mon[32531]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:25.409 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:25 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:25.410 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:25 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:37:25.410 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:25 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:25.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:25.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:37:25.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:25.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:25 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:25.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:25 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:37:25.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:25 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:26.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:26 smithi044 ceph-mon[28604]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:26.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:26 smithi060 ceph-mon[31721]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:26.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:26 smithi160 ceph-mon[32531]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:28.395 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:28 smithi044 ceph-mon[28604]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:28.395 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:28 smithi044 ceph-mon[28604]: from='osd.9 [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-03T22:37:28.395 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:28 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:28.395 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:28 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:28.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:28 smithi060 ceph-mon[31721]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:28.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:28 smithi060 ceph-mon[31721]: from='osd.9 [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-03T22:37:28.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:28 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:28.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:28 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:28.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:28 smithi160 ceph-mon[32531]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:28.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:28 smithi160 ceph-mon[32531]: from='osd.9 [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-03T22:37:28.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:28 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:28.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:28 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:29.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:29.446+0000 7f620e000700 1 -- 172.21.15.44:0/2264533361 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f62100638e0 con 0x7f61f40b2880 2024-05-03T22:37:29.450 INFO:teuthology.orchestra.run.smithi044.stdout:Created osd(s) 9 on host 'smithi044' 2024-05-03T22:37:29.450 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:29 smithi044 ceph-mon[28604]: from='osd.9 [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-03T22:37:29.450 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:29 smithi044 ceph-mon[28604]: osdmap e57: 10 total, 9 up, 10 in 2024-05-03T22:37:29.450 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:29 smithi044 ceph-mon[28604]: from='osd.9 [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-05-03T22:37:29.450 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:29 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:37:29.451 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:29 smithi044 ceph-mon[28604]: from='osd.9 [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-05-03T22:37:29.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:29.450+0000 7f6217800700 1 -- 172.21.15.44:0/2264533361 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f61f40b2880 msgr2=0x7f61f40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:37:29.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:29.450+0000 7f6217800700 1 --2- 172.21.15.44:0/2264533361 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f61f40b2880 0x7f61f40b4d40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6200009fd0 tx=0x7f620000b040 comp rx=0 tx=0).stop 2024-05-03T22:37:29.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:29.450+0000 7f6217800700 1 -- 172.21.15.44:0/2264533361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f621010b6e0 msgr2=0x7f62101a7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:37:29.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:29.450+0000 7f6217800700 1 --2- 172.21.15.44:0/2264533361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f621010b6e0 0x7f62101a7290 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f620800c900 tx=0x7f620800cc10 comp rx=0 tx=0).stop 2024-05-03T22:37:29.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:29.450+0000 7f6217800700 1 -- 172.21.15.44:0/2264533361 shutdown_connections 2024-05-03T22:37:29.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:29.450+0000 7f6217800700 1 --2- 172.21.15.44:0/2264533361 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f621010b6e0 0x7f62101a7290 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:37:29.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:29.450+0000 7f6217800700 1 --2- 172.21.15.44:0/2264533361 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f61f40b2880 0x7f61f40b4d40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:37:29.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:29.450+0000 7f6217800700 1 --2- 172.21.15.44:0/2264533361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6210109b40 0x7f621019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:37:29.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:29.450+0000 7f6217800700 1 --2- 172.21.15.44:0/2264533361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f621010ad40 0x7f62101a0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:37:29.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:29.450+0000 7f6217800700 1 -- 172.21.15.44:0/2264533361 >> 172.21.15.44:0/2264533361 conn(0x7f6210078b10 msgr2=0x7f621010dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:37:29.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:29.450+0000 7f6217800700 1 -- 172.21.15.44:0/2264533361 shutdown_connections 2024-05-03T22:37:29.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:37:29.450+0000 7f6217800700 1 -- 172.21.15.44:0/2264533361 wait complete. 2024-05-03T22:37:29.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:29 smithi060 ceph-mon[31721]: from='osd.9 [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-03T22:37:29.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:29 smithi060 ceph-mon[31721]: osdmap e57: 10 total, 9 up, 10 in 2024-05-03T22:37:29.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:29 smithi060 ceph-mon[31721]: from='osd.9 [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-05-03T22:37:29.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:29 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:37:29.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:29 smithi060 ceph-mon[31721]: from='osd.9 [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-05-03T22:37:29.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:29 smithi160 ceph-mon[32531]: from='osd.9 [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-03T22:37:29.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:29 smithi160 ceph-mon[32531]: osdmap e57: 10 total, 9 up, 10 in 2024-05-03T22:37:29.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:29 smithi160 ceph-mon[32531]: from='osd.9 [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]: dispatch 2024-05-03T22:37:29.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:29 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:37:29.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:29 smithi160 ceph-mon[32531]: from='osd.9 [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi044", "root=default"]}]': finished 2024-05-03T22:37:30.257 DEBUG:teuthology.orchestra.run.smithi044:osd.9> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.9.service 2024-05-03T22:37:30.263 INFO:tasks.cephadm:Deploying osd.10 on smithi060 with /dev/vg_nvme/lv_1... 2024-05-03T22:37:30.263 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-03T22:37:30.492 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:30 smithi044 ceph-mon[28604]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:30.492 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:30 smithi044 ceph-mon[28604]: osdmap e58: 10 total, 9 up, 10 in 2024-05-03T22:37:30.492 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:37:30.492 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:37:30.492 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:30.492 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:30.492 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:30 smithi044 ceph-mon[28604]: from='osd.9 [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386]' entity='osd.9' 2024-05-03T22:37:30.492 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:37:30.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:30 smithi060 ceph-mon[31721]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:30.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:30 smithi060 ceph-mon[31721]: osdmap e58: 10 total, 9 up, 10 in 2024-05-03T22:37:30.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:37:30.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:37:30.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:30.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:30.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:30 smithi060 ceph-mon[31721]: from='osd.9 [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386]' entity='osd.9' 2024-05-03T22:37:30.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:37:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:30 smithi160 ceph-mon[32531]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:30 smithi160 ceph-mon[32531]: osdmap e58: 10 total, 9 up, 10 in 2024-05-03T22:37:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:37:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:37:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:30.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:30.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:30 smithi160 ceph-mon[32531]: from='osd.9 [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386]' entity='osd.9' 2024-05-03T22:37:30.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:37:30.726 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T22:37:32.115 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:32 smithi044 ceph-mon[28604]: purged_snaps scrub starts 2024-05-03T22:37:32.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:32 smithi044 ceph-mon[28604]: purged_snaps scrub ok 2024-05-03T22:37:32.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:32 smithi044 ceph-mon[28604]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:32.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:32 smithi044 ceph-mon[28604]: osd.9 [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386] boot 2024-05-03T22:37:32.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:32 smithi044 ceph-mon[28604]: osdmap e59: 10 total, 10 up, 10 in 2024-05-03T22:37:32.116 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:32 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:37:32.180 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:32 smithi060 ceph-mon[31721]: purged_snaps scrub starts 2024-05-03T22:37:32.180 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:32 smithi060 ceph-mon[31721]: purged_snaps scrub ok 2024-05-03T22:37:32.180 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:32 smithi060 ceph-mon[31721]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:32.181 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:32 smithi060 ceph-mon[31721]: osd.9 [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386] boot 2024-05-03T22:37:32.181 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:32 smithi060 ceph-mon[31721]: osdmap e59: 10 total, 10 up, 10 in 2024-05-03T22:37:32.181 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:32 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:37:32.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:32 smithi160 ceph-mon[32531]: purged_snaps scrub starts 2024-05-03T22:37:32.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:32 smithi160 ceph-mon[32531]: purged_snaps scrub ok 2024-05-03T22:37:32.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:32 smithi160 ceph-mon[32531]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-05-03T22:37:32.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:32 smithi160 ceph-mon[32531]: osd.9 [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386] boot 2024-05-03T22:37:32.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:32 smithi160 ceph-mon[32531]: osdmap e59: 10 total, 10 up, 10 in 2024-05-03T22:37:32.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:32 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-03T22:37:33.084 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:33 smithi060 ceph-mon[31721]: osdmap e60: 10 total, 10 up, 10 in 2024-05-03T22:37:33.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:33 smithi044 ceph-mon[28604]: osdmap e60: 10 total, 10 up, 10 in 2024-05-03T22:37:33.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:33 smithi160 ceph-mon[32531]: osdmap e60: 10 total, 10 up, 10 in 2024-05-03T22:37:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-03T22:37:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-03T22:37:33.937 INFO:teuthology.orchestra.run.smithi060.stderr: stderr: 10+0 records in 2024-05-03T22:37:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:10+0 records out 2024-05-03T22:37:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0378434 s, 277 MB/s 2024-05-03T22:37:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:--> Zapping successful for: 2024-05-03T22:37:34.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:34 smithi060 ceph-mon[31721]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:34.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:34 smithi044 ceph-mon[28604]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:34.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:34 smithi160 ceph-mon[32531]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:34.901 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi060:vg_nvme/lv_1 2024-05-03T22:37:35.326 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.b/config 2024-05-03T22:37:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:36 smithi060 ceph-mon[31721]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:36 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:36 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:36 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:37:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:36 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:37:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:36 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:37:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:36 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:37:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:36 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:36.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:36 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:37:36.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:36 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:37:36.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:36 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:36.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:36 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:37:36.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:36 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:37:36.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:36 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:37:36.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:36 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:36.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:36 smithi044 ceph-mon[28604]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:36.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:36 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:36.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:36 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:36.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:36 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:37:36.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:36 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:37:36.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:36 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:37:36.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:36 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:37:36.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:36 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:36.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:36 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:37:36.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:36 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:37:36.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:36 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:36.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:36 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:37:36.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:36 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:37:36.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:36 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:37:36.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:36 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:36.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:36 smithi160 ceph-mon[32531]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:36.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:36 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:36.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:36 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:36.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:36 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:37:36.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:36 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:37:36.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:36 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:37:36.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:36 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:37:36.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:36 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:36.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:36 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:37:36.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:36 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:37:36.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:36 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:36.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:36 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:37:36.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:36 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:37:36.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:36 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:37:36.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:36 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:37:37.344 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:37 smithi060 ceph-mon[31721]: Detected new or changed devices on smithi044 2024-05-03T22:37:37.344 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:37 smithi060 ceph-mon[31721]: Adjusting osd_memory_target on smithi044 to 4273M 2024-05-03T22:37:37.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:37 smithi044 ceph-mon[28604]: Detected new or changed devices on smithi044 2024-05-03T22:37:37.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:37 smithi044 ceph-mon[28604]: Adjusting osd_memory_target on smithi044 to 4273M 2024-05-03T22:37:37.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:37 smithi160 ceph-mon[32531]: Detected new or changed devices on smithi044 2024-05-03T22:37:37.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:37 smithi160 ceph-mon[32531]: Adjusting osd_memory_target on smithi044 to 4273M 2024-05-03T22:37:37.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.681+0000 7fa142a00700 1 -- 172.21.15.60:0/1654056381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa13c105340 msgr2=0x7fa13c1057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:37:37.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.681+0000 7fa142a00700 1 --2- 172.21.15.60:0/1654056381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa13c105340 0x7fa13c1057a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa1280099c0 tx=0x7fa128009cd0 comp rx=0 tx=0).stop 2024-05-03T22:37:37.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.682+0000 7fa142a00700 1 -- 172.21.15.60:0/1654056381 shutdown_connections 2024-05-03T22:37:37.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.682+0000 7fa142a00700 1 --2- 172.21.15.60:0/1654056381 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa13c105ce0 0x7fa13c10db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:37:37.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.682+0000 7fa142a00700 1 --2- 172.21.15.60:0/1654056381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa13c106e00 0x7fa13c107220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:37:37.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.682+0000 7fa142a00700 1 --2- 172.21.15.60:0/1654056381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa13c105340 0x7fa13c1057a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:37:37.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.682+0000 7fa142a00700 1 -- 172.21.15.60:0/1654056381 >> 172.21.15.60:0/1654056381 conn(0x7fa13c100c80 msgr2=0x7fa13c103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:37:37.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.682+0000 7fa142a00700 1 -- 172.21.15.60:0/1654056381 shutdown_connections 2024-05-03T22:37:37.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.682+0000 7fa142a00700 1 -- 172.21.15.60:0/1654056381 wait complete. 2024-05-03T22:37:37.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.683+0000 7fa142a00700 1 Processor -- start 2024-05-03T22:37:37.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.683+0000 7fa142a00700 1 -- start start 2024-05-03T22:37:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.684+0000 7fa142a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa13c105340 0x7fa13c19bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:37:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.684+0000 7fa142a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa13c105ce0 0x7fa13c19c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:37:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.684+0000 7fa142a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa13c106e00 0x7fa13c1a3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:37:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.684+0000 7fa142a00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c111440 con 0x7fa13c106e00 2024-05-03T22:37:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.684+0000 7fa142a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c1112c0 con 0x7fa13c105ce0 2024-05-03T22:37:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.684+0000 7fa142a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c1115c0 con 0x7fa13c105340 2024-05-03T22:37:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.684+0000 7fa13b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa13c105ce0 0x7fa13c19c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:37:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.684+0000 7fa13b400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa13c105ce0 0x7fa13c19c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35358/0 (socket says 172.21.15.60:35358) 2024-05-03T22:37:37.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.684+0000 7fa13b400700 1 -- 172.21.15.60:0/2444271077 learned_addr learned my addr 172.21.15.60:0/2444271077 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-05-03T22:37:37.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.684+0000 7fa13be00700 1 --2- 172.21.15.60:0/2444271077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa13c105340 0x7fa13c19bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:37:37.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.685+0000 7fa140a00700 1 --2- 172.21.15.60:0/2444271077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa13c106e00 0x7fa13c1a3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:37:37.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.685+0000 7fa13b400700 1 -- 172.21.15.60:0/2444271077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa13c105340 msgr2=0x7fa13c19bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:37:37.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.685+0000 7fa13b400700 1 --2- 172.21.15.60:0/2444271077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa13c105340 0x7fa13c19bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:37:37.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.685+0000 7fa13b400700 1 -- 172.21.15.60:0/2444271077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa13c106e00 msgr2=0x7fa13c1a3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:37:37.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.685+0000 7fa13b400700 1 --2- 172.21.15.60:0/2444271077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa13c106e00 0x7fa13c1a3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:37:37.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.685+0000 7fa13b400700 1 -- 172.21.15.60:0/2444271077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13c1a36f0 con 0x7fa13c105ce0 2024-05-03T22:37:37.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.685+0000 7fa13b400700 1 --2- 172.21.15.60:0/2444271077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa13c105ce0 0x7fa13c19c020 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa12800c010 tx=0x7fa128009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:37:37.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.685+0000 7fa138c00700 1 -- 172.21.15.60:0/2444271077 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa128026070 con 0x7fa13c105ce0 2024-05-03T22:37:37.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.685+0000 7fa138c00700 1 -- 172.21.15.60:0/2444271077 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fa128004120 con 0x7fa13c105ce0 2024-05-03T22:37:37.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.685+0000 7fa138c00700 1 -- 172.21.15.60:0/2444271077 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa128021410 con 0x7fa13c105ce0 2024-05-03T22:37:37.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.685+0000 7fa142a00700 1 -- 172.21.15.60:0/2444271077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa13c1a3980 con 0x7fa13c105ce0 2024-05-03T22:37:37.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.686+0000 7fa142a00700 1 -- 172.21.15.60:0/2444271077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa13c1a3d80 con 0x7fa13c105ce0 2024-05-03T22:37:37.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.687+0000 7fa142a00700 1 -- 172.21.15.60:0/2444271077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa13c06a190 con 0x7fa13c105ce0 2024-05-03T22:37:37.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.690+0000 7fa138c00700 1 -- 172.21.15.60:0/2444271077 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fa128029070 con 0x7fa13c105ce0 2024-05-03T22:37:37.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.691+0000 7fa138c00700 1 --2- 172.21.15.60:0/2444271077 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa1200b2880 0x7fa1200b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:37:37.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.692+0000 7fa138c00700 1 -- 172.21.15.60:0/2444271077 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6261+0+0 (secure 0 0 0) 0x7fa1280e2a50 con 0x7fa13c105ce0 2024-05-03T22:37:37.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.692+0000 7fa13be00700 1 --2- 172.21.15.60:0/2444271077 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa1200b2880 0x7fa1200b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:37:37.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.693+0000 7fa13be00700 1 --2- 172.21.15.60:0/2444271077 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa1200b2880 0x7fa1200b4d40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa12c005950 tx=0x7fa12c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:37:37.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.693+0000 7fa138c00700 1 -- 172.21.15.60:0/2444271077 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa128030020 con 0x7fa13c105ce0 2024-05-03T22:37:37.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:37:37.939+0000 7fa142a00700 1 -- 172.21.15.60:0/2444271077 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa13c0638e0 con 0x7fa1200b2880 2024-05-03T22:37:38.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:38 smithi060 ceph-mon[31721]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:38.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:38 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:37:38.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:38 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:37:38.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:38 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:37:38.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:38 smithi044 ceph-mon[28604]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:38.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:38 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:37:38.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:38 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:37:38.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:38 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:37:38.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:38 smithi160 ceph-mon[32531]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:38.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:38 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:37:38.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:38 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:37:38.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:38 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:37:39.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:39 smithi060 ceph-mon[31721]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:37:39.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:39 smithi044 ceph-mon[28604]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:37:39.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:39 smithi160 ceph-mon[32531]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:37:40.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:40 smithi060 ceph-mon[31721]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:40.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:40 smithi044 ceph-mon[28604]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:40.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:40 smithi160 ceph-mon[32531]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:42.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:42 smithi044 ceph-mon[28604]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:42.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:42 smithi060 ceph-mon[31721]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:42.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:42 smithi160 ceph-mon[32531]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:43.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:43 smithi044 ceph-mon[28604]: from='client.? 172.21.15.60:0/3641854486' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf"}]: dispatch 2024-05-03T22:37:43.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:43 smithi044 ceph-mon[28604]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf"}]: dispatch 2024-05-03T22:37:43.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:43 smithi044 ceph-mon[28604]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf"}]': finished 2024-05-03T22:37:43.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:43 smithi044 ceph-mon[28604]: osdmap e61: 11 total, 10 up, 11 in 2024-05-03T22:37:43.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:43 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:37:43.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:43 smithi044 ceph-mon[28604]: from='client.? 172.21.15.60:0/1349354500' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:37:43.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:43 smithi060 ceph-mon[31721]: from='client.? 172.21.15.60:0/3641854486' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf"}]: dispatch 2024-05-03T22:37:43.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:43 smithi060 ceph-mon[31721]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf"}]: dispatch 2024-05-03T22:37:43.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:43 smithi060 ceph-mon[31721]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf"}]': finished 2024-05-03T22:37:43.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:43 smithi060 ceph-mon[31721]: osdmap e61: 11 total, 10 up, 11 in 2024-05-03T22:37:43.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:43 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:37:43.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:43 smithi060 ceph-mon[31721]: from='client.? 172.21.15.60:0/1349354500' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:37:43.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:43 smithi160 ceph-mon[32531]: from='client.? 172.21.15.60:0/3641854486' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf"}]: dispatch 2024-05-03T22:37:43.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:43 smithi160 ceph-mon[32531]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf"}]: dispatch 2024-05-03T22:37:43.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:43 smithi160 ceph-mon[32531]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf"}]': finished 2024-05-03T22:37:43.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:43 smithi160 ceph-mon[32531]: osdmap e61: 11 total, 10 up, 11 in 2024-05-03T22:37:43.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:43 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:37:43.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:43 smithi160 ceph-mon[32531]: from='client.? 172.21.15.60:0/1349354500' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:37:44.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:44 smithi044 ceph-mon[28604]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:44.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:44 smithi060 ceph-mon[31721]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:44.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:44 smithi160 ceph-mon[32531]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:46.387 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:46 smithi060 ceph-mon[31721]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:46.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:46 smithi044 ceph-mon[28604]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:46.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:46 smithi160 ceph-mon[32531]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:48.482 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:48 smithi060 ceph-mon[31721]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:48.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:48 smithi044 ceph-mon[28604]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:48.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:48 smithi160 ceph-mon[32531]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:50.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:50 smithi044 ceph-mon[28604]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:50.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:50 smithi060 ceph-mon[31721]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:50.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:50 smithi160 ceph-mon[32531]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:52.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:52 smithi044 ceph-mon[28604]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:52.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:52 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-03T22:37:52.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:52 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:37:52.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:52 smithi060 ceph-mon[31721]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:52.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:52 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-03T22:37:52.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:52 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:37:52.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:52 smithi160 ceph-mon[32531]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:52.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:52 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-03T22:37:52.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:52 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:37:53.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:53 smithi060 ceph-mon[31721]: Deploying daemon osd.10 on smithi060 2024-05-03T22:37:53.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:53 smithi044 ceph-mon[28604]: Deploying daemon osd.10 on smithi060 2024-05-03T22:37:53.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:53 smithi160 ceph-mon[32531]: Deploying daemon osd.10 on smithi060 2024-05-03T22:37:54.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:54 smithi060 ceph-mon[31721]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:54.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:54 smithi044 ceph-mon[28604]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:54.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:54 smithi160 ceph-mon[32531]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:56.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:56 smithi044 ceph-mon[28604]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:56.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:56 smithi060 ceph-mon[31721]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:56.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:56 smithi160 ceph-mon[32531]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:58.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:37:58 smithi044 ceph-mon[28604]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:58.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:37:58 smithi060 ceph-mon[31721]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:37:58.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:37:58 smithi160 ceph-mon[32531]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:38:00.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:00 smithi044 ceph-mon[28604]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:38:00.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:00 smithi060 ceph-mon[31721]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:38:00.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:00 smithi160 ceph-mon[32531]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:38:01.431 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:01 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:38:01.431 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:01 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:01.431 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:01 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:01.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:01 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:38:01.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:01 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:01.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:01 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:01.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:01 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:38:01.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:01 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:01.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:01 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:02.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:02 smithi044 ceph-mon[28604]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:38:02.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:02 smithi060 ceph-mon[31721]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:38:02.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:02 smithi160 ceph-mon[32531]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:38:04.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:04 smithi060 ceph-mon[31721]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:38:04.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:04 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:04.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:04 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:04.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:04 smithi160 ceph-mon[32531]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:38:04.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:04 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:04.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:04 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:04.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:04 smithi044 ceph-mon[28604]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:38:04.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:04 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:04.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:04 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:05.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:38:05.008+0000 7fa138c00700 1 -- 172.21.15.60:0/2444271077 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fa13c0638e0 con 0x7fa1200b2880 2024-05-03T22:38:05.012 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 10 on host 'smithi060' 2024-05-03T22:38:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:38:05.012+0000 7fa142a00700 1 -- 172.21.15.60:0/2444271077 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa1200b2880 msgr2=0x7fa1200b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:38:05.012+0000 7fa142a00700 1 --2- 172.21.15.60:0/2444271077 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa1200b2880 0x7fa1200b4d40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa12c005950 tx=0x7fa12c0058e0 comp rx=0 tx=0).stop 2024-05-03T22:38:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:38:05.012+0000 7fa142a00700 1 -- 172.21.15.60:0/2444271077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa13c105ce0 msgr2=0x7fa13c19c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:38:05.012+0000 7fa142a00700 1 --2- 172.21.15.60:0/2444271077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa13c105ce0 0x7fa13c19c020 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa12800c010 tx=0x7fa128009580 comp rx=0 tx=0).stop 2024-05-03T22:38:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:38:05.012+0000 7fa142a00700 1 -- 172.21.15.60:0/2444271077 shutdown_connections 2024-05-03T22:38:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:38:05.012+0000 7fa142a00700 1 --2- 172.21.15.60:0/2444271077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa13c106e00 0x7fa13c1a3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:38:05.012+0000 7fa142a00700 1 --2- 172.21.15.60:0/2444271077 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa1200b2880 0x7fa1200b4d40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:38:05.012+0000 7fa142a00700 1 --2- 172.21.15.60:0/2444271077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa13c105340 0x7fa13c19bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:38:05.012+0000 7fa142a00700 1 --2- 172.21.15.60:0/2444271077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa13c105ce0 0x7fa13c19c020 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:38:05.012+0000 7fa142a00700 1 -- 172.21.15.60:0/2444271077 >> 172.21.15.60:0/2444271077 conn(0x7fa13c100c80 msgr2=0x7fa13c109cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:38:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:38:05.013+0000 7fa142a00700 1 -- 172.21.15.60:0/2444271077 shutdown_connections 2024-05-03T22:38:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-05-03T22:38:05.013+0000 7fa142a00700 1 -- 172.21.15.60:0/2444271077 wait complete. 2024-05-03T22:38:05.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:05 smithi060 ceph-mon[31721]: from='osd.10 [v2:172.21.15.60:6824/2396062554,v1:172.21.15.60:6825/2396062554]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-03T22:38:05.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:05 smithi060 ceph-mon[31721]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-03T22:38:05.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:05.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:05.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:05 smithi044 ceph-mon[28604]: from='osd.10 [v2:172.21.15.60:6824/2396062554,v1:172.21.15.60:6825/2396062554]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-03T22:38:05.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:05 smithi044 ceph-mon[28604]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-03T22:38:05.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:05.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:05.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:05 smithi160 ceph-mon[32531]: from='osd.10 [v2:172.21.15.60:6824/2396062554,v1:172.21.15.60:6825/2396062554]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-03T22:38:05.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:05 smithi160 ceph-mon[32531]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-03T22:38:05.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:05.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:05.781 DEBUG:teuthology.orchestra.run.smithi060:osd.10> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.10.service 2024-05-03T22:38:05.789 INFO:tasks.cephadm:Deploying osd.11 on smithi160 with /dev/vg_nvme/lv_1... 2024-05-03T22:38:05.790 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-03T22:38:06.253 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:38:06.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:06 smithi060 ceph-mon[31721]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:38:06.500 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:06 smithi060 ceph-mon[31721]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-03T22:38:06.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:06 smithi060 ceph-mon[31721]: osdmap e62: 11 total, 10 up, 11 in 2024-05-03T22:38:06.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:06 smithi060 ceph-mon[31721]: from='osd.10 [v2:172.21.15.60:6824/2396062554,v1:172.21.15.60:6825/2396062554]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:38:06.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:06 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:38:06.501 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:06 smithi060 ceph-mon[31721]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:38:06.587 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:06 smithi160 ceph-mon[32531]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:38:06.587 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:06 smithi160 ceph-mon[32531]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-03T22:38:06.587 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:06 smithi160 ceph-mon[32531]: osdmap e62: 11 total, 10 up, 11 in 2024-05-03T22:38:06.587 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:06 smithi160 ceph-mon[32531]: from='osd.10 [v2:172.21.15.60:6824/2396062554,v1:172.21.15.60:6825/2396062554]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:38:06.588 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:06 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:38:06.588 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:06 smithi160 ceph-mon[32531]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:38:06.654 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:06 smithi044 ceph-mon[28604]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:38:06.654 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:06 smithi044 ceph-mon[28604]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-03T22:38:06.654 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:06 smithi044 ceph-mon[28604]: osdmap e62: 11 total, 10 up, 11 in 2024-05-03T22:38:06.654 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:06 smithi044 ceph-mon[28604]: from='osd.10 [v2:172.21.15.60:6824/2396062554,v1:172.21.15.60:6825/2396062554]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:38:06.654 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:06 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:38:06.654 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:06 smithi044 ceph-mon[28604]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]: dispatch 2024-05-03T22:38:07.189 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 22:38:06 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T22:38:06.983+0000 7f63cae00700 -1 osd.10 0 waiting for initial osdmap 2024-05-03T22:38:07.189 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 22:38:07 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T22:38:07.030+0000 7f63c0c00700 -1 osd.10 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-03T22:38:07.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:07 smithi060 ceph-mon[31721]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-03T22:38:07.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:07 smithi060 ceph-mon[31721]: osdmap e63: 11 total, 10 up, 11 in 2024-05-03T22:38:07.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:07 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:38:07.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:07 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:38:07.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:07 smithi060 ceph-mon[31721]: from='osd.10 ' entity='osd.10' 2024-05-03T22:38:07.667 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:07 smithi160 ceph-mon[32531]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-03T22:38:07.667 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:07 smithi160 ceph-mon[32531]: osdmap e63: 11 total, 10 up, 11 in 2024-05-03T22:38:07.667 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:07 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:38:07.667 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:07 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:38:07.667 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:07 smithi160 ceph-mon[32531]: from='osd.10 ' entity='osd.10' 2024-05-03T22:38:07.686 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:07 smithi044 ceph-mon[28604]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-05-03T22:38:07.686 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:07 smithi044 ceph-mon[28604]: osdmap e63: 11 total, 10 up, 11 in 2024-05-03T22:38:07.687 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:07 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:38:07.687 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:07 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:38:07.687 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:07 smithi044 ceph-mon[28604]: from='osd.10 ' entity='osd.10' 2024-05-03T22:38:08.386 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:08 smithi044 ceph-mon[28604]: purged_snaps scrub starts 2024-05-03T22:38:08.386 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:08 smithi044 ceph-mon[28604]: purged_snaps scrub ok 2024-05-03T22:38:08.386 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:08 smithi044 ceph-mon[28604]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:38:08.386 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:08 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:38:08.387 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:08 smithi044 ceph-mon[28604]: osd.10 [v2:172.21.15.60:6824/2396062554,v1:172.21.15.60:6825/2396062554] boot 2024-05-03T22:38:08.387 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:08 smithi044 ceph-mon[28604]: osdmap e64: 11 total, 11 up, 11 in 2024-05-03T22:38:08.387 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:08 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:38:08.573 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:08 smithi160 ceph-mon[32531]: purged_snaps scrub starts 2024-05-03T22:38:08.573 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:08 smithi160 ceph-mon[32531]: purged_snaps scrub ok 2024-05-03T22:38:08.574 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:08 smithi160 ceph-mon[32531]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:38:08.574 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:08 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:38:08.574 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:08 smithi160 ceph-mon[32531]: osd.10 [v2:172.21.15.60:6824/2396062554,v1:172.21.15.60:6825/2396062554] boot 2024-05-03T22:38:08.574 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:08 smithi160 ceph-mon[32531]: osdmap e64: 11 total, 11 up, 11 in 2024-05-03T22:38:08.574 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:08 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:38:08.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:08 smithi060 ceph-mon[31721]: purged_snaps scrub starts 2024-05-03T22:38:08.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:08 smithi060 ceph-mon[31721]: purged_snaps scrub ok 2024-05-03T22:38:08.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:08 smithi060 ceph-mon[31721]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-05-03T22:38:08.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:08 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:38:08.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:08 smithi060 ceph-mon[31721]: osd.10 [v2:172.21.15.60:6824/2396062554,v1:172.21.15.60:6825/2396062554] boot 2024-05-03T22:38:08.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:08 smithi060 ceph-mon[31721]: osdmap e64: 11 total, 11 up, 11 in 2024-05-03T22:38:08.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:08 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-03T22:38:09.218 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-03T22:38:09.218 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-03T22:38:09.218 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2024-05-03T22:38:09.218 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2024-05-03T22:38:09.218 INFO:teuthology.orchestra.run.smithi160.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0324094 s, 324 MB/s 2024-05-03T22:38:09.219 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2024-05-03T22:38:10.167 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi160:vg_nvme/lv_1 2024-05-03T22:38:10.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:09 smithi044 ceph-mon[28604]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:10.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:10 smithi044 ceph-mon[28604]: osdmap e65: 11 total, 11 up, 11 in 2024-05-03T22:38:10.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:10 smithi060 ceph-mon[31721]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:10.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:10 smithi060 ceph-mon[31721]: osdmap e65: 11 total, 11 up, 11 in 2024-05-03T22:38:10.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:10 smithi160 ceph-mon[32531]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:10.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:10 smithi160 ceph-mon[32531]: osdmap e65: 11 total, 11 up, 11 in 2024-05-03T22:38:10.596 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:38:11.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:11 smithi060 ceph-mon[31721]: osdmap e66: 11 total, 11 up, 11 in 2024-05-03T22:38:11.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:11 smithi044 ceph-mon[28604]: osdmap e66: 11 total, 11 up, 11 in 2024-05-03T22:38:11.521 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:11 smithi160 ceph-mon[32531]: osdmap e66: 11 total, 11 up, 11 in 2024-05-03T22:38:12.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:12 smithi160 ceph-mon[32531]: pgmap v297: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:12.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:12 smithi160 ceph-mon[32531]: Detected new or changed devices on smithi060 2024-05-03T22:38:12.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:12.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:12.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:12.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:12.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:12.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:12.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:12 smithi160 ceph-mon[32531]: Adjusting osd_memory_target on smithi060 to 4273M 2024-05-03T22:38:12.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:12.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:12.201 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:38:12.201 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:12.201 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:38:12.201 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:12.201 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:38:12.201 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:12 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:12.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:12 smithi044 ceph-mon[28604]: pgmap v297: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:12.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:12 smithi044 ceph-mon[28604]: Detected new or changed devices on smithi060 2024-05-03T22:38:12.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:12.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:12.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:12.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:12.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:12.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:12.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:12 smithi044 ceph-mon[28604]: Adjusting osd_memory_target on smithi060 to 4273M 2024-05-03T22:38:12.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:12.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:12.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:38:12.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:12.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:38:12.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:12.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:38:12.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:12 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:12.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:12 smithi060 ceph-mon[31721]: pgmap v297: 1 pgs: 1 peering; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:12.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:12 smithi060 ceph-mon[31721]: Detected new or changed devices on smithi060 2024-05-03T22:38:12.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:12.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:12.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:12.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:12.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:12.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:12.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:12 smithi060 ceph-mon[31721]: Adjusting osd_memory_target on smithi060 to 4273M 2024-05-03T22:38:12.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:12.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:12.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:38:12.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:12.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:38:12.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:12.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:38:12.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:12 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:12.708 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.706+0000 7f151a000700 1 -- 172.21.15.160:0/2378036453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f151410b6e0 msgr2=0x7f1514111f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:12.709 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.706+0000 7f151a000700 1 --2- 172.21.15.160:0/2378036453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f151410b6e0 0x7f1514111f90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f150c00b0a0 tx=0x7f150c00b3b0 comp rx=0 tx=0).stop 2024-05-03T22:38:12.709 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.706+0000 7f151a000700 1 -- 172.21.15.160:0/2378036453 shutdown_connections 2024-05-03T22:38:12.709 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.706+0000 7f151a000700 1 --2- 172.21.15.160:0/2378036453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f151410b6e0 0x7f1514111f90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:12.709 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.706+0000 7f151a000700 1 --2- 172.21.15.160:0/2378036453 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1514109b40 0x7f1514109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:12.709 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.706+0000 7f151a000700 1 --2- 172.21.15.160:0/2378036453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f151410ad40 0x7f151410b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:12.709 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.706+0000 7f151a000700 1 -- 172.21.15.160:0/2378036453 >> 172.21.15.160:0/2378036453 conn(0x7f1514078b10 msgr2=0x7f151407af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:38:12.709 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.706+0000 7f151a000700 1 -- 172.21.15.160:0/2378036453 shutdown_connections 2024-05-03T22:38:12.709 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.706+0000 7f151a000700 1 -- 172.21.15.160:0/2378036453 wait complete. 2024-05-03T22:38:12.711 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.707+0000 7f151a000700 1 Processor -- start 2024-05-03T22:38:12.712 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.707+0000 7f151a000700 1 -- start start 2024-05-03T22:38:12.712 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.708+0000 7f151a000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1514109b40 0x7f151419fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:12.712 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.708+0000 7f151a000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f151410ad40 0x7f15141a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:12.712 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.708+0000 7f151a000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f151410b6e0 0x7f15141a71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:12.712 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.708+0000 7f151a000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1514115700 con 0x7f151410ad40 2024-05-03T22:38:12.712 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.708+0000 7f151a000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1514115580 con 0x7f1514109b40 2024-05-03T22:38:12.712 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.708+0000 7f151a000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1514115880 con 0x7f151410b6e0 2024-05-03T22:38:12.712 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.708+0000 7f1513e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f151410b6e0 0x7f15141a71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:12.712 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.708+0000 7f1513e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f151410b6e0 0x7f15141a71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:56514/0 (socket says 172.21.15.160:56514) 2024-05-03T22:38:12.712 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.708+0000 7f1513e00700 1 -- 172.21.15.160:0/3371063208 learned_addr learned my addr 172.21.15.160:0/3371063208 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-03T22:38:12.712 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.708+0000 7f1513400700 1 --2- 172.21.15.160:0/3371063208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1514109b40 0x7f151419fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:12.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.709+0000 7f150be00700 1 --2- 172.21.15.160:0/3371063208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f151410ad40 0x7f15141a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:12.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.709+0000 7f1513e00700 1 -- 172.21.15.160:0/3371063208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1514109b40 msgr2=0x7f151419fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:12.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.709+0000 7f1513e00700 1 --2- 172.21.15.160:0/3371063208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1514109b40 0x7f151419fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:12.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.709+0000 7f1513e00700 1 -- 172.21.15.160:0/3371063208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f151410ad40 msgr2=0x7f15141a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:12.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.709+0000 7f1513e00700 1 --2- 172.21.15.160:0/3371063208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f151410ad40 0x7f15141a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:12.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.709+0000 7f1513e00700 1 -- 172.21.15.160:0/3371063208 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15141a78a0 con 0x7f151410b6e0 2024-05-03T22:38:12.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.709+0000 7f1513e00700 1 --2- 172.21.15.160:0/3371063208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f151410b6e0 0x7f15141a71d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f150c00b070 tx=0x7f150c00be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:38:12.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.709+0000 7f1510c00700 1 -- 172.21.15.160:0/3371063208 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c021070 con 0x7f151410b6e0 2024-05-03T22:38:12.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.709+0000 7f1510c00700 1 -- 172.21.15.160:0/3371063208 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f150c007d70 con 0x7f151410b6e0 2024-05-03T22:38:12.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.709+0000 7f151a000700 1 -- 172.21.15.160:0/3371063208 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15141a7b30 con 0x7f151410b6e0 2024-05-03T22:38:12.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.709+0000 7f1510c00700 1 -- 172.21.15.160:0/3371063208 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150c0048b0 con 0x7f151410b6e0 2024-05-03T22:38:12.713 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.710+0000 7f151a000700 1 -- 172.21.15.160:0/3371063208 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15141a7f80 con 0x7f151410b6e0 2024-05-03T22:38:12.714 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.711+0000 7f151a000700 1 -- 172.21.15.160:0/3371063208 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f151402e510 con 0x7f151410b6e0 2024-05-03T22:38:12.714 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.713+0000 7f1510c00700 1 -- 172.21.15.160:0/3371063208 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f150c004260 con 0x7f151410b6e0 2024-05-03T22:38:12.716 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.714+0000 7f1510c00700 1 --2- 172.21.15.160:0/3371063208 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f14f80b2880 0x7f14f80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:12.716 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.715+0000 7f1510c00700 1 -- 172.21.15.160:0/3371063208 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6694+0+0 (secure 0 0 0) 0x7f150c00f020 con 0x7f151410b6e0 2024-05-03T22:38:12.716 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.715+0000 7f1513400700 1 --2- 172.21.15.160:0/3371063208 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f14f80b2880 0x7f14f80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:12.718 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.716+0000 7f1513400700 1 --2- 172.21.15.160:0/3371063208 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f14f80b2880 0x7f14f80b4d40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1504005950 tx=0x7f15040058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:38:12.721 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.719+0000 7f1510c00700 1 -- 172.21.15.160:0/3371063208 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f150c0e8020 con 0x7f151410b6e0 2024-05-03T22:38:12.962 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:12.960+0000 7f151a000700 1 -- 172.21.15.160:0/3371063208 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f15140638e0 con 0x7f14f80b2880 2024-05-03T22:38:13.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:13 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:38:13.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:13 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:38:13.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:13 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:13.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:38:13.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:38:13.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:13.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:13 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-03T22:38:13.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:13 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-03T22:38:13.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:13 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:14.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:14 smithi160 ceph-mon[32531]: pgmap v298: 1 pgs: 1 peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:14.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:14 smithi160 ceph-mon[32531]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:38:14.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:14 smithi044 ceph-mon[28604]: pgmap v298: 1 pgs: 1 peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:14.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:14 smithi044 ceph-mon[28604]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:38:14.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:14 smithi060 ceph-mon[31721]: pgmap v298: 1 pgs: 1 peering; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:14.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:14 smithi060 ceph-mon[31721]: from='client.24376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:38:16.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:16 smithi044 ceph-mon[28604]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-05-03T22:38:16.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:16 smithi060 ceph-mon[31721]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-05-03T22:38:16.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:16 smithi160 ceph-mon[32531]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-05-03T22:38:17.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:17 smithi044 ceph-mon[28604]: from='client.? 172.21.15.160:0/3812794329' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6951585-9337-4b5a-a691-e765deb4b825"}]: dispatch 2024-05-03T22:38:17.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:17 smithi044 ceph-mon[28604]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6951585-9337-4b5a-a691-e765deb4b825"}]: dispatch 2024-05-03T22:38:17.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:17 smithi044 ceph-mon[28604]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b6951585-9337-4b5a-a691-e765deb4b825"}]': finished 2024-05-03T22:38:17.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:17 smithi044 ceph-mon[28604]: osdmap e67: 12 total, 11 up, 12 in 2024-05-03T22:38:17.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:17 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:38:17.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:17 smithi060 ceph-mon[31721]: from='client.? 172.21.15.160:0/3812794329' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6951585-9337-4b5a-a691-e765deb4b825"}]: dispatch 2024-05-03T22:38:17.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:17 smithi060 ceph-mon[31721]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6951585-9337-4b5a-a691-e765deb4b825"}]: dispatch 2024-05-03T22:38:17.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:17 smithi060 ceph-mon[31721]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b6951585-9337-4b5a-a691-e765deb4b825"}]': finished 2024-05-03T22:38:17.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:17 smithi060 ceph-mon[31721]: osdmap e67: 12 total, 11 up, 12 in 2024-05-03T22:38:17.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:17 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:38:17.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:17 smithi160 ceph-mon[32531]: from='client.? 172.21.15.160:0/3812794329' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6951585-9337-4b5a-a691-e765deb4b825"}]: dispatch 2024-05-03T22:38:17.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:17 smithi160 ceph-mon[32531]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b6951585-9337-4b5a-a691-e765deb4b825"}]: dispatch 2024-05-03T22:38:17.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:17 smithi160 ceph-mon[32531]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b6951585-9337-4b5a-a691-e765deb4b825"}]': finished 2024-05-03T22:38:17.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:17 smithi160 ceph-mon[32531]: osdmap e67: 12 total, 11 up, 12 in 2024-05-03T22:38:17.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:17 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:38:18.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:18 smithi044 ceph-mon[28604]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T22:38:18.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:18 smithi044 ceph-mon[28604]: from='client.? 172.21.15.160:0/3469739356' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:38:18.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:18 smithi060 ceph-mon[31721]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T22:38:18.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:18 smithi060 ceph-mon[31721]: from='client.? 172.21.15.160:0/3469739356' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:38:18.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:18 smithi160 ceph-mon[32531]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-03T22:38:18.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:18 smithi160 ceph-mon[32531]: from='client.? 172.21.15.160:0/3469739356' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-03T22:38:20.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:20 smithi160 ceph-mon[32531]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-05-03T22:38:20.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:20 smithi044 ceph-mon[28604]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-05-03T22:38:20.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:20 smithi060 ceph-mon[31721]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-05-03T22:38:22.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:22 smithi160 ceph-mon[32531]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:38:22.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:22 smithi044 ceph-mon[28604]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:38:22.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:22 smithi060 ceph-mon[31721]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:38:24.171 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:24 smithi160 ceph-mon[32531]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:38:24.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:24 smithi044 ceph-mon[28604]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:38:24.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:24 smithi060 ceph-mon[31721]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-03T22:38:26.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:26 smithi160 ceph-mon[32531]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:26.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:26 smithi044 ceph-mon[28604]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:26.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:26 smithi060 ceph-mon[31721]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:27.393 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-03T22:38:27.393 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:27 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:27.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-03T22:38:27.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:27 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:27.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-03T22:38:27.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:27 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:28.457 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:28 smithi160 ceph-mon[32531]: Deploying daemon osd.11 on smithi160 2024-05-03T22:38:28.457 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:28 smithi160 ceph-mon[32531]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:28.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:28 smithi044 ceph-mon[28604]: Deploying daemon osd.11 on smithi160 2024-05-03T22:38:28.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:28 smithi044 ceph-mon[28604]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:28.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:28 smithi060 ceph-mon[31721]: Deploying daemon osd.11 on smithi160 2024-05-03T22:38:28.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:28 smithi060 ceph-mon[31721]: pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:30.419 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:30 smithi160 ceph-mon[32531]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:30.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:30 smithi044 ceph-mon[28604]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:30.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:30 smithi060 ceph-mon[31721]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:32.143 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:32 smithi160 ceph-mon[32531]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:32.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:32 smithi044 ceph-mon[28604]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:32.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:32 smithi060 ceph-mon[31721]: pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:34.443 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:34 smithi160 ceph-mon[32531]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:34.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:34 smithi044 ceph-mon[28604]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:34.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:34 smithi060 ceph-mon[31721]: pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:36.096 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:35 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:36.096 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:35 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:36.096 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:35 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:38:36.096 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:35 smithi160 ceph-mon[32531]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:36.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:35 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:36.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:35 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:36.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:35 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:38:36.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:35 smithi044 ceph-mon[28604]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:35 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:35 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:35 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:38:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:35 smithi060 ceph-mon[31721]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:38.096 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:37 smithi160 ceph-mon[32531]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:38.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:37 smithi044 ceph-mon[28604]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:38.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:37 smithi060 ceph-mon[31721]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:39.632 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:39.630+0000 7f1510c00700 1 -- 172.21.15.160:0/3371063208 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f15140638e0 con 0x7f14f80b2880 2024-05-03T22:38:39.633 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 11 on host 'smithi160' 2024-05-03T22:38:39.636 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:39.634+0000 7f151a000700 1 -- 172.21.15.160:0/3371063208 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f14f80b2880 msgr2=0x7f14f80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:39.636 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:39.634+0000 7f151a000700 1 --2- 172.21.15.160:0/3371063208 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f14f80b2880 0x7f14f80b4d40 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1504005950 tx=0x7f15040058e0 comp rx=0 tx=0).stop 2024-05-03T22:38:39.636 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:39.634+0000 7f151a000700 1 -- 172.21.15.160:0/3371063208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f151410b6e0 msgr2=0x7f15141a71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:39.637 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:39.634+0000 7f151a000700 1 --2- 172.21.15.160:0/3371063208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f151410b6e0 0x7f15141a71d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f150c00b070 tx=0x7f150c00be20 comp rx=0 tx=0).stop 2024-05-03T22:38:39.637 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:39.635+0000 7f151a000700 1 -- 172.21.15.160:0/3371063208 shutdown_connections 2024-05-03T22:38:39.637 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:39.635+0000 7f151a000700 1 --2- 172.21.15.160:0/3371063208 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f14f80b2880 0x7f14f80b4d40 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:39.637 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:39.635+0000 7f151a000700 1 --2- 172.21.15.160:0/3371063208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f151410b6e0 0x7f15141a71d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:39.637 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:39.635+0000 7f151a000700 1 --2- 172.21.15.160:0/3371063208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1514109b40 0x7f151419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:39.637 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:39.635+0000 7f151a000700 1 --2- 172.21.15.160:0/3371063208 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f151410ad40 0x7f15141a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:39.638 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:39.635+0000 7f151a000700 1 -- 172.21.15.160:0/3371063208 >> 172.21.15.160:0/3371063208 conn(0x7f1514078b10 msgr2=0x7f151410e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:38:39.638 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:39.635+0000 7f151a000700 1 -- 172.21.15.160:0/3371063208 shutdown_connections 2024-05-03T22:38:39.638 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:39.635+0000 7f151a000700 1 -- 172.21.15.160:0/3371063208 wait complete. 2024-05-03T22:38:39.662 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:39 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:39.663 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:39 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:39.663 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:39 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:39.663 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:39 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:38:39.663 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:39 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:39.663 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:39 smithi160 ceph-mon[32531]: from='osd.11 [v2:172.21.15.160:6824/1397967755,v1:172.21.15.160:6825/1397967755]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-03T22:38:39.663 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:39 smithi160 ceph-mon[32531]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-03T22:38:39.663 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:39 smithi160 ceph-mon[32531]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:39.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:39 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:39.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:39 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:39.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:39 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:39.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:39 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:38:39.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:39 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:39.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:39 smithi044 ceph-mon[28604]: from='osd.11 [v2:172.21.15.160:6824/1397967755,v1:172.21.15.160:6825/1397967755]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-03T22:38:39.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:39 smithi044 ceph-mon[28604]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-03T22:38:39.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:39 smithi044 ceph-mon[28604]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:39.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:39 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:39.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:39 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:39.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:39 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:39.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:39 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:38:39.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:39 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:39.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:39 smithi060 ceph-mon[31721]: from='osd.11 [v2:172.21.15.160:6824/1397967755,v1:172.21.15.160:6825/1397967755]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-03T22:38:39.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:39 smithi060 ceph-mon[31721]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-03T22:38:39.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:39 smithi060 ceph-mon[31721]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:40.495 DEBUG:teuthology.orchestra.run.smithi160:osd.11> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.11.service 2024-05-03T22:38:40.500 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-03T22:38:40.500 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-03T22:38:40.745 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:40 smithi160 ceph-mon[32531]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-03T22:38:40.745 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:40 smithi160 ceph-mon[32531]: osdmap e68: 12 total, 11 up, 12 in 2024-05-03T22:38:40.745 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:40 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:38:40.745 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:40 smithi160 ceph-mon[32531]: from='osd.11 [v2:172.21.15.160:6824/1397967755,v1:172.21.15.160:6825/1397967755]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:38:40.745 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:40 smithi160 ceph-mon[32531]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:38:40.745 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:40 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:40.745 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:40 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:38:40.745 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:40 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:40.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:40 smithi044 ceph-mon[28604]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-03T22:38:40.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:40 smithi044 ceph-mon[28604]: osdmap e68: 12 total, 11 up, 12 in 2024-05-03T22:38:40.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:40 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:38:40.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:40 smithi044 ceph-mon[28604]: from='osd.11 [v2:172.21.15.160:6824/1397967755,v1:172.21.15.160:6825/1397967755]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:38:40.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:40 smithi044 ceph-mon[28604]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:38:40.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:40 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:40.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:40 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:38:40.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:40 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:40 smithi060 ceph-mon[31721]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-03T22:38:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:40 smithi060 ceph-mon[31721]: osdmap e68: 12 total, 11 up, 12 in 2024-05-03T22:38:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:40 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:38:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:40 smithi060 ceph-mon[31721]: from='osd.11 [v2:172.21.15.160:6824/1397967755,v1:172.21.15.160:6825/1397967755]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:38:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:40 smithi060 ceph-mon[31721]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2024-05-03T22:38:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:40 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:40 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:38:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:40 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:40.973 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:38:41.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:41 smithi044 ceph-mon[28604]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-03T22:38:41.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:41 smithi044 ceph-mon[28604]: osdmap e69: 12 total, 11 up, 12 in 2024-05-03T22:38:41.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:38:41.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:38:41.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:41 smithi044 ceph-mon[28604]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:41.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:41 smithi060 ceph-mon[31721]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-03T22:38:41.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:41 smithi060 ceph-mon[31721]: osdmap e69: 12 total, 11 up, 12 in 2024-05-03T22:38:41.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:38:41.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:38:41.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:41 smithi060 ceph-mon[31721]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:41.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:41 smithi160 ceph-mon[32531]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2024-05-03T22:38:41.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:41 smithi160 ceph-mon[32531]: osdmap e69: 12 total, 11 up, 12 in 2024-05-03T22:38:41.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:38:41.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:38:41.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:41 smithi160 ceph-mon[32531]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-03T22:38:42.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:42 smithi044 ceph-mon[28604]: purged_snaps scrub starts 2024-05-03T22:38:42.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:42 smithi044 ceph-mon[28604]: purged_snaps scrub ok 2024-05-03T22:38:42.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:42 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:38:42.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:42 smithi044 ceph-mon[28604]: osd.11 [v2:172.21.15.160:6824/1397967755,v1:172.21.15.160:6825/1397967755] boot 2024-05-03T22:38:42.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:42 smithi044 ceph-mon[28604]: osdmap e70: 12 total, 12 up, 12 in 2024-05-03T22:38:42.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:42 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:38:42.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:42 smithi060 ceph-mon[31721]: purged_snaps scrub starts 2024-05-03T22:38:42.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:42 smithi060 ceph-mon[31721]: purged_snaps scrub ok 2024-05-03T22:38:42.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:42 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:38:42.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:42 smithi060 ceph-mon[31721]: osd.11 [v2:172.21.15.160:6824/1397967755,v1:172.21.15.160:6825/1397967755] boot 2024-05-03T22:38:42.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:42 smithi060 ceph-mon[31721]: osdmap e70: 12 total, 12 up, 12 in 2024-05-03T22:38:42.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:42 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:38:42.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:42 smithi160 ceph-mon[32531]: purged_snaps scrub starts 2024-05-03T22:38:42.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:42 smithi160 ceph-mon[32531]: purged_snaps scrub ok 2024-05-03T22:38:42.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:42 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:38:42.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:42 smithi160 ceph-mon[32531]: osd.11 [v2:172.21.15.160:6824/1397967755,v1:172.21.15.160:6825/1397967755] boot 2024-05-03T22:38:42.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:42 smithi160 ceph-mon[32531]: osdmap e70: 12 total, 12 up, 12 in 2024-05-03T22:38:42.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:42 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-03T22:38:43.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.366+0000 7f3837e00700 1 -- 172.21.15.44:0/641150317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3838101090 msgr2=0x7f38381014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:43.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.366+0000 7f3837e00700 1 --2- 172.21.15.44:0/641150317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3838101090 0x7f38381014b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3828009990 tx=0x7f3828009ca0 comp rx=0 tx=0).stop 2024-05-03T22:38:43.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.366+0000 7f3837e00700 1 -- 172.21.15.44:0/641150317 shutdown_connections 2024-05-03T22:38:43.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.366+0000 7f3837e00700 1 --2- 172.21.15.44:0/641150317 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3838109110 0x7f383810b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:43.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.366+0000 7f3837e00700 1 --2- 172.21.15.44:0/641150317 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3838101090 0x7f38381014b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:43.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.366+0000 7f3837e00700 1 --2- 172.21.15.44:0/641150317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3838101a80 0x7f3838108bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:43.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.366+0000 7f3837e00700 1 -- 172.21.15.44:0/641150317 >> 172.21.15.44:0/641150317 conn(0x7f38380fcc20 msgr2=0x7f38380ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:38:43.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.366+0000 7f3837e00700 1 -- 172.21.15.44:0/641150317 shutdown_connections 2024-05-03T22:38:43.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.366+0000 7f3837e00700 1 -- 172.21.15.44:0/641150317 wait complete. 2024-05-03T22:38:43.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.367+0000 7f3837e00700 1 Processor -- start 2024-05-03T22:38:43.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.368+0000 7f3837e00700 1 -- start start 2024-05-03T22:38:43.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.368+0000 7f3837e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3838101090 0x7f38381044c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:43.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.368+0000 7f3837e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3838101a80 0x7f3838102b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:43.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.368+0000 7f3837e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3838109110 0x7f38381030a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:43.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.368+0000 7f3837e00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f383810f020 con 0x7f3838101090 2024-05-03T22:38:43.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.368+0000 7f3837e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f383810eea0 con 0x7f3838109110 2024-05-03T22:38:43.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.368+0000 7f3837e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f383810f1a0 con 0x7f3838101a80 2024-05-03T22:38:43.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.369+0000 7f3836a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3838101090 0x7f38381044c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:43.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.369+0000 7f3836a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3838101090 0x7f38381044c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59084/0 (socket says 172.21.15.44:59084) 2024-05-03T22:38:43.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.369+0000 7f3836a00700 1 -- 172.21.15.44:0/3481627883 learned_addr learned my addr 172.21.15.44:0/3481627883 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:38:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.369+0000 7f382e000700 1 --2- 172.21.15.44:0/3481627883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3838101a80 0x7f3838102b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.369+0000 7f3837400700 1 --2- 172.21.15.44:0/3481627883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3838109110 0x7f38381030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.369+0000 7f3836a00700 1 -- 172.21.15.44:0/3481627883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3838101a80 msgr2=0x7f3838102b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.369+0000 7f3836a00700 1 --2- 172.21.15.44:0/3481627883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3838101a80 0x7f3838102b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.369+0000 7f3836a00700 1 -- 172.21.15.44:0/3481627883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3838109110 msgr2=0x7f38381030a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.369+0000 7f3836a00700 1 --2- 172.21.15.44:0/3481627883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3838109110 0x7f38381030a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.369+0000 7f3836a00700 1 -- 172.21.15.44:0/3481627883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3838103970 con 0x7f3838101090 2024-05-03T22:38:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.369+0000 7f382e000700 1 --2- 172.21.15.44:0/3481627883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3838101a80 0x7f3838102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:38:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.370+0000 7f3836a00700 1 --2- 172.21.15.44:0/3481627883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3838101090 0x7f38381044c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3828005910 tx=0x7f3828009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:38:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.370+0000 7f382fe00700 1 -- 172.21.15.44:0/3481627883 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3828027070 con 0x7f3838101090 2024-05-03T22:38:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.370+0000 7f382fe00700 1 -- 172.21.15.44:0/3481627883 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f3828022470 con 0x7f3838101090 2024-05-03T22:38:43.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.370+0000 7f382fe00700 1 -- 172.21.15.44:0/3481627883 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f382800f6c0 con 0x7f3838101090 2024-05-03T22:38:43.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.370+0000 7f3837e00700 1 -- 172.21.15.44:0/3481627883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38381a36d0 con 0x7f3838101090 2024-05-03T22:38:43.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.370+0000 7f3837e00700 1 -- 172.21.15.44:0/3481627883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38381a3b30 con 0x7f3838101090 2024-05-03T22:38:43.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.372+0000 7f3837e00700 1 -- 172.21.15.44:0/3481627883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f383806a190 con 0x7f3838101090 2024-05-03T22:38:43.376 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.374+0000 7f382fe00700 1 -- 172.21.15.44:0/3481627883 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f382802a070 con 0x7f3838101090 2024-05-03T22:38:43.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.376+0000 7f382fe00700 1 --2- 172.21.15.44:0/3481627883 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f381c0b2900 0x7f381c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:43.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.376+0000 7f382fe00700 1 -- 172.21.15.44:0/3481627883 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f38280e2ed0 con 0x7f3838101090 2024-05-03T22:38:43.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.376+0000 7f382e000700 1 --2- 172.21.15.44:0/3481627883 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f381c0b2900 0x7f381c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:43.379 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.377+0000 7f382e000700 1 --2- 172.21.15.44:0/3481627883 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f381c0b2900 0x7f381c0b4dc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3820005950 tx=0x7f3820005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:38:43.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.378+0000 7f382fe00700 1 -- 172.21.15.44:0/3481627883 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f3828013070 con 0x7f3838101090 2024-05-03T22:38:43.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.619+0000 7f3837e00700 1 -- 172.21.15.44:0/3481627883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f383802e950 con 0x7f3838101090 2024-05-03T22:38:43.623 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.619+0000 7f382fe00700 1 -- 172.21.15.44:0/3481627883 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7f383802e950 con 0x7f3838101090 2024-05-03T22:38:43.624 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:38:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.622+0000 7f3837e00700 1 -- 172.21.15.44:0/3481627883 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f381c0b2900 msgr2=0x7f381c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.622+0000 7f3837e00700 1 --2- 172.21.15.44:0/3481627883 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f381c0b2900 0x7f381c0b4dc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3820005950 tx=0x7f3820005f50 comp rx=0 tx=0).stop 2024-05-03T22:38:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.622+0000 7f3837e00700 1 -- 172.21.15.44:0/3481627883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3838101090 msgr2=0x7f38381044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.622+0000 7f3837e00700 1 --2- 172.21.15.44:0/3481627883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3838101090 0x7f38381044c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3828005910 tx=0x7f3828009f90 comp rx=0 tx=0).stop 2024-05-03T22:38:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.623+0000 7f3837e00700 1 -- 172.21.15.44:0/3481627883 shutdown_connections 2024-05-03T22:38:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.623+0000 7f3837e00700 1 --2- 172.21.15.44:0/3481627883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3838109110 0x7f38381030a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.623+0000 7f3837e00700 1 --2- 172.21.15.44:0/3481627883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3838101090 0x7f38381044c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.623+0000 7f3837e00700 1 --2- 172.21.15.44:0/3481627883 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f381c0b2900 0x7f381c0b4dc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.623+0000 7f3837e00700 1 --2- 172.21.15.44:0/3481627883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3838101a80 0x7f3838102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.623+0000 7f3837e00700 1 -- 172.21.15.44:0/3481627883 >> 172.21.15.44:0/3481627883 conn(0x7f38380fcc20 msgr2=0x7f38380fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:38:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.623+0000 7f3837e00700 1 -- 172.21.15.44:0/3481627883 shutdown_connections 2024-05-03T22:38:43.626 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:43.623+0000 7f3837e00700 1 -- 172.21.15.44:0/3481627883 wait complete. 2024-05-03T22:38:43.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:43 smithi044 ceph-mon[28604]: osdmap e71: 12 total, 12 up, 12 in 2024-05-03T22:38:43.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:43 smithi044 ceph-mon[28604]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:43.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:43 smithi060 ceph-mon[31721]: osdmap e71: 12 total, 12 up, 12 in 2024-05-03T22:38:43.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:43 smithi060 ceph-mon[31721]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:43.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:43 smithi160 ceph-mon[32531]: osdmap e71: 12 total, 12 up, 12 in 2024-05-03T22:38:43.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:43 smithi160 ceph-mon[32531]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:44.723 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":71,"num_osds":12,"num_up_osds":12,"osd_up_since":1714775921,"num_in_osds":12,"osd_in_since":1714775896,"num_remapped_pgs":0} 2024-05-03T22:38:44.724 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:38:44.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:44 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3481627883' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-03T22:38:44.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:44 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3481627883' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-03T22:38:44.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:44 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3481627883' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-03T22:38:45.182 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:38:46.352 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:46 smithi044 ceph-mon[28604]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:46.352 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:46 smithi044 ceph-mon[28604]: Detected new or changed devices on smithi160 2024-05-03T22:38:46.352 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:46.352 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:46.353 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:46.353 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:46.353 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:46.353 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:46.353 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:46 smithi044 ceph-mon[28604]: Adjusting osd_memory_target on smithi160 to 4272M 2024-05-03T22:38:46.353 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:46.353 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:46.353 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:38:46.353 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:46.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:46 smithi060 ceph-mon[31721]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:46.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:46 smithi060 ceph-mon[31721]: Detected new or changed devices on smithi160 2024-05-03T22:38:46.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:46.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:46.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:46.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:46.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:46.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:46.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:46 smithi060 ceph-mon[31721]: Adjusting osd_memory_target on smithi160 to 4272M 2024-05-03T22:38:46.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:46.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:46.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:38:46.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:46.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:46 smithi160 ceph-mon[32531]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:46.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:46 smithi160 ceph-mon[32531]: Detected new or changed devices on smithi160 2024-05-03T22:38:46.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:46.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:46.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:46.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:46.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:46.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:38:46.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:46 smithi160 ceph-mon[32531]: Adjusting osd_memory_target on smithi160 to 4272M 2024-05-03T22:38:46.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:46.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:46.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:38:46.517 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:47.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.691+0000 7ff160200700 1 -- 172.21.15.44:0/1705565680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1581056c0 msgr2=0x7ff158105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:47.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.691+0000 7ff160200700 1 --2- 172.21.15.44:0/1705565680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1581056c0 0x7ff158105b40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff144009990 tx=0x7ff144009ca0 comp rx=0 tx=0).stop 2024-05-03T22:38:47.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.691+0000 7ff160200700 1 -- 172.21.15.44:0/1705565680 shutdown_connections 2024-05-03T22:38:47.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.691+0000 7ff160200700 1 --2- 172.21.15.44:0/1705565680 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff158106080 0x7ff158112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:47.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.691+0000 7ff160200700 1 --2- 172.21.15.44:0/1705565680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff15810b6c0 0x7ff15810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:47.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.691+0000 7ff160200700 1 --2- 172.21.15.44:0/1705565680 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff1581056c0 0x7ff158105b40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:47.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.691+0000 7ff160200700 1 -- 172.21.15.44:0/1705565680 >> 172.21.15.44:0/1705565680 conn(0x7ff1581011b0 msgr2=0x7ff1581035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:38:47.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.691+0000 7ff160200700 1 -- 172.21.15.44:0/1705565680 shutdown_connections 2024-05-03T22:38:47.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.691+0000 7ff160200700 1 -- 172.21.15.44:0/1705565680 wait complete. 2024-05-03T22:38:47.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.692+0000 7ff160200700 1 Processor -- start 2024-05-03T22:38:47.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.693+0000 7ff160200700 1 -- start start 2024-05-03T22:38:47.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.693+0000 7ff160200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1581056c0 0x7ff15819be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:47.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.693+0000 7ff160200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff158106080 0x7ff15819c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:47.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.693+0000 7ff160200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff15810b6c0 0x7ff1581a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:47.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.693+0000 7ff160200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff158115a70 con 0x7ff15810b6c0 2024-05-03T22:38:47.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.693+0000 7ff160200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff1581158f0 con 0x7ff1581056c0 2024-05-03T22:38:47.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.693+0000 7ff160200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff158115bf0 con 0x7ff158106080 2024-05-03T22:38:47.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.693+0000 7ff15e200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff15810b6c0 0x7ff1581a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:47.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.694+0000 7ff15e200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff15810b6c0 0x7ff1581a0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59112/0 (socket says 172.21.15.44:59112) 2024-05-03T22:38:47.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.694+0000 7ff15e200700 1 -- 172.21.15.44:0/3923691236 learned_addr learned my addr 172.21.15.44:0/3923691236 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:38:47.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.694+0000 7ff15ce00700 1 --2- 172.21.15.44:0/3923691236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff158106080 0x7ff15819c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:47.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.694+0000 7ff15d800700 1 --2- 172.21.15.44:0/3923691236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1581056c0 0x7ff15819be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:47.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.694+0000 7ff15e200700 1 -- 172.21.15.44:0/3923691236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff158106080 msgr2=0x7ff15819c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:47.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.694+0000 7ff15e200700 1 --2- 172.21.15.44:0/3923691236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff158106080 0x7ff15819c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:47.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.694+0000 7ff15e200700 1 -- 172.21.15.44:0/3923691236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1581056c0 msgr2=0x7ff15819be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:47.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.694+0000 7ff15e200700 1 --2- 172.21.15.44:0/3923691236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1581056c0 0x7ff15819be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:47.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.694+0000 7ff15e200700 1 -- 172.21.15.44:0/3923691236 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1581a0e70 con 0x7ff15810b6c0 2024-05-03T22:38:47.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.694+0000 7ff15d800700 1 --2- 172.21.15.44:0/3923691236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1581056c0 0x7ff15819be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:38:47.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.694+0000 7ff15e200700 1 --2- 172.21.15.44:0/3923691236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff15810b6c0 0x7ff1581a0730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff150007ee0 tx=0x7ff15000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:38:47.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.695+0000 7ff156000700 1 -- 172.21.15.44:0/3923691236 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15000dbd0 con 0x7ff15810b6c0 2024-05-03T22:38:47.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.695+0000 7ff156000700 1 -- 172.21.15.44:0/3923691236 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7ff15000dd70 con 0x7ff15810b6c0 2024-05-03T22:38:47.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.695+0000 7ff160200700 1 -- 172.21.15.44:0/3923691236 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1581a1160 con 0x7ff15810b6c0 2024-05-03T22:38:47.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.695+0000 7ff156000700 1 -- 172.21.15.44:0/3923691236 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1500133f0 con 0x7ff15810b6c0 2024-05-03T22:38:47.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.695+0000 7ff160200700 1 -- 172.21.15.44:0/3923691236 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1581a89e0 con 0x7ff15810b6c0 2024-05-03T22:38:47.699 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.696+0000 7ff160200700 1 -- 172.21.15.44:0/3923691236 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff15810dc50 con 0x7ff15810b6c0 2024-05-03T22:38:47.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.698+0000 7ff156000700 1 -- 172.21.15.44:0/3923691236 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff15001a020 con 0x7ff15810b6c0 2024-05-03T22:38:47.702 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.700+0000 7ff156000700 1 --2- 172.21.15.44:0/3923691236 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff1400b2880 0x7ff1400b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:47.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.700+0000 7ff156000700 1 -- 172.21.15.44:0/3923691236 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7ff1500e1b60 con 0x7ff15810b6c0 2024-05-03T22:38:47.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.700+0000 7ff15d800700 1 --2- 172.21.15.44:0/3923691236 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff1400b2880 0x7ff1400b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:47.703 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.701+0000 7ff15d800700 1 --2- 172.21.15.44:0/3923691236 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff1400b2880 0x7ff1400b4d40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff14c005e10 tx=0x7ff14c005d80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:38:47.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.703+0000 7ff156000700 1 -- 172.21.15.44:0/3923691236 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff150010070 con 0x7ff15810b6c0 2024-05-03T22:38:47.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.939+0000 7ff160200700 1 -- 172.21.15.44:0/3923691236 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff15810d630 con 0x7ff15810b6c0 2024-05-03T22:38:47.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.942+0000 7ff156000700 1 -- 172.21.15.44:0/3923691236 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+18396 (secure 0 0 0) 0x7ff1500a9c80 con 0x7ff15810b6c0 2024-05-03T22:38:47.945 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:38:47.946 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":71,"fsid":"5b0efdca-099c-11ef-bc97-c7b262605968","created":"2024-05-03T22:28:49.471963+0000","modified":"2024-05-03T22:38:42.458807+0000","last_up_change":"2024-05-03T22:38:41.446244+0000","last_in_change":"2024-05-03T22:38:16.952689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:33:24.956832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05869397-bdc9-4c38-b1c6-deb466454dd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6803","nonce":4219032560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6805","nonce":4219032560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6809","nonce":4219032560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6807","nonce":4219032560}]},"public_addr":"172.21.15.44:6803/4219032560","cluster_addr":"172.21.15.44:6805/4219032560","heartbeat_back_addr":"172.21.15.44:6809/4219032560","heartbeat_front_addr":"172.21.15.44:6807/4219032560","state":["exists","up"]},{"osd":1,"uuid":"ff61ca27-e36b-41c9-898f-1cd7af1d9db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6801","nonce":563003638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6803","nonce":563003638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6807","nonce":563003638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6805","nonce":563003638}]},"public_addr":"172.21.15.60:6801/563003638","cluster_addr":"172.21.15.60:6803/563003638","heartbeat_back_addr":"172.21.15.60:6807/563003638","heartbeat_front_addr":"172.21.15.60:6805/563003638","state":["exists","up"]},{"osd":2,"uuid":"e58f96dc-3486-452e-85a1-847a0e2c523a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6801","nonce":2524540447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6803","nonce":2524540447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6807","nonce":2524540447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6805","nonce":2524540447}]},"public_addr":"172.21.15.160:6801/2524540447","cluster_addr":"172.21.15.160:6803/2524540447","heartbeat_back_addr":"172.21.15.160:6807/2524540447","heartbeat_front_addr":"172.21.15.160:6805/2524540447","state":["exists","up"]},{"osd":3,"uuid":"75c56c3b-5807-4646-885c-1ef16541ff72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6811","nonce":3298926279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6813","nonce":3298926279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6817","nonce":3298926279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6815","nonce":3298926279}]},"public_addr":"172.21.15.44:6811/3298926279","cluster_addr":"172.21.15.44:6813/3298926279","heartbeat_back_addr":"172.21.15.44:6817/3298926279","heartbeat_front_addr":"172.21.15.44:6815/3298926279","state":["exists","up"]},{"osd":4,"uuid":"a8a322e4-6ca1-4727-8b41-5ff523acc591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6809","nonce":3794821539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6811","nonce":3794821539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6815","nonce":3794821539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6813","nonce":3794821539}]},"public_addr":"172.21.15.60:6809/3794821539","cluster_addr":"172.21.15.60:6811/3794821539","heartbeat_back_addr":"172.21.15.60:6815/3794821539","heartbeat_front_addr":"172.21.15.60:6813/3794821539","state":["exists","up"]},{"osd":5,"uuid":"bc718527-bacd-4d1b-90c6-758cbd859e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6809","nonce":429142335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6811","nonce":429142335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6815","nonce":429142335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6813","nonce":429142335}]},"public_addr":"172.21.15.160:6809/429142335","cluster_addr":"172.21.15.160:6811/429142335","heartbeat_back_addr":"172.21.15.160:6815/429142335","heartbeat_front_addr":"172.21.15.160:6813/429142335","state":["exists","up"]},{"osd":6,"uuid":"f95a1d05-a958-4e5c-a90a-6b0c3d9fad43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6819","nonce":2805326764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6821","nonce":2805326764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6825","nonce":2805326764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6823","nonce":2805326764}]},"public_addr":"172.21.15.44:6819/2805326764","cluster_addr":"172.21.15.44:6821/2805326764","heartbeat_back_addr":"172.21.15.44:6825/2805326764","heartbeat_front_addr":"172.21.15.44:6823/2805326764","state":["exists","up"]},{"osd":7,"uuid":"a515e4be-c607-4f4a-96bb-c3d395d7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6817","nonce":693512829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6819","nonce":693512829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6823","nonce":693512829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6821","nonce":693512829}]},"public_addr":"172.21.15.60:6817/693512829","cluster_addr":"172.21.15.60:6819/693512829","heartbeat_back_addr":"172.21.15.60:6823/693512829","heartbeat_front_addr":"172.21.15.60:6821/693512829","state":["exists","up"]},{"osd":8,"uuid":"717aeffb-6c51-4e4e-8344-fba70ac2c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6817","nonce":2920554498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6819","nonce":2920554498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6823","nonce":2920554498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6821","nonce":2920554498}]},"public_addr":"172.21.15.160:6817/2920554498","cluster_addr":"172.21.15.160:6819/2920554498","heartbeat_back_addr":"172.21.15.160:6823/2920554498","heartbeat_front_addr":"172.21.15.160:6821/2920554498","state":["exists","up"]},{"osd":9,"uuid":"ade31284-1246-42c8-9cee-e60dacc58a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6827","nonce":414763386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6829","nonce":414763386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6833","nonce":414763386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6831","nonce":414763386}]},"public_addr":"172.21.15.44:6827/414763386","cluster_addr":"172.21.15.44:6829/414763386","heartbeat_back_addr":"172.21.15.44:6833/414763386","heartbeat_front_addr":"172.21.15.44:6831/414763386","state":["exists","up"]},{"osd":10,"uuid":"e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6825","nonce":2396062554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6827","nonce":2396062554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6831","nonce":2396062554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6829","nonce":2396062554}]},"public_addr":"172.21.15.60:6825/2396062554","cluster_addr":"172.21.15.60:6827/2396062554","heartbeat_back_addr":"172.21.15.60:6831/2396062554","heartbeat_front_addr":"172.21.15.60:6829/2396062554","state":["exists","up"]},{"osd":11,"uuid":"b6951585-9337-4b5a-a691-e765deb4b825","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6825","nonce":1397967755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6827","nonce":1397967755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6831","nonce":1397967755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6829","nonce":1397967755}]},"public_addr":"172.21.15.160:6825/1397967755","cluster_addr":"172.21.15.160:6827/1397967755","heartbeat_back_addr":"172.21.15.160:6831/1397967755","heartbeat_front_addr":"172.21.15.160:6829/1397967755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:15.012060+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:48.390669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:21.227227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:56.388453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:34:31.079377+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:04.912058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:40.941904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:16.757849+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:51.591794+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:37:29.022917+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:05.506391+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:39.793901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2661810503":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3426728285":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/4246410673":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2328074241":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/1738155460":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3461866265":"2024-05-04T22:30:08.766919+0000","172.21.15.44:6800/950841500":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/950841500":"2024-05-04T22:29:32.846592+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:38:47.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.945+0000 7ff160200700 1 -- 172.21.15.44:0/3923691236 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff1400b2880 msgr2=0x7ff1400b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:47.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.945+0000 7ff160200700 1 --2- 172.21.15.44:0/3923691236 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff1400b2880 0x7ff1400b4d40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff14c005e10 tx=0x7ff14c005d80 comp rx=0 tx=0).stop 2024-05-03T22:38:47.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.946+0000 7ff160200700 1 -- 172.21.15.44:0/3923691236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff15810b6c0 msgr2=0x7ff1581a0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:47.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.946+0000 7ff160200700 1 --2- 172.21.15.44:0/3923691236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff15810b6c0 0x7ff1581a0730 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff150007ee0 tx=0x7ff15000d3b0 comp rx=0 tx=0).stop 2024-05-03T22:38:47.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.946+0000 7ff160200700 1 -- 172.21.15.44:0/3923691236 shutdown_connections 2024-05-03T22:38:47.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.946+0000 7ff160200700 1 --2- 172.21.15.44:0/3923691236 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff15810b6c0 0x7ff1581a0730 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:47.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.946+0000 7ff160200700 1 --2- 172.21.15.44:0/3923691236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1581056c0 0x7ff15819be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:47.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.946+0000 7ff160200700 1 --2- 172.21.15.44:0/3923691236 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff1400b2880 0x7ff1400b4d40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:47.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.946+0000 7ff160200700 1 --2- 172.21.15.44:0/3923691236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff158106080 0x7ff15819c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:47.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.946+0000 7ff160200700 1 -- 172.21.15.44:0/3923691236 >> 172.21.15.44:0/3923691236 conn(0x7ff1581011b0 msgr2=0x7ff158101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:38:47.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.946+0000 7ff160200700 1 -- 172.21.15.44:0/3923691236 shutdown_connections 2024-05-03T22:38:47.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:47.946+0000 7ff160200700 1 -- 172.21.15.44:0/3923691236 wait complete. 2024-05-03T22:38:48.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:48 smithi044 ceph-mon[28604]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:48.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:48 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3923691236' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:38:48.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:48 smithi060 ceph-mon[31721]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:48.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:48 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3923691236' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:38:48.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:48 smithi160 ceph-mon[32531]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:48.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:48 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3923691236' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:38:48.727 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-03T22:33:24.956832+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-03T22:38:48.728 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-03T22:38:49.238 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:38:50.443 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:50 smithi044 ceph-mon[28604]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:50.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:50 smithi060 ceph-mon[31721]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:50.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:50 smithi160 ceph-mon[32531]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:51.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.705+0000 7fc018800700 1 -- 172.21.15.44:0/179139111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc010106080 msgr2=0x7fc010112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:51.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.705+0000 7fc018800700 1 --2- 172.21.15.44:0/179139111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc010106080 0x7fc010112590 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00b0a0 tx=0x7fc00c00b3b0 comp rx=0 tx=0).stop 2024-05-03T22:38:51.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.705+0000 7fc018800700 1 -- 172.21.15.44:0/179139111 shutdown_connections 2024-05-03T22:38:51.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.705+0000 7fc018800700 1 --2- 172.21.15.44:0/179139111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc010106080 0x7fc010112590 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:51.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.705+0000 7fc018800700 1 --2- 172.21.15.44:0/179139111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc01010b6c0 0x7fc01010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:51.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.705+0000 7fc018800700 1 --2- 172.21.15.44:0/179139111 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0101056c0 0x7fc010105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:51.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.705+0000 7fc018800700 1 -- 172.21.15.44:0/179139111 >> 172.21.15.44:0/179139111 conn(0x7fc0101011b0 msgr2=0x7fc0101035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:38:51.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.705+0000 7fc018800700 1 -- 172.21.15.44:0/179139111 shutdown_connections 2024-05-03T22:38:51.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.706+0000 7fc018800700 1 -- 172.21.15.44:0/179139111 wait complete. 2024-05-03T22:38:51.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.707+0000 7fc018800700 1 Processor -- start 2024-05-03T22:38:51.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.707+0000 7fc018800700 1 -- start start 2024-05-03T22:38:51.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.707+0000 7fc018800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0101056c0 0x7fc0101123f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:51.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.707+0000 7fc018800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc010106080 0x7fc01010f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:51.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.707+0000 7fc018800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc01010b6c0 0x7fc01010fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:51.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.707+0000 7fc018800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc010115a10 con 0x7fc0101056c0 2024-05-03T22:38:51.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.707+0000 7fc018800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc010115890 con 0x7fc01010b6c0 2024-05-03T22:38:51.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.707+0000 7fc018800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc010115b90 con 0x7fc010106080 2024-05-03T22:38:51.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.708+0000 7fc015e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0101056c0 0x7fc0101123f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:51.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.708+0000 7fc015e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0101056c0 0x7fc0101123f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47008/0 (socket says 172.21.15.44:47008) 2024-05-03T22:38:51.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.708+0000 7fc015e00700 1 -- 172.21.15.44:0/1947467473 learned_addr learned my addr 172.21.15.44:0/1947467473 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:38:51.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.708+0000 7fc015400700 1 --2- 172.21.15.44:0/1947467473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc010106080 0x7fc01010f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:51.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.708+0000 7fc016800700 1 --2- 172.21.15.44:0/1947467473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc01010b6c0 0x7fc01010fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:51.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.708+0000 7fc015e00700 1 -- 172.21.15.44:0/1947467473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc010106080 msgr2=0x7fc01010f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:51.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.708+0000 7fc015e00700 1 --2- 172.21.15.44:0/1947467473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc010106080 0x7fc01010f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:51.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.708+0000 7fc015e00700 1 -- 172.21.15.44:0/1947467473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc01010b6c0 msgr2=0x7fc01010fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:51.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.708+0000 7fc015e00700 1 --2- 172.21.15.44:0/1947467473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc01010b6c0 0x7fc01010fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:51.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.708+0000 7fc015e00700 1 -- 172.21.15.44:0/1947467473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc010110300 con 0x7fc0101056c0 2024-05-03T22:38:51.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.709+0000 7fc015e00700 1 --2- 172.21.15.44:0/1947467473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0101056c0 0x7fc0101123f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc00400d950 tx=0x7fc00400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:38:51.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.709+0000 7fc00aa00700 1 -- 172.21.15.44:0/1947467473 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc004016070 con 0x7fc0101056c0 2024-05-03T22:38:51.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.709+0000 7fc00aa00700 1 -- 172.21.15.44:0/1947467473 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fc004009e10 con 0x7fc0101056c0 2024-05-03T22:38:51.712 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.709+0000 7fc018800700 1 -- 172.21.15.44:0/1947467473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0101ac850 con 0x7fc0101056c0 2024-05-03T22:38:51.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.709+0000 7fc00aa00700 1 -- 172.21.15.44:0/1947467473 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00400f620 con 0x7fc0101056c0 2024-05-03T22:38:51.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.709+0000 7fc018800700 1 -- 172.21.15.44:0/1947467473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0101acd60 con 0x7fc0101056c0 2024-05-03T22:38:51.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.711+0000 7fc018800700 1 -- 172.21.15.44:0/1947467473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc010106e00 con 0x7fc0101056c0 2024-05-03T22:38:51.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.713+0000 7fc00aa00700 1 -- 172.21.15.44:0/1947467473 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc004019070 con 0x7fc0101056c0 2024-05-03T22:38:51.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.714+0000 7fc00aa00700 1 --2- 172.21.15.44:0/1947467473 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fbff80b2880 0x7fbff80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:51.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.715+0000 7fc00aa00700 1 -- 172.21.15.44:0/1947467473 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fc0040e1920 con 0x7fc0101056c0 2024-05-03T22:38:51.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.715+0000 7fc015400700 1 --2- 172.21.15.44:0/1947467473 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fbff80b2880 0x7fbff80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:51.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.715+0000 7fc015400700 1 --2- 172.21.15.44:0/1947467473 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fbff80b2880 0x7fbff80b4d40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc010110c60 tx=0x7fc000009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:38:51.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.717+0000 7fc00aa00700 1 -- 172.21.15.44:0/1947467473 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc0040a9a40 con 0x7fc0101056c0 2024-05-03T22:38:51.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.951+0000 7fc018800700 1 -- 172.21.15.44:0/1947467473 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc01002e510 con 0x7fc0101056c0 2024-05-03T22:38:51.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.952+0000 7fc00aa00700 1 -- 172.21.15.44:0/1947467473 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) ==== 93+0+10 (secure 0 0 0) 0x7fc0040a9340 con 0x7fc0101056c0 2024-05-03T22:38:51.955 INFO:teuthology.orchestra.run.smithi044.stdout:pg_num: 1 2024-05-03T22:38:51.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.955+0000 7fc018800700 1 -- 172.21.15.44:0/1947467473 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fbff80b2880 msgr2=0x7fbff80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:51.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.955+0000 7fc018800700 1 --2- 172.21.15.44:0/1947467473 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fbff80b2880 0x7fbff80b4d40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc010110c60 tx=0x7fc000009260 comp rx=0 tx=0).stop 2024-05-03T22:38:51.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.955+0000 7fc018800700 1 -- 172.21.15.44:0/1947467473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0101056c0 msgr2=0x7fc0101123f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:51.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.955+0000 7fc018800700 1 --2- 172.21.15.44:0/1947467473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0101056c0 0x7fc0101123f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc00400d950 tx=0x7fc00400dc60 comp rx=0 tx=0).stop 2024-05-03T22:38:51.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.955+0000 7fc018800700 1 -- 172.21.15.44:0/1947467473 shutdown_connections 2024-05-03T22:38:51.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.955+0000 7fc018800700 1 --2- 172.21.15.44:0/1947467473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc01010b6c0 0x7fc01010fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:51.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.955+0000 7fc018800700 1 --2- 172.21.15.44:0/1947467473 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc0101056c0 0x7fc0101123f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:51.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.955+0000 7fc018800700 1 --2- 172.21.15.44:0/1947467473 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fbff80b2880 0x7fbff80b4d40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:51.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.955+0000 7fc018800700 1 --2- 172.21.15.44:0/1947467473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc010106080 0x7fc01010f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:51.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.955+0000 7fc018800700 1 -- 172.21.15.44:0/1947467473 >> 172.21.15.44:0/1947467473 conn(0x7fc0101011b0 msgr2=0x7fc010101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:38:51.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.956+0000 7fc018800700 1 -- 172.21.15.44:0/1947467473 shutdown_connections 2024-05-03T22:38:51.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:38:51.956+0000 7fc018800700 1 -- 172.21.15.44:0/1947467473 wait complete. 2024-05-03T22:38:52.214 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:52 smithi160 ceph-mon[32531]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:52.215 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:52 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1947467473' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-03T22:38:52.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:52 smithi044 ceph-mon[28604]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:52.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:52 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1947467473' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-03T22:38:52.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:52 smithi060 ceph-mon[31721]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:52.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:52 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1947467473' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-03T22:38:53.058 INFO:tasks.cephadm:Adding mds.a on smithi044 2024-05-03T22:38:53.058 INFO:tasks.cephadm:Adding mds.d on smithi044 2024-05-03T22:38:53.058 INFO:tasks.cephadm:Adding mds.g on smithi044 2024-05-03T22:38:53.058 INFO:tasks.cephadm:Adding mds.j on smithi044 2024-05-03T22:38:53.058 INFO:tasks.cephadm:Adding mds.b on smithi060 2024-05-03T22:38:53.058 INFO:tasks.cephadm:Adding mds.e on smithi060 2024-05-03T22:38:53.058 INFO:tasks.cephadm:Adding mds.h on smithi060 2024-05-03T22:38:53.058 INFO:tasks.cephadm:Adding mds.k on smithi060 2024-05-03T22:38:53.059 INFO:tasks.cephadm:Adding mds.c on smithi160 2024-05-03T22:38:53.059 INFO:tasks.cephadm:Adding mds.f on smithi160 2024-05-03T22:38:53.059 INFO:tasks.cephadm:Adding mds.i on smithi160 2024-05-03T22:38:53.059 INFO:tasks.cephadm:Adding mds.l on smithi160 2024-05-03T22:38:53.059 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph orch apply mds all '12;smithi044=a;smithi044=d;smithi044=g;smithi044=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l' 2024-05-03T22:38:53.476 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.c/config 2024-05-03T22:38:54.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:54 smithi160 ceph-mon[32531]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:54.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:54 smithi044 ceph-mon[28604]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:54.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:54 smithi060 ceph-mon[31721]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:55.762 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.760+0000 7f8a81000700 1 -- 172.21.15.160:0/1435604722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a7c10ac30 msgr2=0x7f8a7c10b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:55.763 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.760+0000 7f8a81000700 1 --2- 172.21.15.160:0/1435604722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a7c10ac30 0x7f8a7c10b090 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009990 tx=0x7f8a64009ca0 comp rx=0 tx=0).stop 2024-05-03T22:38:55.763 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.760+0000 7f8a81000700 1 -- 172.21.15.160:0/1435604722 shutdown_connections 2024-05-03T22:38:55.763 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.760+0000 7f8a81000700 1 --2- 172.21.15.160:0/1435604722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a7c10b5d0 0x7f8a7c111e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:55.763 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.760+0000 7f8a81000700 1 --2- 172.21.15.160:0/1435604722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a7c109a30 0x7f8a7c109e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:55.763 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.760+0000 7f8a81000700 1 --2- 172.21.15.160:0/1435604722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a7c10ac30 0x7f8a7c10b090 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:55.763 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.760+0000 7f8a81000700 1 -- 172.21.15.160:0/1435604722 >> 172.21.15.160:0/1435604722 conn(0x7f8a7c078a00 msgr2=0x7f8a7c07ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:38:55.763 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.760+0000 7f8a81000700 1 -- 172.21.15.160:0/1435604722 shutdown_connections 2024-05-03T22:38:55.763 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.760+0000 7f8a81000700 1 -- 172.21.15.160:0/1435604722 wait complete. 2024-05-03T22:38:55.765 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.761+0000 7f8a81000700 1 Processor -- start 2024-05-03T22:38:55.765 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.761+0000 7f8a81000700 1 -- start start 2024-05-03T22:38:55.765 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.762+0000 7f8a81000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a7c109a30 0x7f8a7c19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:55.765 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.762+0000 7f8a81000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a7c10ac30 0x7f8a7c1a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:55.765 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.762+0000 7f8a81000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a7c10b5d0 0x7f8a7c1a7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:55.766 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.762+0000 7f8a81000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c1156d0 con 0x7f8a7c10ac30 2024-05-03T22:38:55.766 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.762+0000 7f8a81000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c115550 con 0x7f8a7c10b5d0 2024-05-03T22:38:55.766 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.762+0000 7f8a81000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c115850 con 0x7f8a7c109a30 2024-05-03T22:38:55.766 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.762+0000 7f8a7b400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a7c109a30 0x7f8a7c19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:55.766 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.762+0000 7f8a7b400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a7c109a30 0x7f8a7c19fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:46884/0 (socket says 172.21.15.160:46884) 2024-05-03T22:38:55.766 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.762+0000 7f8a7b400700 1 -- 172.21.15.160:0/2100001021 learned_addr learned my addr 172.21.15.160:0/2100001021 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-05-03T22:38:55.766 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.762+0000 7f8a7be00700 1 --2- 172.21.15.160:0/2100001021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a7c10b5d0 0x7f8a7c1a7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:55.766 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.762+0000 7f8a73e00700 1 --2- 172.21.15.160:0/2100001021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a7c10ac30 0x7f8a7c1a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:55.766 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.763+0000 7f8a7b400700 1 -- 172.21.15.160:0/2100001021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a7c10b5d0 msgr2=0x7f8a7c1a7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:55.766 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.763+0000 7f8a7b400700 1 --2- 172.21.15.160:0/2100001021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a7c10b5d0 0x7f8a7c1a7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:55.766 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.763+0000 7f8a7b400700 1 -- 172.21.15.160:0/2100001021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a7c10ac30 msgr2=0x7f8a7c1a01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:55.766 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.763+0000 7f8a7b400700 1 --2- 172.21.15.160:0/2100001021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a7c10ac30 0x7f8a7c1a01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:55.766 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.763+0000 7f8a7b400700 1 -- 172.21.15.160:0/2100001021 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c1a7910 con 0x7f8a7c109a30 2024-05-03T22:38:55.767 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.763+0000 7f8a7be00700 1 --2- 172.21.15.160:0/2100001021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a7c10b5d0 0x7f8a7c1a7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:38:55.767 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.763+0000 7f8a7b400700 1 --2- 172.21.15.160:0/2100001021 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a7c109a30 0x7f8a7c19fc90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00b500 tx=0x7f8a6c00b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:38:55.767 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.763+0000 7f8a78c00700 1 -- 172.21.15.160:0/2100001021 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c015020 con 0x7f8a7c109a30 2024-05-03T22:38:55.767 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.763+0000 7f8a78c00700 1 -- 172.21.15.160:0/2100001021 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f8a6c011d00 con 0x7f8a7c109a30 2024-05-03T22:38:55.767 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.763+0000 7f8a81000700 1 -- 172.21.15.160:0/2100001021 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a7c1a7c00 con 0x7f8a7c109a30 2024-05-03T22:38:55.767 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.763+0000 7f8a78c00700 1 -- 172.21.15.160:0/2100001021 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c010e10 con 0x7f8a7c109a30 2024-05-03T22:38:55.767 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.764+0000 7f8a81000700 1 -- 172.21.15.160:0/2100001021 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a7c1a8140 con 0x7f8a7c109a30 2024-05-03T22:38:55.767 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.765+0000 7f8a81000700 1 -- 172.21.15.160:0/2100001021 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a7c06a190 con 0x7f8a7c109a30 2024-05-03T22:38:55.769 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.767+0000 7f8a78c00700 1 -- 172.21.15.160:0/2100001021 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f8a6c018020 con 0x7f8a7c109a30 2024-05-03T22:38:55.770 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.769+0000 7f8a78c00700 1 --2- 172.21.15.160:0/2100001021 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8a600b2900 0x7f8a600b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:38:55.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.769+0000 7f8a78c00700 1 -- 172.21.15.160:0/2100001021 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f8a6c0e1b70 con 0x7f8a7c109a30 2024-05-03T22:38:55.771 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.769+0000 7f8a73e00700 1 --2- 172.21.15.160:0/2100001021 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8a600b2900 0x7f8a600b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:38:55.772 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.771+0000 7f8a73e00700 1 --2- 172.21.15.160:0/2100001021 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8a600b2900 0x7f8a600b4dc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8a6400b5c0 tx=0x7f8a64005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:38:55.773 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:55.772+0000 7f8a78c00700 1 -- 172.21.15.160:0/2100001021 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8a6c01f020 con 0x7f8a7c109a30 2024-05-03T22:38:56.016 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:56.014+0000 7f8a81000700 1 -- 172.21.15.160:0/2100001021 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi044=a;smithi044=d;smithi044=g;smithi044=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}) -- 0x7f8a7c063ae0 con 0x7f8a600b2900 2024-05-03T22:38:56.034 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:56.032+0000 7f8a78c00700 1 -- 172.21.15.160:0/2100001021 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f8a7c063ae0 con 0x7f8a600b2900 2024-05-03T22:38:56.035 INFO:teuthology.orchestra.run.smithi160.stdout:Scheduled mds.all update... 2024-05-03T22:38:56.037 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:56.035+0000 7f8a81000700 1 -- 172.21.15.160:0/2100001021 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8a600b2900 msgr2=0x7f8a600b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:56.037 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:56.035+0000 7f8a81000700 1 --2- 172.21.15.160:0/2100001021 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8a600b2900 0x7f8a600b4dc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8a6400b5c0 tx=0x7f8a64005fd0 comp rx=0 tx=0).stop 2024-05-03T22:38:56.037 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:56.035+0000 7f8a81000700 1 -- 172.21.15.160:0/2100001021 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a7c109a30 msgr2=0x7f8a7c19fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:38:56.037 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:56.035+0000 7f8a81000700 1 --2- 172.21.15.160:0/2100001021 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a7c109a30 0x7f8a7c19fc90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00b500 tx=0x7f8a6c00b8c0 comp rx=0 tx=0).stop 2024-05-03T22:38:56.038 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:56.035+0000 7f8a81000700 1 -- 172.21.15.160:0/2100001021 shutdown_connections 2024-05-03T22:38:56.038 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:56.035+0000 7f8a81000700 1 --2- 172.21.15.160:0/2100001021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a7c10b5d0 0x7f8a7c1a7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:56.038 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:56.035+0000 7f8a81000700 1 --2- 172.21.15.160:0/2100001021 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8a600b2900 0x7f8a600b4dc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:56.038 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:56.035+0000 7f8a81000700 1 --2- 172.21.15.160:0/2100001021 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a7c109a30 0x7f8a7c19fc90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:56.038 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:56.035+0000 7f8a81000700 1 --2- 172.21.15.160:0/2100001021 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8a7c10ac30 0x7f8a7c1a01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:38:56.038 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:56.035+0000 7f8a81000700 1 -- 172.21.15.160:0/2100001021 >> 172.21.15.160:0/2100001021 conn(0x7f8a7c078a00 msgr2=0x7f8a7c10df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:38:56.038 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:56.035+0000 7f8a81000700 1 -- 172.21.15.160:0/2100001021 shutdown_connections 2024-05-03T22:38:56.038 INFO:teuthology.orchestra.run.smithi160.stderr:2024-05-03T22:38:56.036+0000 7f8a81000700 1 -- 172.21.15.160:0/2100001021 wait complete. 2024-05-03T22:38:56.482 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:56 smithi160 ceph-mon[32531]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:56.483 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:56 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:56.483 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:56 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:38:56.483 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:56 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:56.483 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:56 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:38:56.483 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:56 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:56.483 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:56 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:38:56.483 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:56 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:38:56.483 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:56 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:56 smithi044 ceph-mon[28604]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:56 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:56 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:38:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:56 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:56 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:38:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:56 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:56 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:38:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:56 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:38:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:56 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:56 smithi060 ceph-mon[31721]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:56 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:56 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:38:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:56 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:56 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:38:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:56 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:38:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:56 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:38:56.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:56 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:38:56.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:56 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:38:56.839 DEBUG:teuthology.orchestra.run.smithi044:mds.a> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.a.service 2024-05-03T22:38:56.847 DEBUG:teuthology.orchestra.run.smithi044:mds.d> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.d.service 2024-05-03T22:38:56.894 DEBUG:teuthology.orchestra.run.smithi044:mds.g> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.g.service 2024-05-03T22:38:56.940 DEBUG:teuthology.orchestra.run.smithi044:mds.j> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.j.service 2024-05-03T22:38:56.985 DEBUG:teuthology.orchestra.run.smithi060:mds.b> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.b.service 2024-05-03T22:38:56.993 DEBUG:teuthology.orchestra.run.smithi060:mds.e> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.e.service 2024-05-03T22:38:57.040 DEBUG:teuthology.orchestra.run.smithi060:mds.h> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.h.service 2024-05-03T22:38:57.086 DEBUG:teuthology.orchestra.run.smithi060:mds.k> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.k.service 2024-05-03T22:38:57.133 DEBUG:teuthology.orchestra.run.smithi160:mds.c> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.c.service 2024-05-03T22:38:57.141 DEBUG:teuthology.orchestra.run.smithi160:mds.f> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.f.service 2024-05-03T22:38:57.187 DEBUG:teuthology.orchestra.run.smithi160:mds.i> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.i.service 2024-05-03T22:38:57.233 DEBUG:teuthology.orchestra.run.smithi160:mds.l> sudo journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.l.service 2024-05-03T22:38:57.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:57 smithi044 ceph-mon[28604]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi044=a;smithi044=d;smithi044=g;smithi044=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:38:57.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:57 smithi044 ceph-mon[28604]: Saving service mds.all spec with placement smithi044=a;smithi044=d;smithi044=g;smithi044=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2024-05-03T22:38:57.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:57 smithi044 ceph-mon[28604]: Deploying daemon mds.l on smithi160 2024-05-03T22:38:57.279 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-03T22:38:57.280 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:38:57.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:57 smithi160 ceph-mon[32531]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi044=a;smithi044=d;smithi044=g;smithi044=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:38:57.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:57 smithi160 ceph-mon[32531]: Saving service mds.all spec with placement smithi044=a;smithi044=d;smithi044=g;smithi044=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2024-05-03T22:38:57.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:57 smithi160 ceph-mon[32531]: Deploying daemon mds.l on smithi160 2024-05-03T22:38:57.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:57 smithi060 ceph-mon[31721]: from='client.24418 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi044=a;smithi044=d;smithi044=g;smithi044=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:38:57.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:57 smithi060 ceph-mon[31721]: Saving service mds.all spec with placement smithi044=a;smithi044=d;smithi044=g;smithi044=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2024-05-03T22:38:57.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:57 smithi060 ceph-mon[31721]: Deploying daemon mds.l on smithi160 2024-05-03T22:38:57.742 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:38:58.182 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:38:58 smithi044 ceph-mon[28604]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:58.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:38:58 smithi160 ceph-mon[32531]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:58.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:38:58 smithi060 ceph-mon[31721]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:38:59.516 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 22:38:59 smithi160 systemd[1]: Starting Ceph mds.l for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T22:38:59.827 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 22:38:59 smithi160 podman[62636]: 2024-05-03 22:38:59.561969989 +0000 UTC m=+0.124861454 container create 7283b54e36480e164d7c7b44502256262227e04f607e5dc8f0a6c886d3367cb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-l, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:38:59.827 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 22:38:59 smithi160 podman[62636]: 2024-05-03 22:38:59.4726965 +0000 UTC m=+0.035587930 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:38:59.827 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 22:38:59 smithi160 podman[62636]: 2024-05-03 22:38:59.824507373 +0000 UTC m=+0.387398851 container init 7283b54e36480e164d7c7b44502256262227e04f607e5dc8f0a6c886d3367cb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-l, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:39:00.150 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 22:38:59 smithi160 podman[62636]: 2024-05-03 22:38:59.835228075 +0000 UTC m=+0.398119525 container start 7283b54e36480e164d7c7b44502256262227e04f607e5dc8f0a6c886d3367cb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-l, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2) 2024-05-03T22:39:00.150 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 22:38:59 smithi160 ceph-mds[62655]: -- 172.21.15.160:0/3677586056 <== mon.0 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560913fe1a40 con 0x560913fb4c00 2024-05-03T22:39:00.150 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 22:38:59 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-l[62651]: starting mds.l at 2024-05-03T22:39:00.150 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 22:38:59 smithi160 bash[62636]: 7283b54e36480e164d7c7b44502256262227e04f607e5dc8f0a6c886d3367cb2 2024-05-03T22:39:00.151 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 22:38:59 smithi160 systemd[1]: Started Ceph mds.l for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:39:00.205 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:00 smithi044 ceph-mon[28604]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:00.206 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:00 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.160:6832/2022701378,v1:172.21.15.160:6833/2022701378] up:boot 2024-05-03T22:39:00.206 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:00 smithi044 ceph-mon[28604]: fsmap 1 up:standby 2024-05-03T22:39:00.206 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:00 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-03T22:39:00.206 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:00 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:00.206 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:00 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:00.206 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:00 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:00.206 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:00 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:00.206 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:00 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:00.206 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:00 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:00.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.244+0000 7fd289800700 1 -- 172.21.15.44:0/81354958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2840756d0 msgr2=0x7fd284075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:00.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.244+0000 7fd289800700 1 --2- 172.21.15.44:0/81354958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2840756d0 0x7fd284075ab0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd274009990 tx=0x7fd274009ca0 comp rx=0 tx=0).stop 2024-05-03T22:39:00.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.245+0000 7fd289800700 1 -- 172.21.15.44:0/81354958 shutdown_connections 2024-05-03T22:39:00.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.245+0000 7fd289800700 1 --2- 172.21.15.44:0/81354958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd28410fea0 0x7fd284112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:00.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.245+0000 7fd289800700 1 --2- 172.21.15.44:0/81354958 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd2840756d0 0x7fd284075ab0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:00.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.245+0000 7fd289800700 1 --2- 172.21.15.44:0/81354958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd284075ff0 0x7fd28410f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:00.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.245+0000 7fd289800700 1 -- 172.21.15.44:0/81354958 >> 172.21.15.44:0/81354958 conn(0x7fd28407a600 msgr2=0x7fd28407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:00.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.245+0000 7fd289800700 1 -- 172.21.15.44:0/81354958 shutdown_connections 2024-05-03T22:39:00.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.245+0000 7fd289800700 1 -- 172.21.15.44:0/81354958 wait complete. 2024-05-03T22:39:00.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.246+0000 7fd289800700 1 Processor -- start 2024-05-03T22:39:00.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.246+0000 7fd289800700 1 -- start start 2024-05-03T22:39:00.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.247+0000 7fd289800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2840756d0 0x7fd28419bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:00.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.247+0000 7fd289800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd284075ff0 0x7fd28419c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:00.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.247+0000 7fd289800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd28410fea0 0x7fd2841a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:00.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.247+0000 7fd289800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd2841159c0 con 0x7fd28410fea0 2024-05-03T22:39:00.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.247+0000 7fd289800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd284115840 con 0x7fd284075ff0 2024-05-03T22:39:00.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.247+0000 7fd289800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd284115b40 con 0x7fd2840756d0 2024-05-03T22:39:00.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.247+0000 7fd283400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd28410fea0 0x7fd2841a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:00.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.247+0000 7fd282000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd284075ff0 0x7fd28419c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:00.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.247+0000 7fd283400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd28410fea0 0x7fd2841a0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43962/0 (socket says 172.21.15.44:43962) 2024-05-03T22:39:00.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.247+0000 7fd283400700 1 -- 172.21.15.44:0/1445855410 learned_addr learned my addr 172.21.15.44:0/1445855410 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:39:00.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.247+0000 7fd282a00700 1 --2- 172.21.15.44:0/1445855410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2840756d0 0x7fd28419bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:00.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.248+0000 7fd282000700 1 -- 172.21.15.44:0/1445855410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2840756d0 msgr2=0x7fd28419bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:00.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.248+0000 7fd282000700 1 --2- 172.21.15.44:0/1445855410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2840756d0 0x7fd28419bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:00.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.248+0000 7fd282000700 1 -- 172.21.15.44:0/1445855410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd28410fea0 msgr2=0x7fd2841a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:00.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.248+0000 7fd282000700 1 --2- 172.21.15.44:0/1445855410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd28410fea0 0x7fd2841a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:00.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.248+0000 7fd282000700 1 -- 172.21.15.44:0/1445855410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2841a0e90 con 0x7fd284075ff0 2024-05-03T22:39:00.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.248+0000 7fd282000700 1 --2- 172.21.15.44:0/1445855410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd284075ff0 0x7fd28419c410 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd27000d950 tx=0x7fd27000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:00.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.249+0000 7fd27b400700 1 -- 172.21.15.44:0/1445855410 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd270016070 con 0x7fd284075ff0 2024-05-03T22:39:00.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.249+0000 7fd289800700 1 -- 172.21.15.44:0/1445855410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2841a1180 con 0x7fd284075ff0 2024-05-03T22:39:00.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.249+0000 7fd27b400700 1 -- 172.21.15.44:0/1445855410 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fd27000fd60 con 0x7fd284075ff0 2024-05-03T22:39:00.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.249+0000 7fd27b400700 1 -- 172.21.15.44:0/1445855410 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27000e3b0 con 0x7fd284075ff0 2024-05-03T22:39:00.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.249+0000 7fd289800700 1 -- 172.21.15.44:0/1445855410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2841a8a00 con 0x7fd284075ff0 2024-05-03T22:39:00.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.250+0000 7fd289800700 1 -- 172.21.15.44:0/1445855410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd28406a190 con 0x7fd284075ff0 2024-05-03T22:39:00.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.254+0000 7fd27b400700 1 -- 172.21.15.44:0/1445855410 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd270019070 con 0x7fd284075ff0 2024-05-03T22:39:00.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.256+0000 7fd27b400700 1 --2- 172.21.15.44:0/1445855410 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd2680b2900 0x7fd2680b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:00.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.256+0000 7fd27b400700 1 -- 172.21.15.44:0/1445855410 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fd2700e1c50 con 0x7fd284075ff0 2024-05-03T22:39:00.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.256+0000 7fd282a00700 1 --2- 172.21.15.44:0/1445855410 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd2680b2900 0x7fd2680b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:00.258 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.257+0000 7fd282a00700 1 --2- 172.21.15.44:0/1445855410 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd2680b2900 0x7fd2680b4dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd274006010 tx=0x7fd27400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:00.269 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.268+0000 7fd27b400700 1 -- 172.21.15.44:0/1445855410 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd2700a9d70 con 0x7fd284075ff0 2024-05-03T22:39:00.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:00 smithi060 ceph-mon[31721]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:00.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:00 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.160:6832/2022701378,v1:172.21.15.160:6833/2022701378] up:boot 2024-05-03T22:39:00.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:00 smithi060 ceph-mon[31721]: fsmap 1 up:standby 2024-05-03T22:39:00.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:00 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-03T22:39:00.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:00 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:00.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:00 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:00.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:00 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:00.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:00 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:00.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:00 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:00.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:00 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:00.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:00 smithi160 ceph-mon[32531]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:00.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:00 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.160:6832/2022701378,v1:172.21.15.160:6833/2022701378] up:boot 2024-05-03T22:39:00.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:00 smithi160 ceph-mon[32531]: fsmap 1 up:standby 2024-05-03T22:39:00.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:00 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-03T22:39:00.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:00 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:00.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:00 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:00.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:00 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:00.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:00 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:00.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:00 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:00.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:00 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:00.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.568+0000 7fd289800700 1 -- 172.21.15.44:0/1445855410 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd28402e510 con 0x7fd284075ff0 2024-05-03T22:39:00.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.569+0000 7fd27b400700 1 -- 172.21.15.44:0/1445855410 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7fd2700a9670 con 0x7fd284075ff0 2024-05-03T22:39:00.571 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:39:00.571 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-03T22:39:00.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.573+0000 7fd289800700 1 -- 172.21.15.44:0/1445855410 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd2680b2900 msgr2=0x7fd2680b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:00.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.573+0000 7fd289800700 1 --2- 172.21.15.44:0/1445855410 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd2680b2900 0x7fd2680b4dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd274006010 tx=0x7fd27400b540 comp rx=0 tx=0).stop 2024-05-03T22:39:00.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.573+0000 7fd289800700 1 -- 172.21.15.44:0/1445855410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd284075ff0 msgr2=0x7fd28419c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:00.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.573+0000 7fd289800700 1 --2- 172.21.15.44:0/1445855410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd284075ff0 0x7fd28419c410 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd27000d950 tx=0x7fd27000dc60 comp rx=0 tx=0).stop 2024-05-03T22:39:00.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.573+0000 7fd289800700 1 -- 172.21.15.44:0/1445855410 shutdown_connections 2024-05-03T22:39:00.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.573+0000 7fd289800700 1 --2- 172.21.15.44:0/1445855410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd28410fea0 0x7fd2841a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:00.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.573+0000 7fd289800700 1 --2- 172.21.15.44:0/1445855410 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd2680b2900 0x7fd2680b4dc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:00.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.573+0000 7fd289800700 1 --2- 172.21.15.44:0/1445855410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2840756d0 0x7fd28419bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:00.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.573+0000 7fd289800700 1 --2- 172.21.15.44:0/1445855410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd284075ff0 0x7fd28419c410 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:00.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.573+0000 7fd289800700 1 -- 172.21.15.44:0/1445855410 >> 172.21.15.44:0/1445855410 conn(0x7fd28407a600 msgr2=0x7fd2841006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:00.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.573+0000 7fd289800700 1 -- 172.21.15.44:0/1445855410 shutdown_connections 2024-05-03T22:39:00.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:00.573+0000 7fd289800700 1 -- 172.21.15.44:0/1445855410 wait complete. 2024-05-03T22:39:00.576 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 2 2024-05-03T22:39:01.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:01 smithi044 ceph-mon[28604]: Deploying daemon mds.k on smithi060 2024-05-03T22:39:01.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:01 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1445855410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:01.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:01 smithi060 ceph-mon[31721]: Deploying daemon mds.k on smithi060 2024-05-03T22:39:01.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:01 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1445855410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:01.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:01 smithi160 ceph-mon[32531]: Deploying daemon mds.k on smithi060 2024-05-03T22:39:01.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:01 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1445855410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:02.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:02 smithi060 ceph-mon[31721]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:02.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:02 smithi044 ceph-mon[28604]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:02.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:02 smithi160 ceph-mon[32531]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:03.424 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:39:03.642 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 22:39:03 smithi060 systemd[1]: Starting Ceph mds.k for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T22:39:03.900 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:39:03.951 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 22:39:03 smithi060 podman[61537]: 2024-05-03 22:39:03.552620713 +0000 UTC m=+0.039446899 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:39:03.951 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 22:39:03 smithi060 podman[61537]: 2024-05-03 22:39:03.688128169 +0000 UTC m=+0.174954392 container create 76669e1cfdcc330f2fd0db366bc7f13d6db9ad959e3313faca2bf3f83395718f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-k, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD) 2024-05-03T22:39:03.951 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 22:39:03 smithi060 podman[61537]: 2024-05-03 22:39:03.949619501 +0000 UTC m=+0.436445714 container init 76669e1cfdcc330f2fd0db366bc7f13d6db9ad959e3313faca2bf3f83395718f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-k, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=) 2024-05-03T22:39:04.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:04 smithi060 ceph-mon[31721]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:04.256 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 22:39:03 smithi060 podman[61537]: 2024-05-03 22:39:03.959199047 +0000 UTC m=+0.446025244 container start 76669e1cfdcc330f2fd0db366bc7f13d6db9ad959e3313faca2bf3f83395718f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-k, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:39:04.256 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 22:39:04 smithi060 ceph-mds[61564]: -- 172.21.15.60:0/2551087896 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559eb6049a40 con 0x559eb601c800 2024-05-03T22:39:04.256 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 22:39:04 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-k[61555]: starting mds.k at 2024-05-03T22:39:04.256 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 22:39:04 smithi060 bash[61537]: 76669e1cfdcc330f2fd0db366bc7f13d6db9ad959e3313faca2bf3f83395718f 2024-05-03T22:39:04.256 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 22:39:04 smithi060 systemd[1]: Started Ceph mds.k for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:39:04.396 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:04 smithi044 ceph-mon[28604]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:04.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:04 smithi160 ceph-mon[32531]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:05.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:05 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] up:boot 2024-05-03T22:39:05.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:05 smithi044 ceph-mon[28604]: fsmap 2 up:standby 2024-05-03T22:39:05.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-03T22:39:05.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:05.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:05.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:05.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:05.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:05.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:05.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:05 smithi044 ceph-mon[28604]: Deploying daemon mds.j on smithi044 2024-05-03T22:39:05.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:05 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] up:boot 2024-05-03T22:39:05.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:05 smithi060 ceph-mon[31721]: fsmap 2 up:standby 2024-05-03T22:39:05.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-03T22:39:05.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:05.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:05.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:05.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:05.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:05.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:05.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:05 smithi060 ceph-mon[31721]: Deploying daemon mds.j on smithi044 2024-05-03T22:39:05.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:05 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] up:boot 2024-05-03T22:39:05.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:05 smithi160 ceph-mon[32531]: fsmap 2 up:standby 2024-05-03T22:39:05.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-03T22:39:05.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:05.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:05.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:05.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:05.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:05.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:05.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:05 smithi160 ceph-mon[32531]: Deploying daemon mds.j on smithi044 2024-05-03T22:39:06.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.075+0000 7f6149800700 1 -- 172.21.15.44:0/3207774003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6144108850 msgr2=0x7f61441103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:06.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.075+0000 7f6149800700 1 --2- 172.21.15.44:0/3207774003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6144108850 0x7f61441103d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f613c00b0d0 tx=0x7f613c00b3e0 comp rx=0 tx=0).stop 2024-05-03T22:39:06.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.075+0000 7f6149800700 1 -- 172.21.15.44:0/3207774003 shutdown_connections 2024-05-03T22:39:06.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.075+0000 7f6149800700 1 --2- 172.21.15.44:0/3207774003 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6144108850 0x7f61441103d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:06.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.075+0000 7f6149800700 1 --2- 172.21.15.44:0/3207774003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6144103750 0x7f6144103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:06.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.075+0000 7f6149800700 1 --2- 172.21.15.44:0/3207774003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6144104100 0x7f6144108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:06.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.075+0000 7f6149800700 1 -- 172.21.15.44:0/3207774003 >> 172.21.15.44:0/3207774003 conn(0x7f614407a600 msgr2=0x7f614407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:06.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.076+0000 7f6149800700 1 -- 172.21.15.44:0/3207774003 shutdown_connections 2024-05-03T22:39:06.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.076+0000 7f6149800700 1 -- 172.21.15.44:0/3207774003 wait complete. 2024-05-03T22:39:06.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.077+0000 7f6149800700 1 Processor -- start 2024-05-03T22:39:06.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.077+0000 7f6149800700 1 -- start start 2024-05-03T22:39:06.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.078+0000 7f6149800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6144103750 0x7f61440757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:06.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.078+0000 7f6149800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6144104100 0x7f6144075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:06.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.078+0000 7f6149800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6144108850 0x7f6144076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:06.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.078+0000 7f6149800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f61441137b0 con 0x7f6144108850 2024-05-03T22:39:06.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.078+0000 7f6149800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6144113630 con 0x7f6144104100 2024-05-03T22:39:06.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.078+0000 7f6149800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6144113930 con 0x7f6144103750 2024-05-03T22:39:06.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.078+0000 7f6143400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6144108850 0x7f6144076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:06.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.078+0000 7f6143400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6144108850 0x7f6144076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43982/0 (socket says 172.21.15.44:43982) 2024-05-03T22:39:06.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.078+0000 7f6143400700 1 -- 172.21.15.44:0/1571070375 learned_addr learned my addr 172.21.15.44:0/1571070375 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:39:06.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.079+0000 7f613be00700 1 --2- 172.21.15.44:0/1571070375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6144104100 0x7f6144075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:06.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.079+0000 7f6142a00700 1 --2- 172.21.15.44:0/1571070375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6144103750 0x7f61440757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:06.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.079+0000 7f6143400700 1 -- 172.21.15.44:0/1571070375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6144103750 msgr2=0x7f61440757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:06.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.079+0000 7f6143400700 1 --2- 172.21.15.44:0/1571070375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6144103750 0x7f61440757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:06.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.079+0000 7f6143400700 1 -- 172.21.15.44:0/1571070375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6144104100 msgr2=0x7f6144075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:06.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.079+0000 7f6143400700 1 --2- 172.21.15.44:0/1571070375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6144104100 0x7f6144075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:06.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.079+0000 7f6143400700 1 -- 172.21.15.44:0/1571070375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61441a80c0 con 0x7f6144108850 2024-05-03T22:39:06.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.080+0000 7f6143400700 1 --2- 172.21.15.44:0/1571070375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6144108850 0x7f6144076220 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f613c007980 tx=0x7f613c0079b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:06.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.080+0000 7f613b400700 1 -- 172.21.15.44:0/1571070375 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c01f070 con 0x7f6144108850 2024-05-03T22:39:06.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.080+0000 7f6149800700 1 -- 172.21.15.44:0/1571070375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61441a8350 con 0x7f6144108850 2024-05-03T22:39:06.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.080+0000 7f6149800700 1 -- 172.21.15.44:0/1571070375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61441a87a0 con 0x7f6144108850 2024-05-03T22:39:06.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.080+0000 7f613b400700 1 -- 172.21.15.44:0/1571070375 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f613c007e20 con 0x7f6144108850 2024-05-03T22:39:06.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.080+0000 7f613b400700 1 -- 172.21.15.44:0/1571070375 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613c01b6a0 con 0x7f6144108850 2024-05-03T22:39:06.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.082+0000 7f6149800700 1 -- 172.21.15.44:0/1571070375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f614406a190 con 0x7f6144108850 2024-05-03T22:39:06.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.084+0000 7f613b400700 1 -- 172.21.15.44:0/1571070375 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f613c022070 con 0x7f6144108850 2024-05-03T22:39:06.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.086+0000 7f613b400700 1 --2- 172.21.15.44:0/1571070375 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f61280b2900 0x7f61280b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:06.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.086+0000 7f613b400700 1 -- 172.21.15.44:0/1571070375 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f613c0e2d60 con 0x7f6144108850 2024-05-03T22:39:06.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.086+0000 7f6142a00700 1 --2- 172.21.15.44:0/1571070375 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f61280b2900 0x7f61280b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:06.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.087+0000 7f6142a00700 1 --2- 172.21.15.44:0/1571070375 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f61280b2900 0x7f61280b4dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6134005950 tx=0x7f613400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:06.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.089+0000 7f613b400700 1 -- 172.21.15.44:0/1571070375 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f613c0aafb0 con 0x7f6144108850 2024-05-03T22:39:06.408 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.406+0000 7f6149800700 1 -- 172.21.15.44:0/1571070375 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f614402e630 con 0x7f6144108850 2024-05-03T22:39:06.409 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.407+0000 7f613b400700 1 -- 172.21.15.44:0/1571070375 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2218 (secure 0 0 0) 0x7f613c0aa8b0 con 0x7f6144108850 2024-05-03T22:39:06.409 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:39:06.409 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34391,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/153110190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":153110190},{"type":"v1","addr":"172.21.15.60:6833","nonce":153110190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-03T22:39:06.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.410+0000 7f6149800700 1 -- 172.21.15.44:0/1571070375 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f61280b2900 msgr2=0x7f61280b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:06.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.410+0000 7f6149800700 1 --2- 172.21.15.44:0/1571070375 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f61280b2900 0x7f61280b4dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6134005950 tx=0x7f613400b410 comp rx=0 tx=0).stop 2024-05-03T22:39:06.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.410+0000 7f6149800700 1 -- 172.21.15.44:0/1571070375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6144108850 msgr2=0x7f6144076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:06.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.410+0000 7f6149800700 1 --2- 172.21.15.44:0/1571070375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6144108850 0x7f6144076220 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f613c007980 tx=0x7f613c0079b0 comp rx=0 tx=0).stop 2024-05-03T22:39:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.410+0000 7f6149800700 1 -- 172.21.15.44:0/1571070375 shutdown_connections 2024-05-03T22:39:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.410+0000 7f6149800700 1 --2- 172.21.15.44:0/1571070375 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6144108850 0x7f6144076220 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.410+0000 7f6149800700 1 --2- 172.21.15.44:0/1571070375 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f61280b2900 0x7f61280b4dc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.410+0000 7f6149800700 1 --2- 172.21.15.44:0/1571070375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6144103750 0x7f61440757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.410+0000 7f6149800700 1 --2- 172.21.15.44:0/1571070375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6144104100 0x7f6144075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.410+0000 7f6149800700 1 -- 172.21.15.44:0/1571070375 >> 172.21.15.44:0/1571070375 conn(0x7f614407a600 msgr2=0x7f61441072f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.410+0000 7f6149800700 1 -- 172.21.15.44:0/1571070375 shutdown_connections 2024-05-03T22:39:06.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:06.410+0000 7f6149800700 1 -- 172.21.15.44:0/1571070375 wait complete. 2024-05-03T22:39:06.413 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 3 2024-05-03T22:39:06.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:06 smithi044 ceph-mon[28604]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:06.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:06 smithi160 ceph-mon[32531]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:06.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:06 smithi060 ceph-mon[31721]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:07.594 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:07 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1571070375' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:07.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:07 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1571070375' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:07.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:07 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1571070375' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:08.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:08 smithi044 ceph-mon[28604]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:08.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:08 smithi060 ceph-mon[31721]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:08.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:08 smithi160 ceph-mon[32531]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:09.252 INFO:journalctl@ceph.mds.j.smithi044.stdout:May 03 22:39:08 smithi044 systemd[1]: Starting Ceph mds.j for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T22:39:09.529 INFO:journalctl@ceph.mds.j.smithi044.stdout:May 03 22:39:09 smithi044 podman[69533]: 2024-05-03 22:39:09.186357706 +0000 UTC m=+0.047828547 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:39:09.529 INFO:journalctl@ceph.mds.j.smithi044.stdout:May 03 22:39:09 smithi044 podman[69533]: 2024-05-03 22:39:09.336744745 +0000 UTC m=+0.198215606 container create 8b089bba3c0639917e8842fa574f73cb94d26d2f6898199ef022b4e060230b9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-j, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-03T22:39:10.001 INFO:journalctl@ceph.mds.j.smithi044.stdout:May 03 22:39:09 smithi044 podman[69533]: 2024-05-03 22:39:09.641439918 +0000 UTC m=+0.502910812 container init 8b089bba3c0639917e8842fa574f73cb94d26d2f6898199ef022b4e060230b9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD) 2024-05-03T22:39:10.002 INFO:journalctl@ceph.mds.j.smithi044.stdout:May 03 22:39:09 smithi044 podman[69533]: 2024-05-03 22:39:09.652208561 +0000 UTC m=+0.513679425 container start 8b089bba3c0639917e8842fa574f73cb94d26d2f6898199ef022b4e060230b9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-j, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-03T22:39:10.002 INFO:journalctl@ceph.mds.j.smithi044.stdout:May 03 22:39:09 smithi044 ceph-mds[69552]: -- 172.21.15.44:0/2859060932 <== mon.0 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ac242f1a40 con 0x55ac242c5000 2024-05-03T22:39:10.002 INFO:journalctl@ceph.mds.j.smithi044.stdout:May 03 22:39:09 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-j[69548]: starting mds.j at 2024-05-03T22:39:10.002 INFO:journalctl@ceph.mds.j.smithi044.stdout:May 03 22:39:09 smithi044 bash[69533]: 8b089bba3c0639917e8842fa574f73cb94d26d2f6898199ef022b4e060230b9f 2024-05-03T22:39:10.002 INFO:journalctl@ceph.mds.j.smithi044.stdout:May 03 22:39:09 smithi044 systemd[1]: Started Ceph mds.j for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:39:10.125 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:39:10.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:10 smithi044 ceph-mon[28604]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:10.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:10.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:10.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:10.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:10.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:10.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:10.559 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:10 smithi060 ceph-mon[31721]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:10.559 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:10.559 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:10.559 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:10.559 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:10.559 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:10.559 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:10.591 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:39:10.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:10 smithi160 ceph-mon[32531]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:10.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:10.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:10.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:10.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:10.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:10.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:11.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:11 smithi044 ceph-mon[28604]: Deploying daemon mds.d on smithi044 2024-05-03T22:39:11.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:11 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.44:6834/2550955759,v1:172.21.15.44:6835/2550955759] up:boot 2024-05-03T22:39:11.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:11 smithi044 ceph-mon[28604]: fsmap 3 up:standby 2024-05-03T22:39:11.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:11 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-03T22:39:11.575 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:11 smithi060 ceph-mon[31721]: Deploying daemon mds.d on smithi044 2024-05-03T22:39:11.575 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:11 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.44:6834/2550955759,v1:172.21.15.44:6835/2550955759] up:boot 2024-05-03T22:39:11.576 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:11 smithi060 ceph-mon[31721]: fsmap 3 up:standby 2024-05-03T22:39:11.576 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:11 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-03T22:39:11.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:11 smithi160 ceph-mon[32531]: Deploying daemon mds.d on smithi044 2024-05-03T22:39:11.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:11 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.44:6834/2550955759,v1:172.21.15.44:6835/2550955759] up:boot 2024-05-03T22:39:11.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:11 smithi160 ceph-mon[32531]: fsmap 3 up:standby 2024-05-03T22:39:11.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:11 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-03T22:39:12.665 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:12 smithi044 ceph-mon[28604]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:12.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:12 smithi060 ceph-mon[31721]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:12.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:12 smithi160 ceph-mon[32531]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:13.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:13 smithi044 ceph-mon[28604]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:13.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:13 smithi060 ceph-mon[31721]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:13.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:13 smithi160 ceph-mon[32531]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:14.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.010+0000 7fcefa200700 1 -- 172.21.15.44:0/1012614074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcef4103750 msgr2=0x7fcef4103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:14.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.010+0000 7fcefa200700 1 --2- 172.21.15.44:0/1012614074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcef4103750 0x7fcef4103b30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fcee400b0d0 tx=0x7fcee400b3e0 comp rx=0 tx=0).stop 2024-05-03T22:39:14.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.010+0000 7fcefa200700 1 -- 172.21.15.44:0/1012614074 shutdown_connections 2024-05-03T22:39:14.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.010+0000 7fcefa200700 1 --2- 172.21.15.44:0/1012614074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcef4108850 0x7fcef41103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:14.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.010+0000 7fcefa200700 1 --2- 172.21.15.44:0/1012614074 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcef4103750 0x7fcef4103b30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:14.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.010+0000 7fcefa200700 1 --2- 172.21.15.44:0/1012614074 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef4104100 0x7fcef4108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:14.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.010+0000 7fcefa200700 1 -- 172.21.15.44:0/1012614074 >> 172.21.15.44:0/1012614074 conn(0x7fcef407a600 msgr2=0x7fcef407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:14.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.010+0000 7fcefa200700 1 -- 172.21.15.44:0/1012614074 shutdown_connections 2024-05-03T22:39:14.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.010+0000 7fcefa200700 1 -- 172.21.15.44:0/1012614074 wait complete. 2024-05-03T22:39:14.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.012+0000 7fcefa200700 1 Processor -- start 2024-05-03T22:39:14.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.012+0000 7fcefa200700 1 -- start start 2024-05-03T22:39:14.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.012+0000 7fcefa200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcef4103750 0x7fcef40757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:14.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.012+0000 7fcefa200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef4104100 0x7fcef4075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:14.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.012+0000 7fcefa200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcef4108850 0x7fcef4076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:14.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.012+0000 7fcefa200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcef41137b0 con 0x7fcef4108850 2024-05-03T22:39:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.012+0000 7fcefa200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcef4113630 con 0x7fcef4104100 2024-05-03T22:39:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.012+0000 7fcefa200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcef4113930 con 0x7fcef4103750 2024-05-03T22:39:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.013+0000 7fcef3e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcef4108850 0x7fcef4076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.013+0000 7fcef3e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcef4108850 0x7fcef4076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39224/0 (socket says 172.21.15.44:39224) 2024-05-03T22:39:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.013+0000 7fcef3e00700 1 -- 172.21.15.44:0/2813021874 learned_addr learned my addr 172.21.15.44:0/2813021874 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:39:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.013+0000 7fcef3400700 1 --2- 172.21.15.44:0/2813021874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcef4103750 0x7fcef40757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.013+0000 7fceeaa00700 1 --2- 172.21.15.44:0/2813021874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef4104100 0x7fcef4075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.013+0000 7fcef3e00700 1 -- 172.21.15.44:0/2813021874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcef4103750 msgr2=0x7fcef40757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.013+0000 7fcef3e00700 1 --2- 172.21.15.44:0/2813021874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcef4103750 0x7fcef40757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.013+0000 7fcef3e00700 1 -- 172.21.15.44:0/2813021874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef4104100 msgr2=0x7fcef4075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.013+0000 7fcef3e00700 1 --2- 172.21.15.44:0/2813021874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef4104100 0x7fcef4075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:14.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.014+0000 7fcef3e00700 1 -- 172.21.15.44:0/2813021874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef41a8150 con 0x7fcef4108850 2024-05-03T22:39:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.014+0000 7fcef3e00700 1 --2- 172.21.15.44:0/2813021874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcef4108850 0x7fcef4076220 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fceec00d980 tx=0x7fceec00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.014+0000 7fcef0c00700 1 -- 172.21.15.44:0/2813021874 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec017070 con 0x7fcef4108850 2024-05-03T22:39:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.014+0000 7fcef0c00700 1 -- 172.21.15.44:0/2813021874 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fceec005020 con 0x7fcef4108850 2024-05-03T22:39:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.014+0000 7fcef0c00700 1 -- 172.21.15.44:0/2813021874 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec00fb30 con 0x7fcef4108850 2024-05-03T22:39:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.014+0000 7fcefa200700 1 -- 172.21.15.44:0/2813021874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcef41a8440 con 0x7fcef4108850 2024-05-03T22:39:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.015+0000 7fcefa200700 1 -- 172.21.15.44:0/2813021874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcef41a8930 con 0x7fcef4108850 2024-05-03T22:39:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.016+0000 7fcefa200700 1 -- 172.21.15.44:0/2813021874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcef410ba90 con 0x7fcef4108850 2024-05-03T22:39:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.019+0000 7fcef0c00700 1 -- 172.21.15.44:0/2813021874 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fceec00fcd0 con 0x7fcef4108850 2024-05-03T22:39:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.021+0000 7fcef0c00700 1 --2- 172.21.15.44:0/2813021874 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fced80b2880 0x7fced80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.022+0000 7fcef0c00700 1 -- 172.21.15.44:0/2813021874 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fceec0e1f10 con 0x7fcef4108850 2024-05-03T22:39:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.022+0000 7fcef3400700 1 --2- 172.21.15.44:0/2813021874 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fced80b2880 0x7fced80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.023+0000 7fcef3400700 1 --2- 172.21.15.44:0/2813021874 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fced80b2880 0x7fced80b4d40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcee400d010 tx=0x7fcee400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:14.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.025+0000 7fcef0c00700 1 -- 172.21.15.44:0/2813021874 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fceec020020 con 0x7fcef4108850 2024-05-03T22:39:14.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.327+0000 7fcefa200700 1 -- 172.21.15.44:0/2813021874 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcef406a190 con 0x7fcef4108850 2024-05-03T22:39:14.329 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.328+0000 7fcef0c00700 1 -- 172.21.15.44:0/2813021874 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3043 (secure 0 0 0) 0x7fceec0aa030 con 0x7fcef4108850 2024-05-03T22:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:39:14.330 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2550955759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2550955759},{"type":"v1","addr":"172.21.15.44:6835","nonce":2550955759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34391,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/153110190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":153110190},{"type":"v1","addr":"172.21.15.60:6833","nonce":153110190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-03T22:39:14.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.332+0000 7fcefa200700 1 -- 172.21.15.44:0/2813021874 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fced80b2880 msgr2=0x7fced80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:14.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.332+0000 7fcefa200700 1 --2- 172.21.15.44:0/2813021874 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fced80b2880 0x7fced80b4d40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcee400d010 tx=0x7fcee400b040 comp rx=0 tx=0).stop 2024-05-03T22:39:14.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.332+0000 7fcefa200700 1 -- 172.21.15.44:0/2813021874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcef4108850 msgr2=0x7fcef4076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:14.333 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.332+0000 7fcefa200700 1 --2- 172.21.15.44:0/2813021874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcef4108850 0x7fcef4076220 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fceec00d980 tx=0x7fceec00dc90 comp rx=0 tx=0).stop 2024-05-03T22:39:14.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.332+0000 7fcefa200700 1 -- 172.21.15.44:0/2813021874 shutdown_connections 2024-05-03T22:39:14.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.332+0000 7fcefa200700 1 --2- 172.21.15.44:0/2813021874 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcef4108850 0x7fcef4076220 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:14.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.332+0000 7fcefa200700 1 --2- 172.21.15.44:0/2813021874 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fced80b2880 0x7fced80b4d40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:14.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.332+0000 7fcefa200700 1 --2- 172.21.15.44:0/2813021874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcef4103750 0x7fcef40757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:14.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.332+0000 7fcefa200700 1 --2- 172.21.15.44:0/2813021874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef4104100 0x7fcef4075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:14.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.332+0000 7fcefa200700 1 -- 172.21.15.44:0/2813021874 >> 172.21.15.44:0/2813021874 conn(0x7fcef407a600 msgr2=0x7fcef4102cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:14.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.332+0000 7fcefa200700 1 -- 172.21.15.44:0/2813021874 shutdown_connections 2024-05-03T22:39:14.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:14.332+0000 7fcefa200700 1 -- 172.21.15.44:0/2813021874 wait complete. 2024-05-03T22:39:14.335 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 4 2024-05-03T22:39:14.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:14 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2813021874' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:14.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:14 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2813021874' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:14.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:14 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2813021874' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:15.253 INFO:journalctl@ceph.mds.d.smithi044.stdout:May 03 22:39:15 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-d[70005]: starting mds.d at 2024-05-03T22:39:15.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:15 smithi044 ceph-mon[28604]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:15.752 INFO:journalctl@ceph.mds.d.smithi044.stdout:May 03 22:39:15 smithi044 bash[69975]: 8cc7f2b267219f52ee57107964277921ef86854ff9ec906a76b3519ae039020f 2024-05-03T22:39:15.752 INFO:journalctl@ceph.mds.d.smithi044.stdout:May 03 22:39:15 smithi044 systemd[1]: Started Ceph mds.d for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:39:15.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:15 smithi060 ceph-mon[31721]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:15.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:15 smithi160 ceph-mon[32531]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:16.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:16 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.44:6836/3118490782,v1:172.21.15.44:6837/3118490782] up:boot 2024-05-03T22:39:16.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:16 smithi044 ceph-mon[28604]: fsmap 4 up:standby 2024-05-03T22:39:16.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:16 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-03T22:39:16.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:16 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:16.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:16 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:16.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:16 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:16.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:16 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:16.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:16 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:16.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:16 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:16.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:16 smithi044 ceph-mon[28604]: Deploying daemon mds.e on smithi060 2024-05-03T22:39:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:16 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.44:6836/3118490782,v1:172.21.15.44:6837/3118490782] up:boot 2024-05-03T22:39:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:16 smithi060 ceph-mon[31721]: fsmap 4 up:standby 2024-05-03T22:39:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:16 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-03T22:39:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:16 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:16 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:16 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:16 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:16 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:16 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:16 smithi060 ceph-mon[31721]: Deploying daemon mds.e on smithi060 2024-05-03T22:39:16.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:16 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.44:6836/3118490782,v1:172.21.15.44:6837/3118490782] up:boot 2024-05-03T22:39:16.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:16 smithi160 ceph-mon[32531]: fsmap 4 up:standby 2024-05-03T22:39:16.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:16 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-03T22:39:16.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:16 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:16.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:16 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:16.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:16 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:16.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:16 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:16.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:16 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:16.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:16 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:16.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:16 smithi160 ceph-mon[32531]: Deploying daemon mds.e on smithi060 2024-05-03T22:39:17.475 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:39:17.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:17 smithi060 ceph-mon[31721]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:17.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:17 smithi044 ceph-mon[28604]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:17.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:17 smithi160 ceph-mon[32531]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:17.980 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:39:19.255 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 22:39:18 smithi060 systemd[1]: Starting Ceph mds.e for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T22:39:19.708 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 22:39:19 smithi060 podman[61848]: 2024-05-03 22:39:19.262249549 +0000 UTC m=+0.035732626 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:39:19.709 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 22:39:19 smithi060 podman[61848]: 2024-05-03 22:39:19.410814953 +0000 UTC m=+0.184298061 container create 884b783230cfa19fe0d054042753d708244be50f132d1a6a13169a63ad570da3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-03T22:39:19.709 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 22:39:19 smithi060 podman[61848]: 2024-05-03 22:39:19.706555894 +0000 UTC m=+0.480039008 container init 884b783230cfa19fe0d054042753d708244be50f132d1a6a13169a63ad570da3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-e, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-03T22:39:20.004 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 22:39:19 smithi060 podman[61848]: 2024-05-03 22:39:19.717532147 +0000 UTC m=+0.491015262 container start 884b783230cfa19fe0d054042753d708244be50f132d1a6a13169a63ad570da3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430) 2024-05-03T22:39:20.004 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 22:39:19 smithi060 ceph-mds[61867]: -- 172.21.15.60:0/3229908017 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bcaea7ba40 con 0x55bcaea4ec00 2024-05-03T22:39:20.004 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 22:39:19 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-e[61863]: starting mds.e at 2024-05-03T22:39:20.004 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 22:39:19 smithi060 bash[61848]: 884b783230cfa19fe0d054042753d708244be50f132d1a6a13169a63ad570da3 2024-05-03T22:39:20.004 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 22:39:19 smithi060 systemd[1]: Started Ceph mds.e for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:39:20.085 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:20 smithi044 ceph-mon[28604]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:20.085 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:20 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:20.086 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:20 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:20.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:20 smithi060 ceph-mon[31721]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:20.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:20 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:20.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:20 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:20.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:20 smithi160 ceph-mon[32531]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:20.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:20 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:20.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:20 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.416+0000 7f35f5600700 1 -- 172.21.15.44:0/3383802939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35f010b6e0 msgr2=0x7f35f010bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.416+0000 7f35f5600700 1 --2- 172.21.15.44:0/3383802939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35f010b6e0 0x7f35f010bac0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009990 tx=0x7f35e0009ca0 comp rx=0 tx=0).stop 2024-05-03T22:39:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.416+0000 7f35f5600700 1 -- 172.21.15.44:0/3383802939 shutdown_connections 2024-05-03T22:39:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.416+0000 7f35f5600700 1 --2- 172.21.15.44:0/3383802939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35f01060a0 0x7f35f01125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.416+0000 7f35f5600700 1 --2- 172.21.15.44:0/3383802939 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35f010b6e0 0x7f35f010bac0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.416+0000 7f35f5600700 1 --2- 172.21.15.44:0/3383802939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35f01056e0 0x7f35f0105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.416+0000 7f35f5600700 1 -- 172.21.15.44:0/3383802939 >> 172.21.15.44:0/3383802939 conn(0x7f35f01011d0 msgr2=0x7f35f01035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.416+0000 7f35f5600700 1 -- 172.21.15.44:0/3383802939 shutdown_connections 2024-05-03T22:39:20.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.416+0000 7f35f5600700 1 -- 172.21.15.44:0/3383802939 wait complete. 2024-05-03T22:39:20.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.417+0000 7f35f5600700 1 Processor -- start 2024-05-03T22:39:20.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.417+0000 7f35f5600700 1 -- start start 2024-05-03T22:39:20.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.418+0000 7f35f5600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35f01056e0 0x7f35f019be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:20.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.418+0000 7f35f5600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35f01060a0 0x7f35f019c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:20.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.418+0000 7f35f5600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35f010b6e0 0x7f35f01a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:20.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.418+0000 7f35f5600700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f35f0115a30 con 0x7f35f010b6e0 2024-05-03T22:39:20.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.418+0000 7f35f5600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f35f01158b0 con 0x7f35f01056e0 2024-05-03T22:39:20.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.418+0000 7f35f5600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f35f0115bb0 con 0x7f35f01060a0 2024-05-03T22:39:20.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.418+0000 7f35ef400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35f010b6e0 0x7f35f01a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:20.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.418+0000 7f35ef400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35f010b6e0 0x7f35f01a06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41362/0 (socket says 172.21.15.44:41362) 2024-05-03T22:39:20.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.418+0000 7f35ef400700 1 -- 172.21.15.44:0/3556097258 learned_addr learned my addr 172.21.15.44:0/3556097258 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:39:20.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.418+0000 7f35e7e00700 1 --2- 172.21.15.44:0/3556097258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35f01060a0 0x7f35f019c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:20.420 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.418+0000 7f35eea00700 1 --2- 172.21.15.44:0/3556097258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35f01056e0 0x7f35f019be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:20.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.419+0000 7f35ef400700 1 -- 172.21.15.44:0/3556097258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35f01060a0 msgr2=0x7f35f019c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:20.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.419+0000 7f35ef400700 1 --2- 172.21.15.44:0/3556097258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35f01060a0 0x7f35f019c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:20.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.419+0000 7f35ef400700 1 -- 172.21.15.44:0/3556097258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35f01056e0 msgr2=0x7f35f019be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:20.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.419+0000 7f35ef400700 1 --2- 172.21.15.44:0/3556097258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35f01056e0 0x7f35f019be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:20.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.419+0000 7f35ef400700 1 -- 172.21.15.44:0/3556097258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f01a0e10 con 0x7f35f010b6e0 2024-05-03T22:39:20.421 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.419+0000 7f35ef400700 1 --2- 172.21.15.44:0/3556097258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35f010b6e0 0x7f35f01a06d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f35e8007ee0 tx=0x7f35e800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:20.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.419+0000 7f35e7400700 1 -- 172.21.15.44:0/3556097258 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8004bb0 con 0x7f35f010b6e0 2024-05-03T22:39:20.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.419+0000 7f35e7400700 1 -- 172.21.15.44:0/3556097258 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f35e8004d50 con 0x7f35f010b6e0 2024-05-03T22:39:20.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.419+0000 7f35f5600700 1 -- 172.21.15.44:0/3556097258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f01a1100 con 0x7f35f010b6e0 2024-05-03T22:39:20.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.419+0000 7f35e7400700 1 -- 172.21.15.44:0/3556097258 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8005950 con 0x7f35f010b6e0 2024-05-03T22:39:20.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.419+0000 7f35f5600700 1 -- 172.21.15.44:0/3556097258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f01a8980 con 0x7f35f010b6e0 2024-05-03T22:39:20.422 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.421+0000 7f35f5600700 1 -- 172.21.15.44:0/3556097258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35f006a190 con 0x7f35f010b6e0 2024-05-03T22:39:20.424 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.423+0000 7f35e7400700 1 -- 172.21.15.44:0/3556097258 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f35e801a020 con 0x7f35f010b6e0 2024-05-03T22:39:20.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.425+0000 7f35e7400700 1 --2- 172.21.15.44:0/3556097258 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f35d40b2880 0x7f35d40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:20.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.425+0000 7f35e7400700 1 -- 172.21.15.44:0/3556097258 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f35e80e1480 con 0x7f35f010b6e0 2024-05-03T22:39:20.426 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.425+0000 7f35eea00700 1 --2- 172.21.15.44:0/3556097258 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f35d40b2880 0x7f35d40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:20.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.426+0000 7f35eea00700 1 --2- 172.21.15.44:0/3556097258 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f35d40b2880 0x7f35d40b4d40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f35e000b5c0 tx=0x7f35e0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:20.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.430+0000 7f35e7400700 1 -- 172.21.15.44:0/3556097258 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f35e8010070 con 0x7f35f010b6e0 2024-05-03T22:39:20.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.716+0000 7f35f5600700 1 -- 172.21.15.44:0/3556097258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35f01a8b50 con 0x7f35f010b6e0 2024-05-03T22:39:20.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.717+0000 7f35e7400700 1 -- 172.21.15.44:0/3556097258 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4693 (secure 0 0 0) 0x7f35e80a95a0 con 0x7f35f010b6e0 2024-05-03T22:39:20.718 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:39:20.718 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2550955759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2550955759},{"type":"v1","addr":"172.21.15.44:6835","nonce":2550955759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3118490782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3118490782},{"type":"v1","addr":"172.21.15.44:6837","nonce":3118490782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34391,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/153110190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":153110190},{"type":"v1","addr":"172.21.15.60:6833","nonce":153110190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34409,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3390425489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3390425489},{"type":"v1","addr":"172.21.15.60:6835","nonce":3390425489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-03T22:39:20.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.720+0000 7f35f5600700 1 -- 172.21.15.44:0/3556097258 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f35d40b2880 msgr2=0x7f35d40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:20.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.720+0000 7f35f5600700 1 --2- 172.21.15.44:0/3556097258 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f35d40b2880 0x7f35d40b4d40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f35e000b5c0 tx=0x7f35e0005fd0 comp rx=0 tx=0).stop 2024-05-03T22:39:20.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.720+0000 7f35f5600700 1 -- 172.21.15.44:0/3556097258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35f010b6e0 msgr2=0x7f35f01a06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:20.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.720+0000 7f35f5600700 1 --2- 172.21.15.44:0/3556097258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35f010b6e0 0x7f35f01a06d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f35e8007ee0 tx=0x7f35e800d3b0 comp rx=0 tx=0).stop 2024-05-03T22:39:20.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.720+0000 7f35f5600700 1 -- 172.21.15.44:0/3556097258 shutdown_connections 2024-05-03T22:39:20.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.720+0000 7f35f5600700 1 --2- 172.21.15.44:0/3556097258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35f010b6e0 0x7f35f01a06d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:20.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.720+0000 7f35f5600700 1 --2- 172.21.15.44:0/3556097258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35f01056e0 0x7f35f019be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:20.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.720+0000 7f35f5600700 1 --2- 172.21.15.44:0/3556097258 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f35d40b2880 0x7f35d40b4d40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:20.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.720+0000 7f35f5600700 1 --2- 172.21.15.44:0/3556097258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35f01060a0 0x7f35f019c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:20.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.720+0000 7f35f5600700 1 -- 172.21.15.44:0/3556097258 >> 172.21.15.44:0/3556097258 conn(0x7f35f01011d0 msgr2=0x7f35f0101670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:20.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.721+0000 7f35f5600700 1 -- 172.21.15.44:0/3556097258 shutdown_connections 2024-05-03T22:39:20.723 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:20.721+0000 7f35f5600700 1 -- 172.21.15.44:0/3556097258 wait complete. 2024-05-03T22:39:20.723 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 6 2024-05-03T22:39:21.245 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:21 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] up:boot 2024-05-03T22:39:21.245 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:21 smithi160 ceph-mon[32531]: fsmap 5 up:standby 2024-05-03T22:39:21.245 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:21 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-03T22:39:21.245 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:21 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:21.245 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:21 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:21.245 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:21 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:21.245 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:21 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:21.245 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:21 smithi160 ceph-mon[32531]: Deploying daemon mds.f on smithi160 2024-05-03T22:39:21.245 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:21 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3556097258' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:21.471 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:21 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] up:boot 2024-05-03T22:39:21.471 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:21 smithi044 ceph-mon[28604]: fsmap 5 up:standby 2024-05-03T22:39:21.471 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:21 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-03T22:39:21.471 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:21 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:21.471 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:21 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:21.472 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:21 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:21.472 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:21 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:21.472 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:21 smithi044 ceph-mon[28604]: Deploying daemon mds.f on smithi160 2024-05-03T22:39:21.472 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:21 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3556097258' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:21.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:21 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] up:boot 2024-05-03T22:39:21.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:21 smithi060 ceph-mon[31721]: fsmap 5 up:standby 2024-05-03T22:39:21.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:21 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-03T22:39:21.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:21 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:21.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:21 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:21.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:21 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:21.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:21 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:21.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:21 smithi060 ceph-mon[31721]: Deploying daemon mds.f on smithi160 2024-05-03T22:39:21.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:21 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3556097258' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:22.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:22 smithi160 ceph-mon[32531]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:22.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:22 smithi044 ceph-mon[28604]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:22.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:22 smithi060 ceph-mon[31721]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:23.515 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 22:39:23 smithi160 systemd[1]: Starting Ceph mds.f for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T22:39:23.523 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:39:23.866 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 22:39:23 smithi160 podman[62955]: 2024-05-03 22:39:23.426977087 +0000 UTC m=+0.036174839 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:39:23.867 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 22:39:23 smithi160 podman[62955]: 2024-05-03 22:39:23.559883927 +0000 UTC m=+0.169081716 container create 102dcaa56d834db83e735f7a215ab5447edc8948612b5604b3a7f529ef8d7295 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T22:39:23.867 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 22:39:23 smithi160 podman[62955]: 2024-05-03 22:39:23.863693781 +0000 UTC m=+0.472891577 container init 102dcaa56d834db83e735f7a215ab5447edc8948612b5604b3a7f529ef8d7295 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-f, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-03T22:39:24.000 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:39:24.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:24 smithi160 ceph-mon[32531]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:24.265 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 22:39:23 smithi160 podman[62955]: 2024-05-03 22:39:23.874579935 +0000 UTC m=+0.483777731 container start 102dcaa56d834db83e735f7a215ab5447edc8948612b5604b3a7f529ef8d7295 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-03T22:39:24.265 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 22:39:23 smithi160 ceph-mds[62975]: -- 172.21.15.160:0/3543671924 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563213ee1a40 con 0x563213eb4c00 2024-05-03T22:39:24.265 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 22:39:23 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-f[62971]: starting mds.f at 2024-05-03T22:39:24.265 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 22:39:23 smithi160 bash[62955]: 102dcaa56d834db83e735f7a215ab5447edc8948612b5604b3a7f529ef8d7295 2024-05-03T22:39:24.266 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 22:39:23 smithi160 systemd[1]: Started Ceph mds.f for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:39:24.359 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:24 smithi044 ceph-mon[28604]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:24.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:24 smithi060 ceph-mon[31721]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:25.411 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:25 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.160:6834/1332937382,v1:172.21.15.160:6835/1332937382] up:boot 2024-05-03T22:39:25.412 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:25 smithi044 ceph-mon[28604]: fsmap 6 up:standby 2024-05-03T22:39:25.412 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:25 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-03T22:39:25.412 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:25 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:25.412 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:25 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:25.412 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:25 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:25.412 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:25 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:25.412 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:25 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:25.412 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:25 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:25.412 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:25 smithi044 ceph-mon[28604]: Deploying daemon mds.c on smithi160 2024-05-03T22:39:25.458 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:25 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.160:6834/1332937382,v1:172.21.15.160:6835/1332937382] up:boot 2024-05-03T22:39:25.458 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:25 smithi160 ceph-mon[32531]: fsmap 6 up:standby 2024-05-03T22:39:25.458 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:25 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-03T22:39:25.458 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:25 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:25.459 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:25 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:25.459 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:25 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:25.459 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:25 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:25.459 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:25 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:25.459 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:25 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:25.459 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:25 smithi160 ceph-mon[32531]: Deploying daemon mds.c on smithi160 2024-05-03T22:39:25.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:25 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.160:6834/1332937382,v1:172.21.15.160:6835/1332937382] up:boot 2024-05-03T22:39:25.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:25 smithi060 ceph-mon[31721]: fsmap 6 up:standby 2024-05-03T22:39:25.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-03T22:39:25.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:25.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:25.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:25.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:25.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:25.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:25 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:25.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:25 smithi060 ceph-mon[31721]: Deploying daemon mds.c on smithi160 2024-05-03T22:39:26.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.271+0000 7fc80f000700 1 -- 172.21.15.44:0/1864974291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc808105f90 msgr2=0x7fc8081124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:26.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.271+0000 7fc80f000700 1 --2- 172.21.15.44:0/1864974291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc808105f90 0x7fc8081124a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc80000b0a0 tx=0x7fc80000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:39:26.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.272+0000 7fc80f000700 1 -- 172.21.15.44:0/1864974291 shutdown_connections 2024-05-03T22:39:26.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.272+0000 7fc80f000700 1 --2- 172.21.15.44:0/1864974291 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc808105f90 0x7fc8081124a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:26.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.272+0000 7fc80f000700 1 --2- 172.21.15.44:0/1864974291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc80810b660 0x7fc80810ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:26.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.272+0000 7fc80f000700 1 --2- 172.21.15.44:0/1864974291 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8081055d0 0x7fc808105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:26.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.272+0000 7fc80f000700 1 -- 172.21.15.44:0/1864974291 >> 172.21.15.44:0/1864974291 conn(0x7fc8081010c0 msgr2=0x7fc8081034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:26.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.272+0000 7fc80f000700 1 -- 172.21.15.44:0/1864974291 shutdown_connections 2024-05-03T22:39:26.274 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.272+0000 7fc80f000700 1 -- 172.21.15.44:0/1864974291 wait complete. 2024-05-03T22:39:26.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.273+0000 7fc80f000700 1 Processor -- start 2024-05-03T22:39:26.276 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.273+0000 7fc80f000700 1 -- start start 2024-05-03T22:39:26.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.273+0000 7fc80f000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8081055d0 0x7fc8081a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:26.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.273+0000 7fc80f000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc808105f90 0x7fc8081a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:26.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.273+0000 7fc80f000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc80810b660 0x7fc80819ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:26.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.273+0000 7fc80f000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc8081158e0 con 0x7fc8081055d0 2024-05-03T22:39:26.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.273+0000 7fc80f000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc808115760 con 0x7fc808105f90 2024-05-03T22:39:26.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.273+0000 7fc80f000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc808115a60 con 0x7fc80810b660 2024-05-03T22:39:26.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.274+0000 7fc80dc00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8081055d0 0x7fc8081a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:26.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.274+0000 7fc80dc00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8081055d0 0x7fc8081a1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41388/0 (socket says 172.21.15.44:41388) 2024-05-03T22:39:26.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.274+0000 7fc80dc00700 1 -- 172.21.15.44:0/1031770190 learned_addr learned my addr 172.21.15.44:0/1031770190 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:39:26.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.274+0000 7fc80d200700 1 --2- 172.21.15.44:0/1031770190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc808105f90 0x7fc8081a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:26.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.274+0000 7fc80e600700 1 --2- 172.21.15.44:0/1031770190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc80810b660 0x7fc80819ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:26.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.274+0000 7fc80dc00700 1 -- 172.21.15.44:0/1031770190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc80810b660 msgr2=0x7fc80819ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:26.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.274+0000 7fc80dc00700 1 --2- 172.21.15.44:0/1031770190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc80810b660 0x7fc80819ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:26.277 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.274+0000 7fc80dc00700 1 -- 172.21.15.44:0/1031770190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc808105f90 msgr2=0x7fc8081a1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:26.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.274+0000 7fc80dc00700 1 --2- 172.21.15.44:0/1031770190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc808105f90 0x7fc8081a1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:26.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.274+0000 7fc80dc00700 1 -- 172.21.15.44:0/1031770190 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc80819c1e0 con 0x7fc8081055d0 2024-05-03T22:39:26.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.274+0000 7fc80e600700 1 --2- 172.21.15.44:0/1031770190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc80810b660 0x7fc80819ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:39:26.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.275+0000 7fc80dc00700 1 --2- 172.21.15.44:0/1031770190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8081055d0 0x7fc8081a1870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00d980 tx=0x7fc7fc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:26.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.275+0000 7fc806000700 1 -- 172.21.15.44:0/1031770190 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc017030 con 0x7fc8081055d0 2024-05-03T22:39:26.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.275+0000 7fc806000700 1 -- 172.21.15.44:0/1031770190 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fc7fc0044f0 con 0x7fc8081055d0 2024-05-03T22:39:26.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.275+0000 7fc80f000700 1 -- 172.21.15.44:0/1031770190 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc80819c4d0 con 0x7fc8081055d0 2024-05-03T22:39:26.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.275+0000 7fc806000700 1 -- 172.21.15.44:0/1031770190 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc003b40 con 0x7fc8081055d0 2024-05-03T22:39:26.278 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.275+0000 7fc80f000700 1 -- 172.21.15.44:0/1031770190 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8081a8740 con 0x7fc8081055d0 2024-05-03T22:39:26.279 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.276+0000 7fc80f000700 1 -- 172.21.15.44:0/1031770190 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc80806a190 con 0x7fc8081055d0 2024-05-03T22:39:26.280 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.279+0000 7fc806000700 1 -- 172.21.15.44:0/1031770190 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc7fc01a070 con 0x7fc8081055d0 2024-05-03T22:39:26.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.280+0000 7fc806000700 1 --2- 172.21.15.44:0/1031770190 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc7f00b2900 0x7fc7f00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:26.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.280+0000 7fc806000700 1 -- 172.21.15.44:0/1031770190 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fc7fc0e1a90 con 0x7fc8081055d0 2024-05-03T22:39:26.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.280+0000 7fc80d200700 1 --2- 172.21.15.44:0/1031770190 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc7f00b2900 0x7fc7f00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:26.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.281+0000 7fc80d200700 1 --2- 172.21.15.44:0/1031770190 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc7f00b2900 0x7fc7f00b4dc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4005950 tx=0x7fc7f40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:26.284 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.283+0000 7fc806000700 1 -- 172.21.15.44:0/1031770190 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc7fc0a9cd0 con 0x7fc8081055d0 2024-05-03T22:39:26.481 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:26 smithi160 ceph-mon[32531]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:26.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:26 smithi044 ceph-mon[28604]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:26.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:26 smithi060 ceph-mon[31721]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:26.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.571+0000 7fc80f000700 1 -- 172.21.15.44:0/1031770190 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc80819cf60 con 0x7fc8081055d0 2024-05-03T22:39:26.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.572+0000 7fc806000700 1 -- 172.21.15.44:0/1031770190 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5521 (secure 0 0 0) 0x7fc7fc0a95d0 con 0x7fc8081055d0 2024-05-03T22:39:26.574 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:39:26.574 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2550955759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2550955759},{"type":"v1","addr":"172.21.15.44:6835","nonce":2550955759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3118490782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3118490782},{"type":"v1","addr":"172.21.15.44:6837","nonce":3118490782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1332937382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1332937382},{"type":"v1","addr":"172.21.15.160:6835","nonce":1332937382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":34391,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/153110190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":153110190},{"type":"v1","addr":"172.21.15.60:6833","nonce":153110190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34409,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3390425489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3390425489},{"type":"v1","addr":"172.21.15.60:6835","nonce":3390425489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-03T22:39:26.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.575+0000 7fc80f000700 1 -- 172.21.15.44:0/1031770190 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc7f00b2900 msgr2=0x7fc7f00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:26.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.575+0000 7fc80f000700 1 --2- 172.21.15.44:0/1031770190 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc7f00b2900 0x7fc7f00b4dc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4005950 tx=0x7fc7f40058e0 comp rx=0 tx=0).stop 2024-05-03T22:39:26.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.575+0000 7fc80f000700 1 -- 172.21.15.44:0/1031770190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8081055d0 msgr2=0x7fc8081a1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:26.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.575+0000 7fc80f000700 1 --2- 172.21.15.44:0/1031770190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8081055d0 0x7fc8081a1870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00d980 tx=0x7fc7fc00dd40 comp rx=0 tx=0).stop 2024-05-03T22:39:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.576+0000 7fc80f000700 1 -- 172.21.15.44:0/1031770190 shutdown_connections 2024-05-03T22:39:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.576+0000 7fc80f000700 1 --2- 172.21.15.44:0/1031770190 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc7f00b2900 0x7fc7f00b4dc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.576+0000 7fc80f000700 1 --2- 172.21.15.44:0/1031770190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc80810b660 0x7fc80819ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.576+0000 7fc80f000700 1 --2- 172.21.15.44:0/1031770190 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc8081055d0 0x7fc8081a1870 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.576+0000 7fc80f000700 1 --2- 172.21.15.44:0/1031770190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc808105f90 0x7fc8081a1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.576+0000 7fc80f000700 1 -- 172.21.15.44:0/1031770190 >> 172.21.15.44:0/1031770190 conn(0x7fc8081010c0 msgr2=0x7fc808102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.576+0000 7fc80f000700 1 -- 172.21.15.44:0/1031770190 shutdown_connections 2024-05-03T22:39:26.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:26.576+0000 7fc80f000700 1 -- 172.21.15.44:0/1031770190 wait complete. 2024-05-03T22:39:26.579 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 7 2024-05-03T22:39:27.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:27 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1031770190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:27.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:27 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1031770190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:27.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:27 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1031770190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:27.686 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 22:39:27 smithi160 systemd[1]: Starting Ceph mds.c for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T22:39:28.012 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 22:39:27 smithi160 podman[63259]: 2024-05-03 22:39:27.588807314 +0000 UTC m=+0.033562973 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:39:28.012 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 22:39:27 smithi160 podman[63259]: 2024-05-03 22:39:27.706427169 +0000 UTC m=+0.151182865 container create 9ce22ca19a12e8c68c50edae570dfd66f72463e087c7405b547ceeb3f1015761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-c, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-05-03T22:39:28.013 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 22:39:28 smithi160 podman[63259]: 2024-05-03 22:39:28.010137048 +0000 UTC m=+0.454892768 container init 9ce22ca19a12e8c68c50edae570dfd66f72463e087c7405b547ceeb3f1015761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-03T22:39:28.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:28 smithi160 ceph-mon[32531]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:28.266 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 22:39:28 smithi160 podman[63259]: 2024-05-03 22:39:28.020564898 +0000 UTC m=+0.465320601 container start 9ce22ca19a12e8c68c50edae570dfd66f72463e087c7405b547ceeb3f1015761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-c, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-03T22:39:28.266 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 22:39:28 smithi160 ceph-mds[63278]: -- 172.21.15.160:0/1060994675 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ef8d2c3a40 con 0x55ef8d296c00 2024-05-03T22:39:28.266 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 22:39:28 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-c[63274]: starting mds.c at 2024-05-03T22:39:28.266 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 22:39:28 smithi160 bash[63259]: 9ce22ca19a12e8c68c50edae570dfd66f72463e087c7405b547ceeb3f1015761 2024-05-03T22:39:28.266 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 22:39:28 smithi160 systemd[1]: Started Ceph mds.c for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:39:28.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:28 smithi044 ceph-mon[28604]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:28.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:28 smithi060 ceph-mon[31721]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:29.419 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:39:29.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:29 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.160:6836/3735287805,v1:172.21.15.160:6837/3735287805] up:boot 2024-05-03T22:39:29.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:29 smithi044 ceph-mon[28604]: fsmap 7 up:standby 2024-05-03T22:39:29.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:29 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-03T22:39:29.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:29 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:29.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:29 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:29.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:29 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:29.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:29 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:29.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:29 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:29.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:29 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:29.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:29 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.160:6836/3735287805,v1:172.21.15.160:6837/3735287805] up:boot 2024-05-03T22:39:29.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:29 smithi060 ceph-mon[31721]: fsmap 7 up:standby 2024-05-03T22:39:29.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:29 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-03T22:39:29.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:29 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:29.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:29 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:29.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:29 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:29.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:29 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:29.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:29 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:29.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:29 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:29.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:29 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.160:6836/3735287805,v1:172.21.15.160:6837/3735287805] up:boot 2024-05-03T22:39:29.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:29 smithi160 ceph-mon[32531]: fsmap 7 up:standby 2024-05-03T22:39:29.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:29 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-03T22:39:29.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:29 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:29.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:29 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:29.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:29 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:29.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:29 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:29.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:29 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:29.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:29 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:29.896 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:39:30.323 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:30 smithi044 ceph-mon[28604]: Deploying daemon mds.h on smithi060 2024-05-03T22:39:30.323 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:30 smithi044 ceph-mon[28604]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:30.454 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:30 smithi060 ceph-mon[31721]: Deploying daemon mds.h on smithi060 2024-05-03T22:39:30.454 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:30 smithi060 ceph-mon[31721]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:30 smithi160 ceph-mon[32531]: Deploying daemon mds.h on smithi060 2024-05-03T22:39:30.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:30 smithi160 ceph-mon[32531]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:31.755 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 22:39:31 smithi060 systemd[1]: Starting Ceph mds.h for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T22:39:32.199 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 22:39:31 smithi060 podman[62154]: 2024-05-03 22:39:31.778100884 +0000 UTC m=+0.033780226 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:39:32.199 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 22:39:31 smithi060 podman[62154]: 2024-05-03 22:39:31.908975674 +0000 UTC m=+0.164655053 container create 36e06da620b3498eeeae54e9441c7c03ae90a1116fee4398c9f362d0abb9d29a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-h, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:39:32.199 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 22:39:32 smithi060 podman[62154]: 2024-05-03 22:39:32.19693382 +0000 UTC m=+0.452613206 container init 36e06da620b3498eeeae54e9441c7c03ae90a1116fee4398c9f362d0abb9d29a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T22:39:32.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:32 smithi160 ceph-mon[32531]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.284+0000 7f1f3c000700 1 -- 172.21.15.44:0/376024437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f34109510 msgr2=0x7f1f341098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.284+0000 7f1f3c000700 1 --2- 172.21.15.44:0/376024437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f34109510 0x7f1f341098f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1f28009990 tx=0x7f1f28009ca0 comp rx=0 tx=0).stop 2024-05-03T22:39:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.284+0000 7f1f3c000700 1 -- 172.21.15.44:0/376024437 shutdown_connections 2024-05-03T22:39:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.284+0000 7f1f3c000700 1 --2- 172.21.15.44:0/376024437 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f3406bb40 0x7f1f34110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.284+0000 7f1f3c000700 1 --2- 172.21.15.44:0/376024437 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f34109510 0x7f1f341098f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.284+0000 7f1f3c000700 1 --2- 172.21.15.44:0/376024437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f3406b180 0x7f1f3406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.284+0000 7f1f3c000700 1 -- 172.21.15.44:0/376024437 >> 172.21.15.44:0/376024437 conn(0x7f1f34079350 msgr2=0x7f1f34079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:32.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.284+0000 7f1f3c000700 1 -- 172.21.15.44:0/376024437 shutdown_connections 2024-05-03T22:39:32.287 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.284+0000 7f1f3c000700 1 -- 172.21.15.44:0/376024437 wait complete. 2024-05-03T22:39:32.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.285+0000 7f1f3c000700 1 Processor -- start 2024-05-03T22:39:32.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.285+0000 7f1f3c000700 1 -- start start 2024-05-03T22:39:32.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.286+0000 7f1f3c000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f3406b180 0x7f1f34102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:32.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.286+0000 7f1f3c000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f3406bb40 0x7f1f341029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:32.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.286+0000 7f1f3c000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f34109510 0x7f1f34102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:32.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.286+0000 7f1f3c000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1f341137d0 con 0x7f1f34109510 2024-05-03T22:39:32.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.286+0000 7f1f3c000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1f34113650 con 0x7f1f3406b180 2024-05-03T22:39:32.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.286+0000 7f1f3c000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1f34113950 con 0x7f1f3406bb40 2024-05-03T22:39:32.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.286+0000 7f1f3a000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f34109510 0x7f1f34102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:32.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.286+0000 7f1f39600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f3406b180 0x7f1f34102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:32.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.286+0000 7f1f3a000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f34109510 0x7f1f34102ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54880/0 (socket says 172.21.15.44:54880) 2024-05-03T22:39:32.288 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.286+0000 7f1f39600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f3406b180 0x7f1f34102470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.44:55630/0 (socket says 172.21.15.44:55630) 2024-05-03T22:39:32.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.286+0000 7f1f3a000700 1 -- 172.21.15.44:0/251224778 learned_addr learned my addr 172.21.15.44:0/251224778 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:39:32.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.286+0000 7f1f38c00700 1 --2- 172.21.15.44:0/251224778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f3406bb40 0x7f1f341029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:32.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.287+0000 7f1f39600700 1 -- 172.21.15.44:0/251224778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f3406bb40 msgr2=0x7f1f341029b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:32.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.287+0000 7f1f39600700 1 --2- 172.21.15.44:0/251224778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f3406bb40 0x7f1f341029b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:32.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.287+0000 7f1f39600700 1 -- 172.21.15.44:0/251224778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f34109510 msgr2=0x7f1f34102ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:32.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.287+0000 7f1f39600700 1 --2- 172.21.15.44:0/251224778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f34109510 0x7f1f34102ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:32.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.287+0000 7f1f39600700 1 -- 172.21.15.44:0/251224778 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f341a81d0 con 0x7f1f3406b180 2024-05-03T22:39:32.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.287+0000 7f1f39600700 1 --2- 172.21.15.44:0/251224778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f3406b180 0x7f1f34102470 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800b5c0 tx=0x7f1f280047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:32.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.287+0000 7f1f32000700 1 -- 172.21.15.44:0/251224778 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28004830 con 0x7f1f3406b180 2024-05-03T22:39:32.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.287+0000 7f1f3c000700 1 -- 172.21.15.44:0/251224778 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f341a8460 con 0x7f1f3406b180 2024-05-03T22:39:32.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.287+0000 7f1f32000700 1 -- 172.21.15.44:0/251224778 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f1f28005020 con 0x7f1f3406b180 2024-05-03T22:39:32.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.287+0000 7f1f32000700 1 -- 172.21.15.44:0/251224778 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28003d20 con 0x7f1f3406b180 2024-05-03T22:39:32.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.288+0000 7f1f3c000700 1 -- 172.21.15.44:0/251224778 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f341a88b0 con 0x7f1f3406b180 2024-05-03T22:39:32.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.289+0000 7f1f3c000700 1 -- 172.21.15.44:0/251224778 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f3410b9f0 con 0x7f1f3406b180 2024-05-03T22:39:32.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.291+0000 7f1f32000700 1 -- 172.21.15.44:0/251224778 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f1f28028060 con 0x7f1f3406b180 2024-05-03T22:39:32.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.293+0000 7f1f32000700 1 --2- 172.21.15.44:0/251224778 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1f1c0b2900 0x7f1f1c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:32.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.293+0000 7f1f32000700 1 -- 172.21.15.44:0/251224778 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f1f280e2610 con 0x7f1f3406b180 2024-05-03T22:39:32.294 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.293+0000 7f1f38c00700 1 --2- 172.21.15.44:0/251224778 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1f1c0b2900 0x7f1f1c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:32.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.294+0000 7f1f38c00700 1 --2- 172.21.15.44:0/251224778 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1f1c0b2900 0x7f1f1c0b4dc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1f20005fd0 tx=0x7f1f20005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:32.301 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.300+0000 7f1f32000700 1 -- 172.21.15.44:0/251224778 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f1f28013070 con 0x7f1f3406b180 2024-05-03T22:39:32.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:32 smithi044 ceph-mon[28604]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:32.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:32 smithi060 ceph-mon[31721]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:32.505 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 22:39:32 smithi060 podman[62154]: 2024-05-03 22:39:32.207612004 +0000 UTC m=+0.463291352 container start 36e06da620b3498eeeae54e9441c7c03ae90a1116fee4398c9f362d0abb9d29a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-03T22:39:32.505 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 22:39:32 smithi060 ceph-mds[62173]: -- 172.21.15.60:0/497202685 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x565437263a40 con 0x565437237000 2024-05-03T22:39:32.505 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 22:39:32 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-h[62169]: starting mds.h at 2024-05-03T22:39:32.505 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 22:39:32 smithi060 bash[62154]: 36e06da620b3498eeeae54e9441c7c03ae90a1116fee4398c9f362d0abb9d29a 2024-05-03T22:39:32.505 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 22:39:32 smithi060 systemd[1]: Started Ceph mds.h for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:39:32.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.594+0000 7f1f3c000700 1 -- 172.21.15.44:0/251224778 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f3410b3d0 con 0x7f1f3406b180 2024-05-03T22:39:32.597 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.595+0000 7f1f32000700 1 -- 172.21.15.44:0/251224778 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6349 (secure 0 0 0) 0x7f1f280aa7c0 con 0x7f1f3406b180 2024-05-03T22:39:32.597 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:39:32.597 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2550955759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2550955759},{"type":"v1","addr":"172.21.15.44:6835","nonce":2550955759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3118490782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3118490782},{"type":"v1","addr":"172.21.15.44:6837","nonce":3118490782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1332937382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1332937382},{"type":"v1","addr":"172.21.15.160:6835","nonce":1332937382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/3735287805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3735287805},{"type":"v1","addr":"172.21.15.160:6837","nonce":3735287805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34391,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/153110190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":153110190},{"type":"v1","addr":"172.21.15.60:6833","nonce":153110190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34409,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3390425489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3390425489},{"type":"v1","addr":"172.21.15.60:6835","nonce":3390425489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-03T22:39:32.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.599+0000 7f1f3c000700 1 -- 172.21.15.44:0/251224778 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1f1c0b2900 msgr2=0x7f1f1c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:32.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.599+0000 7f1f3c000700 1 --2- 172.21.15.44:0/251224778 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1f1c0b2900 0x7f1f1c0b4dc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1f20005fd0 tx=0x7f1f20005f60 comp rx=0 tx=0).stop 2024-05-03T22:39:32.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.599+0000 7f1f3c000700 1 -- 172.21.15.44:0/251224778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f3406b180 msgr2=0x7f1f34102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:32.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.599+0000 7f1f3c000700 1 --2- 172.21.15.44:0/251224778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f3406b180 0x7f1f34102470 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1f2800b5c0 tx=0x7f1f280047b0 comp rx=0 tx=0).stop 2024-05-03T22:39:32.601 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.599+0000 7f1f3c000700 1 -- 172.21.15.44:0/251224778 shutdown_connections 2024-05-03T22:39:32.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.599+0000 7f1f3c000700 1 --2- 172.21.15.44:0/251224778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1f34109510 0x7f1f34102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:32.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.599+0000 7f1f3c000700 1 --2- 172.21.15.44:0/251224778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f3406b180 0x7f1f34102470 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:32.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.599+0000 7f1f3c000700 1 --2- 172.21.15.44:0/251224778 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1f1c0b2900 0x7f1f1c0b4dc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:32.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.599+0000 7f1f3c000700 1 --2- 172.21.15.44:0/251224778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f3406bb40 0x7f1f341029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:32.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.599+0000 7f1f3c000700 1 -- 172.21.15.44:0/251224778 >> 172.21.15.44:0/251224778 conn(0x7f1f34079350 msgr2=0x7f1f34100fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:32.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.599+0000 7f1f3c000700 1 -- 172.21.15.44:0/251224778 shutdown_connections 2024-05-03T22:39:32.602 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:32.600+0000 7f1f3c000700 1 -- 172.21.15.44:0/251224778 wait complete. 2024-05-03T22:39:32.602 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 8 2024-05-03T22:39:33.743 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:33 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:33.744 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:33 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:33.744 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:33 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:33.744 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:33 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:33.744 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:33 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:33.744 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:33 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:33.744 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:33 smithi160 ceph-mon[32531]: Deploying daemon mds.i on smithi160 2024-05-03T22:39:33.744 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:33 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/251224778' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:33.744 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:33 smithi160 ceph-mon[32531]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:33.744 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:33 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] up:boot 2024-05-03T22:39:33.744 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:33 smithi160 ceph-mon[32531]: fsmap 8 up:standby 2024-05-03T22:39:33.744 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:33 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-03T22:39:33.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:33 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:33.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:33 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:33.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:33 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:33.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:33 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:33.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:33 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:33.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:33 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:33.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:33 smithi044 ceph-mon[28604]: Deploying daemon mds.i on smithi160 2024-05-03T22:39:33.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:33 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/251224778' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:33.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:33 smithi044 ceph-mon[28604]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:33.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:33 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] up:boot 2024-05-03T22:39:33.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:33 smithi044 ceph-mon[28604]: fsmap 8 up:standby 2024-05-03T22:39:33.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:33 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-03T22:39:33.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:33 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:33.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:33 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:33.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:33 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:33.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:33 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:33.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:33 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:33.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:33 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:33.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:33 smithi060 ceph-mon[31721]: Deploying daemon mds.i on smithi160 2024-05-03T22:39:33.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:33 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/251224778' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:33.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:33 smithi060 ceph-mon[31721]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:33.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:33 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] up:boot 2024-05-03T22:39:33.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:33 smithi060 ceph-mon[31721]: fsmap 8 up:standby 2024-05-03T22:39:33.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:33 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-03T22:39:35.454 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:39:35.914 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:39:35.999 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 22:39:35 smithi160 systemd[1]: Starting Ceph mds.i for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T22:39:36.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:35 smithi044 ceph-mon[28604]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:35 smithi060 ceph-mon[31721]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:36.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:35 smithi160 ceph-mon[32531]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:36.266 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 22:39:36 smithi160 podman[63563]: 2024-05-03 22:39:35.979424703 +0000 UTC m=+0.032972391 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:39:36.266 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 22:39:36 smithi160 podman[63563]: 2024-05-03 22:39:36.094306345 +0000 UTC m=+0.147854075 container create 31853a619ebc4b4647d7fc2d91bc32e68f4e5f9d19afa28a8f064df1feec2e03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-i, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T22:39:36.766 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 22:39:36 smithi160 podman[63563]: 2024-05-03 22:39:36.373921668 +0000 UTC m=+0.427469437 container init 31853a619ebc4b4647d7fc2d91bc32e68f4e5f9d19afa28a8f064df1feec2e03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-i, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-05-03T22:39:36.767 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 22:39:36 smithi160 podman[63563]: 2024-05-03 22:39:36.384927453 +0000 UTC m=+0.438475196 container start 31853a619ebc4b4647d7fc2d91bc32e68f4e5f9d19afa28a8f064df1feec2e03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-03T22:39:36.767 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 22:39:36 smithi160 ceph-mds[63582]: -- 172.21.15.160:0/3067829349 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5618029b7a40 con 0x56180298a800 2024-05-03T22:39:36.767 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 22:39:36 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-i[63578]: starting mds.i at 2024-05-03T22:39:36.767 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 22:39:36 smithi160 bash[63563]: 31853a619ebc4b4647d7fc2d91bc32e68f4e5f9d19afa28a8f064df1feec2e03 2024-05-03T22:39:36.767 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 22:39:36 smithi160 systemd[1]: Started Ceph mds.i for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:39:37.847 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:37 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:37.847 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:37 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:37.847 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:37 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:37.847 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:37 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:37.847 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:37 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:37.847 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:37 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:37.847 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:37 smithi044 ceph-mon[28604]: Deploying daemon mds.g on smithi044 2024-05-03T22:39:37.847 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:37 smithi044 ceph-mon[28604]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:37.847 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:37 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] up:boot 2024-05-03T22:39:37.847 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:37 smithi044 ceph-mon[28604]: fsmap 9 up:standby 2024-05-03T22:39:37.847 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:37 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-03T22:39:38.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:37 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:38.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:37 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:38.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:37 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:38.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:37 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:38.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:37 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:38.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:37 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:38.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:37 smithi060 ceph-mon[31721]: Deploying daemon mds.g on smithi044 2024-05-03T22:39:38.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:37 smithi060 ceph-mon[31721]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:38.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:37 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] up:boot 2024-05-03T22:39:38.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:37 smithi060 ceph-mon[31721]: fsmap 9 up:standby 2024-05-03T22:39:38.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:37 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-03T22:39:38.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:37 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:38.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:37 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:38.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:37 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:38.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:37 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:38.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:37 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:38.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:37 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:38.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:37 smithi160 ceph-mon[32531]: Deploying daemon mds.g on smithi044 2024-05-03T22:39:38.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:37 smithi160 ceph-mon[32531]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:38.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:37 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] up:boot 2024-05-03T22:39:38.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:37 smithi160 ceph-mon[32531]: fsmap 9 up:standby 2024-05-03T22:39:38.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:37 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-03T22:39:38.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.095+0000 7f8834600700 1 -- 172.21.15.44:0/1079154633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f882c1023a0 msgr2=0x7f882c102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:38.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.095+0000 7f8834600700 1 --2- 172.21.15.44:0/1079154633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f882c1023a0 0x7f882c102820 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8818009990 tx=0x7f8818009ca0 comp rx=0 tx=0).stop 2024-05-03T22:39:38.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.095+0000 7f8834600700 1 -- 172.21.15.44:0/1079154633 shutdown_connections 2024-05-03T22:39:38.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.095+0000 7f8834600700 1 --2- 172.21.15.44:0/1079154633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f882c102d60 0x7f882c10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:38.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.096+0000 7f8834600700 1 --2- 172.21.15.44:0/1079154633 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f882c108410 0x7f882c1087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:38.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.096+0000 7f8834600700 1 --2- 172.21.15.44:0/1079154633 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f882c1023a0 0x7f882c102820 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:38.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.096+0000 7f8834600700 1 -- 172.21.15.44:0/1079154633 >> 172.21.15.44:0/1079154633 conn(0x7f882c079350 msgr2=0x7f882c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:38.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.096+0000 7f8834600700 1 -- 172.21.15.44:0/1079154633 shutdown_connections 2024-05-03T22:39:38.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.096+0000 7f8834600700 1 -- 172.21.15.44:0/1079154633 wait complete. 2024-05-03T22:39:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.097+0000 7f8834600700 1 Processor -- start 2024-05-03T22:39:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.097+0000 7f8834600700 1 -- start start 2024-05-03T22:39:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.097+0000 7f8834600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f882c1023a0 0x7f882c104080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.097+0000 7f8834600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f882c102d60 0x7f882c1045c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.097+0000 7f8834600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f882c108410 0x7f882c104b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.097+0000 7f8834600700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f882c112770 con 0x7f882c1023a0 2024-05-03T22:39:38.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.097+0000 7f8834600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f882c1125f0 con 0x7f882c102d60 2024-05-03T22:39:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.097+0000 7f8834600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f882c1128f0 con 0x7f882c108410 2024-05-03T22:39:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.098+0000 7f8831c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f882c1023a0 0x7f882c104080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.098+0000 7f8831c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f882c1023a0 0x7f882c104080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:54906/0 (socket says 172.21.15.44:54906) 2024-05-03T22:39:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.098+0000 7f8831c00700 1 -- 172.21.15.44:0/3457823664 learned_addr learned my addr 172.21.15.44:0/3457823664 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:39:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.098+0000 7f8831200700 1 --2- 172.21.15.44:0/3457823664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f882c102d60 0x7f882c1045c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.098+0000 7f8832600700 1 --2- 172.21.15.44:0/3457823664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f882c108410 0x7f882c104b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.098+0000 7f8831c00700 1 -- 172.21.15.44:0/3457823664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f882c108410 msgr2=0x7f882c104b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.098+0000 7f8831c00700 1 --2- 172.21.15.44:0/3457823664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f882c108410 0x7f882c104b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.098+0000 7f8831c00700 1 -- 172.21.15.44:0/3457823664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f882c102d60 msgr2=0x7f882c1045c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.098+0000 7f8831c00700 1 --2- 172.21.15.44:0/3457823664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f882c102d60 0x7f882c1045c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.098+0000 7f8831c00700 1 -- 172.21.15.44:0/3457823664 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f882c1a82e0 con 0x7f882c1023a0 2024-05-03T22:39:38.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.098+0000 7f8831200700 1 --2- 172.21.15.44:0/3457823664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f882c102d60 0x7f882c1045c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:39:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.098+0000 7f8831c00700 1 --2- 172.21.15.44:0/3457823664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f882c1023a0 0x7f882c104080 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f882000b530 tx=0x7f882000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.099+0000 7f882a000700 1 -- 172.21.15.44:0/3457823664 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8820015020 con 0x7f882c1023a0 2024-05-03T22:39:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.099+0000 7f882a000700 1 -- 172.21.15.44:0/3457823664 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f8820011d00 con 0x7f882c1023a0 2024-05-03T22:39:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.099+0000 7f8834600700 1 -- 172.21.15.44:0/3457823664 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f882c1a85d0 con 0x7f882c1023a0 2024-05-03T22:39:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.099+0000 7f882a000700 1 -- 172.21.15.44:0/3457823664 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8820010dd0 con 0x7f882c1023a0 2024-05-03T22:39:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.099+0000 7f8834600700 1 -- 172.21.15.44:0/3457823664 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f882c1a8ac0 con 0x7f882c1023a0 2024-05-03T22:39:38.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.100+0000 7f8834600700 1 -- 172.21.15.44:0/3457823664 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f882c06a190 con 0x7f882c1023a0 2024-05-03T22:39:38.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.103+0000 7f882a000700 1 -- 172.21.15.44:0/3457823664 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f8820018020 con 0x7f882c1023a0 2024-05-03T22:39:38.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.105+0000 7f882a000700 1 --2- 172.21.15.44:0/3457823664 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f88140b2880 0x7f88140b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:38.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.105+0000 7f882a000700 1 -- 172.21.15.44:0/3457823664 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f88200e16e0 con 0x7f882c1023a0 2024-05-03T22:39:38.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.105+0000 7f8831200700 1 --2- 172.21.15.44:0/3457823664 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f88140b2880 0x7f88140b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:38.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.106+0000 7f8831200700 1 --2- 172.21.15.44:0/3457823664 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f88140b2880 0x7f88140b4d40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8818000c00 tx=0x7f8818005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:38.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.110+0000 7f882a000700 1 -- 172.21.15.44:0/3457823664 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f882001f020 con 0x7f882c1023a0 2024-05-03T22:39:38.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.410+0000 7f8834600700 1 -- 172.21.15.44:0/3457823664 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f882c1a8db0 con 0x7f882c1023a0 2024-05-03T22:39:38.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.411+0000 7f882a000700 1 -- 172.21.15.44:0/3457823664 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8001 (secure 0 0 0) 0x7f88200a9800 con 0x7f882c1023a0 2024-05-03T22:39:38.413 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:39:38.413 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2550955759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2550955759},{"type":"v1","addr":"172.21.15.44:6835","nonce":2550955759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3118490782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3118490782},{"type":"v1","addr":"172.21.15.44:6837","nonce":3118490782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1332937382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1332937382},{"type":"v1","addr":"172.21.15.160:6835","nonce":1332937382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/3735287805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3735287805},{"type":"v1","addr":"172.21.15.160:6837","nonce":3735287805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/861756806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":861756806},{"type":"v1","addr":"172.21.15.160:6839","nonce":861756806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34391,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/153110190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":153110190},{"type":"v1","addr":"172.21.15.60:6833","nonce":153110190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34409,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3390425489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3390425489},{"type":"v1","addr":"172.21.15.60:6835","nonce":3390425489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34427,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3568217572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3568217572},{"type":"v1","addr":"172.21.15.60:6837","nonce":3568217572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-03T22:39:38.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.414+0000 7f8834600700 1 -- 172.21.15.44:0/3457823664 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f88140b2880 msgr2=0x7f88140b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:38.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.414+0000 7f8834600700 1 --2- 172.21.15.44:0/3457823664 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f88140b2880 0x7f88140b4d40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8818000c00 tx=0x7f8818005fb0 comp rx=0 tx=0).stop 2024-05-03T22:39:38.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.414+0000 7f8834600700 1 -- 172.21.15.44:0/3457823664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f882c1023a0 msgr2=0x7f882c104080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:38.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.414+0000 7f8834600700 1 --2- 172.21.15.44:0/3457823664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f882c1023a0 0x7f882c104080 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f882000b530 tx=0x7f882000b8f0 comp rx=0 tx=0).stop 2024-05-03T22:39:38.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.414+0000 7f8834600700 1 -- 172.21.15.44:0/3457823664 shutdown_connections 2024-05-03T22:39:38.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.414+0000 7f8834600700 1 --2- 172.21.15.44:0/3457823664 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f88140b2880 0x7f88140b4d40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:38.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.414+0000 7f8834600700 1 --2- 172.21.15.44:0/3457823664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f882c108410 0x7f882c104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:38.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.414+0000 7f8834600700 1 --2- 172.21.15.44:0/3457823664 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f882c1023a0 0x7f882c104080 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:38.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.414+0000 7f8834600700 1 --2- 172.21.15.44:0/3457823664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f882c102d60 0x7f882c1045c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:38.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.414+0000 7f8834600700 1 -- 172.21.15.44:0/3457823664 >> 172.21.15.44:0/3457823664 conn(0x7f882c079350 msgr2=0x7f882c101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:38.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.414+0000 7f8834600700 1 -- 172.21.15.44:0/3457823664 shutdown_connections 2024-05-03T22:39:38.416 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:38.414+0000 7f8834600700 1 -- 172.21.15.44:0/3457823664 wait complete. 2024-05-03T22:39:38.417 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 10 2024-05-03T22:39:39.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:38 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3457823664' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:39.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:38 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3457823664' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:39.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:38 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3457823664' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:39.945 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:39 smithi044 ceph-mon[28604]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:40.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:39 smithi060 ceph-mon[31721]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:40.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:39 smithi160 ceph-mon[32531]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:41.503 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 22:39:41 smithi044 systemd[1]: Starting Ceph mds.g for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T22:39:41.694 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:39:41.784 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 22:39:41 smithi044 podman[70928]: 2024-05-03 22:39:41.434084055 +0000 UTC m=+0.035146284 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:39:41.784 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 22:39:41 smithi044 podman[70928]: 2024-05-03 22:39:41.665350164 +0000 UTC m=+0.266412426 container create 1ed06d1b8655542ff382bc8edd015ab062bbc8e245881df7fc82146cf1153fa6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-g, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True) 2024-05-03T22:39:42.103 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:41 smithi044 ceph-mon[28604]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:42.104 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 22:39:41 smithi044 podman[70928]: 2024-05-03 22:39:41.944534988 +0000 UTC m=+0.545597256 container init 1ed06d1b8655542ff382bc8edd015ab062bbc8e245881df7fc82146cf1153fa6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-g, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T22:39:42.104 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 22:39:41 smithi044 podman[70928]: 2024-05-03 22:39:41.959026446 +0000 UTC m=+0.560088683 container start 1ed06d1b8655542ff382bc8edd015ab062bbc8e245881df7fc82146cf1153fa6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-05-03T22:39:42.104 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 22:39:42 smithi044 ceph-mds[70965]: -- 172.21.15.44:0/1386545311 <== mon.0 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563a3d7a1a40 con 0x563a3d774800 2024-05-03T22:39:42.104 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 22:39:42 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-g[70961]: starting mds.g at 2024-05-03T22:39:42.250 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:39:42.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:41 smithi060 ceph-mon[31721]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:42.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:41 smithi160 ceph-mon[32531]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:42.402 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 22:39:42 smithi044 bash[70928]: 1ed06d1b8655542ff382bc8edd015ab062bbc8e245881df7fc82146cf1153fa6 2024-05-03T22:39:42.403 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 22:39:42 smithi044 systemd[1]: Started Ceph mds.g for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:39:43.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:43 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:43.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:43 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:43.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:43 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:43.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:43 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:43.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:43 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:43.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:43 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:43.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:43 smithi060 ceph-mon[31721]: Deploying daemon mds.a on smithi044 2024-05-03T22:39:43.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:43 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.44:6838/1408147232,v1:172.21.15.44:6839/1408147232] up:boot 2024-05-03T22:39:43.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:43 smithi060 ceph-mon[31721]: fsmap 10 up:standby 2024-05-03T22:39:43.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:43 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-03T22:39:43.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:43 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:43.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:43 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:43.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:43 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:43.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:43 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:43.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:43 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:43.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:43 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:43.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:43 smithi044 ceph-mon[28604]: Deploying daemon mds.a on smithi044 2024-05-03T22:39:43.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:43 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.44:6838/1408147232,v1:172.21.15.44:6839/1408147232] up:boot 2024-05-03T22:39:43.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:43 smithi044 ceph-mon[28604]: fsmap 10 up:standby 2024-05-03T22:39:43.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:43 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-03T22:39:43.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:43 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:43.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:43 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:43.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:43 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:43.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:43 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:43.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:43 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:43.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:43 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:43.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:43 smithi160 ceph-mon[32531]: Deploying daemon mds.a on smithi044 2024-05-03T22:39:43.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:43 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.44:6838/1408147232,v1:172.21.15.44:6839/1408147232] up:boot 2024-05-03T22:39:43.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:43 smithi160 ceph-mon[32531]: fsmap 10 up:standby 2024-05-03T22:39:43.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:43 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-03T22:39:44.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:44 smithi044 ceph-mon[28604]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:44.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:44 smithi060 ceph-mon[31721]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:44.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:44 smithi160 ceph-mon[32531]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:45.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.872+0000 7f71af200700 1 -- 172.21.15.44:0/2560097651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71b01023f0 msgr2=0x7f71b01027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:45.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.872+0000 7f71af200700 1 --2- 172.21.15.44:0/2560097651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71b01023f0 0x7f71b01027d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f71a0009990 tx=0x7f71a0009ca0 comp rx=0 tx=0).stop 2024-05-03T22:39:45.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.872+0000 7f71af200700 1 -- 172.21.15.44:0/2560097651 shutdown_connections 2024-05-03T22:39:45.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.872+0000 7f71af200700 1 --2- 172.21.15.44:0/2560097651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71b0107800 0x7f71b0107cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:45.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.872+0000 7f71af200700 1 --2- 172.21.15.44:0/2560097651 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71b01023f0 0x7f71b01027d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:45.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.872+0000 7f71af200700 1 --2- 172.21.15.44:0/2560097651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71b0102d10 0x7f71b01071e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:45.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.872+0000 7f71af200700 1 -- 172.21.15.44:0/2560097651 >> 172.21.15.44:0/2560097651 conn(0x7f71b00fde50 msgr2=0x7f71b0100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:45.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.873+0000 7f71af200700 1 -- 172.21.15.44:0/2560097651 shutdown_connections 2024-05-03T22:39:45.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.873+0000 7f71af200700 1 -- 172.21.15.44:0/2560097651 wait complete. 2024-05-03T22:39:45.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.874+0000 7f71af200700 1 Processor -- start 2024-05-03T22:39:45.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.874+0000 7f71af200700 1 -- start start 2024-05-03T22:39:45.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.874+0000 7f71af200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71b01023f0 0x7f71b01a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:45.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.874+0000 7f71af200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71b0102d10 0x7f71b01a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:45.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.874+0000 7f71af200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71b0107800 0x7f71b01a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:45.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.874+0000 7f71af200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f71b0119de0 con 0x7f71b0107800 2024-05-03T22:39:45.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.874+0000 7f71af200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f71b0119c60 con 0x7f71b01023f0 2024-05-03T22:39:45.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.874+0000 7f71af200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f71b0119f60 con 0x7f71b0102d10 2024-05-03T22:39:45.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.875+0000 7f71ae800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71b0107800 0x7f71b01a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:45.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.875+0000 7f71ae800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71b0107800 0x7f71b01a4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50466/0 (socket says 172.21.15.44:50466) 2024-05-03T22:39:45.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.875+0000 7f71ae800700 1 -- 172.21.15.44:0/788854206 learned_addr learned my addr 172.21.15.44:0/788854206 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:39:45.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.875+0000 7f71ade00700 1 --2- 172.21.15.44:0/788854206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71b01023f0 0x7f71b01a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:45.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.875+0000 7f71ad400700 1 --2- 172.21.15.44:0/788854206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71b0102d10 0x7f71b01a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:45.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.876+0000 7f71ae800700 1 -- 172.21.15.44:0/788854206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71b0102d10 msgr2=0x7f71b01a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:45.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.876+0000 7f71ae800700 1 --2- 172.21.15.44:0/788854206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71b0102d10 0x7f71b01a0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:45.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.876+0000 7f71ae800700 1 -- 172.21.15.44:0/788854206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71b01023f0 msgr2=0x7f71b01a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:45.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.876+0000 7f71ae800700 1 --2- 172.21.15.44:0/788854206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71b01023f0 0x7f71b01a0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:45.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.876+0000 7f71ae800700 1 -- 172.21.15.44:0/788854206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71b01a5240 con 0x7f71b0107800 2024-05-03T22:39:45.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.876+0000 7f71ae800700 1 --2- 172.21.15.44:0/788854206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71b0107800 0x7f71b01a4b00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f71a8007ee0 tx=0x7f71a800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:45.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.876+0000 7f71a6a00700 1 -- 172.21.15.44:0/788854206 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8004bb0 con 0x7f71b0107800 2024-05-03T22:39:45.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.877+0000 7f71a6a00700 1 -- 172.21.15.44:0/788854206 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f71a8004d50 con 0x7f71b0107800 2024-05-03T22:39:45.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.877+0000 7f71af200700 1 -- 172.21.15.44:0/788854206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71b01a5530 con 0x7f71b0107800 2024-05-03T22:39:45.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.877+0000 7f71a6a00700 1 -- 172.21.15.44:0/788854206 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a8005950 con 0x7f71b0107800 2024-05-03T22:39:45.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.877+0000 7f71af200700 1 -- 172.21.15.44:0/788854206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71b01acdb0 con 0x7f71b0107800 2024-05-03T22:39:45.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.878+0000 7f71af200700 1 -- 172.21.15.44:0/788854206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71b006a190 con 0x7f71b0107800 2024-05-03T22:39:45.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.882+0000 7f71a6a00700 1 -- 172.21.15.44:0/788854206 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f71a801a020 con 0x7f71b0107800 2024-05-03T22:39:45.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.883+0000 7f71a6a00700 1 --2- 172.21.15.44:0/788854206 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f71940b2900 0x7f71940b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:45.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.884+0000 7f71a6a00700 1 -- 172.21.15.44:0/788854206 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f71a80e1aa0 con 0x7f71b0107800 2024-05-03T22:39:45.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.884+0000 7f71ade00700 1 --2- 172.21.15.44:0/788854206 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f71940b2900 0x7f71940b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:45.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.885+0000 7f71ade00700 1 --2- 172.21.15.44:0/788854206 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f71940b2900 0x7f71940b4dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f71a0005b00 tx=0x7f71a0005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:45.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:44.887+0000 7f71a6a00700 1 -- 172.21.15.44:0/788854206 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f71a8010070 con 0x7f71b0107800 2024-05-03T22:39:45.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:45.184+0000 7f71af200700 1 -- 172.21.15.44:0/788854206 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71b01a1590 con 0x7f71b0107800 2024-05-03T22:39:45.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:45.185+0000 7f71a6a00700 1 -- 172.21.15.44:0/788854206 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8827 (secure 0 0 0) 0x7f71b01a1590 con 0x7f71b0107800 2024-05-03T22:39:45.188 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:39:45.188 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2550955759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2550955759},{"type":"v1","addr":"172.21.15.44:6835","nonce":2550955759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3118490782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3118490782},{"type":"v1","addr":"172.21.15.44:6837","nonce":3118490782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6839/1408147232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1408147232},{"type":"v1","addr":"172.21.15.44:6839","nonce":1408147232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1332937382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1332937382},{"type":"v1","addr":"172.21.15.160:6835","nonce":1332937382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/3735287805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3735287805},{"type":"v1","addr":"172.21.15.160:6837","nonce":3735287805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/861756806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":861756806},{"type":"v1","addr":"172.21.15.160:6839","nonce":861756806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34391,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/153110190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":153110190},{"type":"v1","addr":"172.21.15.60:6833","nonce":153110190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34409,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3390425489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3390425489},{"type":"v1","addr":"172.21.15.60:6835","nonce":3390425489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34427,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3568217572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3568217572},{"type":"v1","addr":"172.21.15.60:6837","nonce":3568217572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-03T22:39:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:45.188+0000 7f71af200700 1 -- 172.21.15.44:0/788854206 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f71940b2900 msgr2=0x7f71940b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:45.188+0000 7f71af200700 1 --2- 172.21.15.44:0/788854206 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f71940b2900 0x7f71940b4dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f71a0005b00 tx=0x7f71a0005a90 comp rx=0 tx=0).stop 2024-05-03T22:39:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:45.188+0000 7f71af200700 1 -- 172.21.15.44:0/788854206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71b0107800 msgr2=0x7f71b01a4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:45.188+0000 7f71af200700 1 --2- 172.21.15.44:0/788854206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71b0107800 0x7f71b01a4b00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f71a8007ee0 tx=0x7f71a800d3b0 comp rx=0 tx=0).stop 2024-05-03T22:39:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:45.188+0000 7f71af200700 1 -- 172.21.15.44:0/788854206 shutdown_connections 2024-05-03T22:39:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:45.188+0000 7f71af200700 1 --2- 172.21.15.44:0/788854206 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71b0107800 0x7f71b01a4b00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:45.188+0000 7f71af200700 1 --2- 172.21.15.44:0/788854206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71b01023f0 0x7f71b01a0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:45.188+0000 7f71af200700 1 --2- 172.21.15.44:0/788854206 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f71940b2900 0x7f71940b4dc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:45.188+0000 7f71af200700 1 --2- 172.21.15.44:0/788854206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71b0102d10 0x7f71b01a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:45.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:45.188+0000 7f71af200700 1 -- 172.21.15.44:0/788854206 >> 172.21.15.44:0/788854206 conn(0x7f71b00fde50 msgr2=0x7f71b01051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:45.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:45.188+0000 7f71af200700 1 -- 172.21.15.44:0/788854206 shutdown_connections 2024-05-03T22:39:45.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:45.189+0000 7f71af200700 1 -- 172.21.15.44:0/788854206 wait complete. 2024-05-03T22:39:45.192 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 11 2024-05-03T22:39:45.389 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:45 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/788854206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:45.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:45 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/788854206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:45.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:45 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/788854206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:46.736 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:46 smithi044 ceph-mon[28604]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:46.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:46 smithi060 ceph-mon[31721]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:46.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:46 smithi160 ceph-mon[32531]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:47.002 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 22:39:46 smithi044 systemd[1]: Starting Ceph mds.a for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T22:39:47.489 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 22:39:47 smithi044 podman[71389]: 2024-05-03 22:39:47.064045565 +0000 UTC m=+0.034970295 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:39:47.489 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 22:39:47 smithi044 podman[71389]: 2024-05-03 22:39:47.215572381 +0000 UTC m=+0.186497115 container create 8276c737a75ead193e2ac5042545bceafd25b1cea1deb3dd1ee295bfc9a100b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-a, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-03T22:39:47.489 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 22:39:47 smithi044 podman[71389]: 2024-05-03 22:39:47.486295142 +0000 UTC m=+0.457219910 container init 8276c737a75ead193e2ac5042545bceafd25b1cea1deb3dd1ee295bfc9a100b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430) 2024-05-03T22:39:47.752 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 22:39:47 smithi044 podman[71389]: 2024-05-03 22:39:47.497489055 +0000 UTC m=+0.468413797 container start 8276c737a75ead193e2ac5042545bceafd25b1cea1deb3dd1ee295bfc9a100b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-a, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-03T22:39:47.752 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 22:39:47 smithi044 ceph-mds[71408]: -- 172.21.15.44:0/3090501246 <== mon.0 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55718ddefa40 con 0x55718ddc2800 2024-05-03T22:39:47.752 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 22:39:47 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-a[71404]: starting mds.a at 2024-05-03T22:39:47.752 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 22:39:47 smithi044 bash[71389]: 8276c737a75ead193e2ac5042545bceafd25b1cea1deb3dd1ee295bfc9a100b3 2024-05-03T22:39:47.752 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 22:39:47 smithi044 systemd[1]: Started Ceph mds.a for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:39:48.529 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:39:48.615 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:48 smithi044 ceph-mon[28604]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:48.616 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:48 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:48.616 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:48 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:48.616 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:48 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:48.616 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:48 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:48.616 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:48 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:48.616 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:48 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:48 smithi060 ceph-mon[31721]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:48 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:48 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:48 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:48 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:48 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:48 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:48 smithi160 ceph-mon[32531]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:48 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:48.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:48 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:48.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:48 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:48.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:48 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-03T22:39:48.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:48 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-03T22:39:48.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:48 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:48.992 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:39:49.421 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:49 smithi044 ceph-mon[28604]: Deploying daemon mds.b on smithi060 2024-05-03T22:39:49.421 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:49 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.44:6840/4262223160,v1:172.21.15.44:6841/4262223160] up:boot 2024-05-03T22:39:49.422 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:49 smithi044 ceph-mon[28604]: fsmap 11 up:standby 2024-05-03T22:39:49.422 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:49 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-03T22:39:49.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:49 smithi060 ceph-mon[31721]: Deploying daemon mds.b on smithi060 2024-05-03T22:39:49.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:49 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.44:6840/4262223160,v1:172.21.15.44:6841/4262223160] up:boot 2024-05-03T22:39:49.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:49 smithi060 ceph-mon[31721]: fsmap 11 up:standby 2024-05-03T22:39:49.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:49 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-03T22:39:49.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:49 smithi160 ceph-mon[32531]: Deploying daemon mds.b on smithi060 2024-05-03T22:39:49.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:49 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.44:6840/4262223160,v1:172.21.15.44:6841/4262223160] up:boot 2024-05-03T22:39:49.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:49 smithi160 ceph-mon[32531]: fsmap 11 up:standby 2024-05-03T22:39:49.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:49 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-03T22:39:50.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:50 smithi044 ceph-mon[28604]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:50.667 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:50 smithi160 ceph-mon[32531]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:50.694 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:50 smithi060 ceph-mon[31721]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:51.002 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 22:39:51 smithi060 systemd[1]: Starting Ceph mds.b for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T22:39:51.334 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.331+0000 7f0bf6a00700 1 -- 172.21.15.44:0/1803263561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf01033d0 msgr2=0x7f0bf0103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:51.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.331+0000 7f0bf6a00700 1 --2- 172.21.15.44:0/1803263561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf01033d0 0x7f0bf0103850 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc009990 tx=0x7f0bdc009ca0 comp rx=0 tx=0).stop 2024-05-03T22:39:51.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.331+0000 7f0bf6a00700 1 -- 172.21.15.44:0/1803263561 shutdown_connections 2024-05-03T22:39:51.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.331+0000 7f0bf6a00700 1 --2- 172.21.15.44:0/1803263561 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bf0103d90 0x7f0bf01102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:51.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.331+0000 7f0bf6a00700 1 --2- 172.21.15.44:0/1803263561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bf0109460 0x7f0bf0109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:51.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.331+0000 7f0bf6a00700 1 --2- 172.21.15.44:0/1803263561 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf01033d0 0x7f0bf0103850 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:51.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.331+0000 7f0bf6a00700 1 -- 172.21.15.44:0/1803263561 >> 172.21.15.44:0/1803263561 conn(0x7f0bf00fef20 msgr2=0x7f0bf0101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:51.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.332+0000 7f0bf6a00700 1 -- 172.21.15.44:0/1803263561 shutdown_connections 2024-05-03T22:39:51.335 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.332+0000 7f0bf6a00700 1 -- 172.21.15.44:0/1803263561 wait complete. 2024-05-03T22:39:51.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.333+0000 7f0bf6a00700 1 Processor -- start 2024-05-03T22:39:51.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.334+0000 7f0bf6a00700 1 -- start start 2024-05-03T22:39:51.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.334+0000 7f0bf6a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf01033d0 0x7f0bf019f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:51.336 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.334+0000 7f0bf6a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bf0103d90 0x7f0bf019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:51.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.334+0000 7f0bf6a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bf0109460 0x7f0bf01999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:51.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.334+0000 7f0bf6a00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf01136e0 con 0x7f0bf01033d0 2024-05-03T22:39:51.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.334+0000 7f0bf6a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf0113560 con 0x7f0bf0103d90 2024-05-03T22:39:51.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.334+0000 7f0bf6a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0bf0113860 con 0x7f0bf0109460 2024-05-03T22:39:51.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.334+0000 7f0bf5600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf01033d0 0x7f0bf019f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:51.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.334+0000 7f0bf5600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf01033d0 0x7f0bf019f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56004/0 (socket says 172.21.15.44:56004) 2024-05-03T22:39:51.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.335+0000 7f0bf5600700 1 -- 172.21.15.44:0/1455753659 learned_addr learned my addr 172.21.15.44:0/1455753659 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:39:51.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.335+0000 7f0bf4c00700 1 --2- 172.21.15.44:0/1455753659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bf0103d90 0x7f0bf019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:51.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.335+0000 7f0bf5600700 1 -- 172.21.15.44:0/1455753659 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bf0109460 msgr2=0x7f0bf01999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:51.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.335+0000 7f0bf5600700 1 --2- 172.21.15.44:0/1455753659 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bf0109460 0x7f0bf01999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:51.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.335+0000 7f0bf5600700 1 -- 172.21.15.44:0/1455753659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bf0103d90 msgr2=0x7f0bf019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:51.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.335+0000 7f0bf5600700 1 --2- 172.21.15.44:0/1455753659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bf0103d90 0x7f0bf019fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:51.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.335+0000 7f0bf5600700 1 -- 172.21.15.44:0/1455753659 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf019a100 con 0x7f0bf01033d0 2024-05-03T22:39:51.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.336+0000 7f0bf5600700 1 --2- 172.21.15.44:0/1455753659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf01033d0 0x7f0bf019f790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0be400ef10 tx=0x7f0be400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:51.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.336+0000 7f0bee000700 1 -- 172.21.15.44:0/1455753659 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be400ca70 con 0x7f0bf01033d0 2024-05-03T22:39:51.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.336+0000 7f0bee000700 1 -- 172.21.15.44:0/1455753659 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f0be4019070 con 0x7f0bf01033d0 2024-05-03T22:39:51.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.336+0000 7f0bee000700 1 -- 172.21.15.44:0/1455753659 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be40146e0 con 0x7f0bf01033d0 2024-05-03T22:39:51.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.336+0000 7f0bf6a00700 1 -- 172.21.15.44:0/1455753659 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf019a390 con 0x7f0bf01033d0 2024-05-03T22:39:51.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.337+0000 7f0bf6a00700 1 -- 172.21.15.44:0/1455753659 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bf01a6660 con 0x7f0bf01033d0 2024-05-03T22:39:51.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.338+0000 7f0bf6a00700 1 -- 172.21.15.44:0/1455753659 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bf010b940 con 0x7f0bf01033d0 2024-05-03T22:39:51.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.340+0000 7f0bee000700 1 -- 172.21.15.44:0/1455753659 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f0be4012050 con 0x7f0bf01033d0 2024-05-03T22:39:51.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.342+0000 7f0bee000700 1 --2- 172.21.15.44:0/1455753659 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f0bd80b2900 0x7f0bd80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:51.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.342+0000 7f0bee000700 1 -- 172.21.15.44:0/1455753659 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f0be40e1d10 con 0x7f0bf01033d0 2024-05-03T22:39:51.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.342+0000 7f0bf4c00700 1 --2- 172.21.15.44:0/1455753659 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f0bd80b2900 0x7f0bd80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:51.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.343+0000 7f0bf4c00700 1 --2- 172.21.15.44:0/1455753659 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f0bd80b2900 0x7f0bd80b4dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0098e0 tx=0x7f0bdc005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:51.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.347+0000 7f0bee000700 1 -- 172.21.15.44:0/1455753659 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0be40e7020 con 0x7f0bf01033d0 2024-05-03T22:39:51.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:51 smithi044 ceph-mon[28604]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:51.604 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:51 smithi060 ceph-mon[31721]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:51.604 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 22:39:51 smithi060 podman[62469]: 2024-05-03 22:39:51.286071308 +0000 UTC m=+0.037117969 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T22:39:51.604 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 22:39:51 smithi060 podman[62469]: 2024-05-03 22:39:51.407067637 +0000 UTC m=+0.158114320 container create 0922f61147fd52423a14b8b08b65089b088480bc7b4b386a219ca3ee36123fbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0) 2024-05-03T22:39:51.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.638+0000 7f0bf6a00700 1 -- 172.21.15.44:0/1455753659 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0bf006a190 con 0x7f0bf01033d0 2024-05-03T22:39:51.641 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.639+0000 7f0bee000700 1 -- 172.21.15.44:0/1455753659 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9653 (secure 0 0 0) 0x7f0be4010040 con 0x7f0bf01033d0 2024-05-03T22:39:51.642 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:39:51.642 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2550955759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2550955759},{"type":"v1","addr":"172.21.15.44:6835","nonce":2550955759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3118490782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3118490782},{"type":"v1","addr":"172.21.15.44:6837","nonce":3118490782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6839/1408147232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1408147232},{"type":"v1","addr":"172.21.15.44:6839","nonce":1408147232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6841/4262223160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":4262223160},{"type":"v1","addr":"172.21.15.44:6841","nonce":4262223160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1332937382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1332937382},{"type":"v1","addr":"172.21.15.160:6835","nonce":1332937382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/3735287805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3735287805},{"type":"v1","addr":"172.21.15.160:6837","nonce":3735287805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/861756806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":861756806},{"type":"v1","addr":"172.21.15.160:6839","nonce":861756806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34391,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/153110190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":153110190},{"type":"v1","addr":"172.21.15.60:6833","nonce":153110190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34409,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3390425489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3390425489},{"type":"v1","addr":"172.21.15.60:6835","nonce":3390425489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34427,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3568217572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3568217572},{"type":"v1","addr":"172.21.15.60:6837","nonce":3568217572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-03T22:39:51.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.642+0000 7f0bf6a00700 1 -- 172.21.15.44:0/1455753659 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f0bd80b2900 msgr2=0x7f0bd80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:51.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.642+0000 7f0bf6a00700 1 --2- 172.21.15.44:0/1455753659 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f0bd80b2900 0x7f0bd80b4dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0098e0 tx=0x7f0bdc005960 comp rx=0 tx=0).stop 2024-05-03T22:39:51.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.642+0000 7f0bf6a00700 1 -- 172.21.15.44:0/1455753659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf01033d0 msgr2=0x7f0bf019f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:51.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.642+0000 7f0bf6a00700 1 --2- 172.21.15.44:0/1455753659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf01033d0 0x7f0bf019f790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0be400ef10 tx=0x7f0be400c3a0 comp rx=0 tx=0).stop 2024-05-03T22:39:51.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.642+0000 7f0bf6a00700 1 -- 172.21.15.44:0/1455753659 shutdown_connections 2024-05-03T22:39:51.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.642+0000 7f0bf6a00700 1 --2- 172.21.15.44:0/1455753659 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f0bd80b2900 0x7f0bd80b4dc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:51.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.642+0000 7f0bf6a00700 1 --2- 172.21.15.44:0/1455753659 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bf0109460 0x7f0bf01999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:51.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.642+0000 7f0bf6a00700 1 --2- 172.21.15.44:0/1455753659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0bf01033d0 0x7f0bf019f790 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:51.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.642+0000 7f0bf6a00700 1 --2- 172.21.15.44:0/1455753659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bf0103d90 0x7f0bf019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:51.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.643+0000 7f0bf6a00700 1 -- 172.21.15.44:0/1455753659 >> 172.21.15.44:0/1455753659 conn(0x7f0bf00fef20 msgr2=0x7f0bf00ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:51.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.643+0000 7f0bf6a00700 1 -- 172.21.15.44:0/1455753659 shutdown_connections 2024-05-03T22:39:51.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:51.643+0000 7f0bf6a00700 1 -- 172.21.15.44:0/1455753659 wait complete. 2024-05-03T22:39:51.647 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 12 2024-05-03T22:39:51.694 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:51 smithi160 ceph-mon[32531]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:52.006 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 22:39:51 smithi060 podman[62469]: 2024-05-03 22:39:51.694883455 +0000 UTC m=+0.445930181 container init 0922f61147fd52423a14b8b08b65089b088480bc7b4b386a219ca3ee36123fbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T22:39:52.006 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 22:39:51 smithi060 podman[62469]: 2024-05-03 22:39:51.705453369 +0000 UTC m=+0.456500029 container start 0922f61147fd52423a14b8b08b65089b088480bc7b4b386a219ca3ee36123fbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-b, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-03T22:39:52.006 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 22:39:51 smithi060 ceph-mds[62488]: -- 172.21.15.60:0/1082216149 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557f81f83a40 con 0x557f81f56800 2024-05-03T22:39:52.006 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 22:39:51 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-b[62484]: starting mds.b at 2024-05-03T22:39:52.006 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 22:39:51 smithi060 bash[62469]: 0922f61147fd52423a14b8b08b65089b088480bc7b4b386a219ca3ee36123fbc 2024-05-03T22:39:52.006 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 22:39:51 smithi060 systemd[1]: Started Ceph mds.b for 5b0efdca-099c-11ef-bc97-c7b262605968. 2024-05-03T22:39:52.594 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:52 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1455753659' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:52.594 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:52 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:52.594 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:52 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:52.594 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:52 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:52.594 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:52 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:52.594 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:52 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:52.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:52 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1455753659' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:52.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:52 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:52.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:52 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:52.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:52 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:52.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:52 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:52.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:52 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:52.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:52 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1455753659' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:52.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:52 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:52.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:52 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:52.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:52 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:52.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:52 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:52.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:52 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:53.647 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:53 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] up:boot 2024-05-03T22:39:53.647 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:53 smithi160 ceph-mon[32531]: fsmap 12 up:standby 2024-05-03T22:39:53.647 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:53 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T22:39:53.647 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:53 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:39:53.647 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:53 smithi160 ceph-mon[32531]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:53.726 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:53 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] up:boot 2024-05-03T22:39:53.726 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:53 smithi044 ceph-mon[28604]: fsmap 12 up:standby 2024-05-03T22:39:53.726 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T22:39:53.726 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:53 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:39:53.726 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:53 smithi044 ceph-mon[28604]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:53.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:53 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] up:boot 2024-05-03T22:39:53.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:53 smithi060 ceph-mon[31721]: fsmap 12 up:standby 2024-05-03T22:39:53.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:53 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T22:39:53.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:53 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:39:53.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:53 smithi060 ceph-mon[31721]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:54.597 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:39:55.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:54 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:55.029 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:39:55.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:54 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:55.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:54 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:56.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:56 smithi044 ceph-mon[28604]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:56 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:56 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:56 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:56 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:56 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:56 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:56 smithi060 ceph-mon[31721]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:56 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:56 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:56 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:56 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:56 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:56 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:56.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:56 smithi160 ceph-mon[32531]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:56.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:56 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:56.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:56 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:56.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:56 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:56.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:56 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:56.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:56 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:56.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:56 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:57.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.332+0000 7f6ce8600700 1 -- 172.21.15.44:0/3426816315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce0103750 msgr2=0x7f6ce0103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:57.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.332+0000 7f6ce8600700 1 --2- 172.21.15.44:0/3426816315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce0103750 0x7f6ce0103b30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6cd40099c0 tx=0x7f6cd4009cd0 comp rx=0 tx=0).stop 2024-05-03T22:39:57.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.332+0000 7f6ce8600700 1 -- 172.21.15.44:0/3426816315 shutdown_connections 2024-05-03T22:39:57.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.332+0000 7f6ce8600700 1 --2- 172.21.15.44:0/3426816315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ce0108850 0x7f6ce01103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:57.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.332+0000 7f6ce8600700 1 --2- 172.21.15.44:0/3426816315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce0103750 0x7f6ce0103b30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:57.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.332+0000 7f6ce8600700 1 --2- 172.21.15.44:0/3426816315 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ce0104100 0x7f6ce0108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:57.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.332+0000 7f6ce8600700 1 -- 172.21.15.44:0/3426816315 >> 172.21.15.44:0/3426816315 conn(0x7f6ce007a600 msgr2=0x7f6ce007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:57.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.332+0000 7f6ce8600700 1 -- 172.21.15.44:0/3426816315 shutdown_connections 2024-05-03T22:39:57.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.332+0000 7f6ce8600700 1 -- 172.21.15.44:0/3426816315 wait complete. 2024-05-03T22:39:57.339 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:57.339 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:39:57.339 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:57.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.334+0000 7f6ce8600700 1 Processor -- start 2024-05-03T22:39:57.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.334+0000 7f6ce8600700 1 -- start start 2024-05-03T22:39:57.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.334+0000 7f6ce8600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ce0103750 0x7f6ce019be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:57.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.334+0000 7f6ce8600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce0104100 0x7f6ce019c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:57.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.334+0000 7f6ce8600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ce0108850 0x7f6ce01a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:57.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.334+0000 7f6ce8600700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce01137d0 con 0x7f6ce0104100 2024-05-03T22:39:57.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.335+0000 7f6ce8600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce0113650 con 0x7f6ce0103750 2024-05-03T22:39:57.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.335+0000 7f6ce8600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6ce0113950 con 0x7f6ce0108850 2024-05-03T22:39:57.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.335+0000 7f6ce5200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce0104100 0x7f6ce019c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:57.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.335+0000 7f6ce5200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce0104100 0x7f6ce019c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56014/0 (socket says 172.21.15.44:56014) 2024-05-03T22:39:57.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.335+0000 7f6ce5200700 1 -- 172.21.15.44:0/3241700054 learned_addr learned my addr 172.21.15.44:0/3241700054 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:39:57.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.335+0000 7f6ce5c00700 1 --2- 172.21.15.44:0/3241700054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ce0103750 0x7f6ce019be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:57.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.335+0000 7f6ce6600700 1 --2- 172.21.15.44:0/3241700054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ce0108850 0x7f6ce01a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:57.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.335+0000 7f6ce5200700 1 -- 172.21.15.44:0/3241700054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ce0108850 msgr2=0x7f6ce01a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:57.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.335+0000 7f6ce5200700 1 --2- 172.21.15.44:0/3241700054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ce0108850 0x7f6ce01a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:57.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.335+0000 7f6ce5200700 1 -- 172.21.15.44:0/3241700054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ce0103750 msgr2=0x7f6ce019be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:57.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.335+0000 7f6ce5200700 1 --2- 172.21.15.44:0/3241700054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ce0103750 0x7f6ce019be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:57.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.335+0000 7f6ce5200700 1 -- 172.21.15.44:0/3241700054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ce01a0e30 con 0x7f6ce0104100 2024-05-03T22:39:57.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.336+0000 7f6ce5200700 1 --2- 172.21.15.44:0/3241700054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce0104100 0x7f6ce019c360 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00e9c0 tx=0x7f6ccc00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:57.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.336+0000 7f6cde000700 1 -- 172.21.15.44:0/3241700054 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc00cbd0 con 0x7f6ce0104100 2024-05-03T22:39:57.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.336+0000 7f6cde000700 1 -- 172.21.15.44:0/3241700054 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f6ccc00cd70 con 0x7f6ce0104100 2024-05-03T22:39:57.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.336+0000 7f6ce8600700 1 -- 172.21.15.44:0/3241700054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ce01a1120 con 0x7f6ce0104100 2024-05-03T22:39:57.342 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.336+0000 7f6cde000700 1 -- 172.21.15.44:0/3241700054 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc010430 con 0x7f6ce0104100 2024-05-03T22:39:57.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.336+0000 7f6ce8600700 1 -- 172.21.15.44:0/3241700054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ce01a89a0 con 0x7f6ce0104100 2024-05-03T22:39:57.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.338+0000 7f6ce8600700 1 -- 172.21.15.44:0/3241700054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ce006a190 con 0x7f6ce0104100 2024-05-03T22:39:57.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.340+0000 7f6cde000700 1 -- 172.21.15.44:0/3241700054 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f6ccc004750 con 0x7f6ce0104100 2024-05-03T22:39:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.342+0000 7f6cde000700 1 --2- 172.21.15.44:0/3241700054 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6cc80b2880 0x7f6cc80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:39:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.342+0000 7f6cde000700 1 -- 172.21.15.44:0/3241700054 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f6ccc0e21b0 con 0x7f6ce0104100 2024-05-03T22:39:57.344 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.342+0000 7f6ce5c00700 1 --2- 172.21.15.44:0/3241700054 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6cc80b2880 0x7f6cc80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:39:57.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.343+0000 7f6ce5c00700 1 --2- 172.21.15.44:0/3241700054 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6cc80b2880 0x7f6cc80b4d40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4000c00 tx=0x7f6cd4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:39:57.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.346+0000 7f6cde000700 1 -- 172.21.15.44:0/3241700054 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f6ccc0aa370 con 0x7f6ce0104100 2024-05-03T22:39:57.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:57.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:39:57.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:57.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:39:57.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:39:57.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:57.638 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.635+0000 7f6ce8600700 1 -- 172.21.15.44:0/3241700054 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ce019d180 con 0x7f6ce0104100 2024-05-03T22:39:57.639 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.637+0000 7f6cde000700 1 -- 172.21.15.44:0/3241700054 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10479 (secure 0 0 0) 0x7f6ce019d180 con 0x7f6ce0104100 2024-05-03T22:39:57.640 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:39:57.640 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2550955759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2550955759},{"type":"v1","addr":"172.21.15.44:6835","nonce":2550955759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3118490782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3118490782},{"type":"v1","addr":"172.21.15.44:6837","nonce":3118490782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6839/1408147232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1408147232},{"type":"v1","addr":"172.21.15.44:6839","nonce":1408147232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6841/4262223160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":4262223160},{"type":"v1","addr":"172.21.15.44:6841","nonce":4262223160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1332937382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1332937382},{"type":"v1","addr":"172.21.15.160:6835","nonce":1332937382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/3735287805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3735287805},{"type":"v1","addr":"172.21.15.160:6837","nonce":3735287805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/861756806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":861756806},{"type":"v1","addr":"172.21.15.160:6839","nonce":861756806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34391,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/153110190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":153110190},{"type":"v1","addr":"172.21.15.60:6833","nonce":153110190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34409,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3390425489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3390425489},{"type":"v1","addr":"172.21.15.60:6835","nonce":3390425489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34427,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3568217572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3568217572},{"type":"v1","addr":"172.21.15.60:6837","nonce":3568217572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":34463,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/2420093605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2420093605},{"type":"v1","addr":"172.21.15.60:6839","nonce":2420093605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-05-03T22:39:57.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.641+0000 7f6ce8600700 1 -- 172.21.15.44:0/3241700054 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6cc80b2880 msgr2=0x7f6cc80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:57.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.641+0000 7f6ce8600700 1 --2- 172.21.15.44:0/3241700054 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6cc80b2880 0x7f6cc80b4d40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4000c00 tx=0x7f6cd4005fb0 comp rx=0 tx=0).stop 2024-05-03T22:39:57.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.642+0000 7f6ce8600700 1 -- 172.21.15.44:0/3241700054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce0104100 msgr2=0x7f6ce019c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:39:57.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.642+0000 7f6ce8600700 1 --2- 172.21.15.44:0/3241700054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce0104100 0x7f6ce019c360 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00e9c0 tx=0x7f6ccc00ed80 comp rx=0 tx=0).stop 2024-05-03T22:39:57.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.642+0000 7f6ce8600700 1 -- 172.21.15.44:0/3241700054 shutdown_connections 2024-05-03T22:39:57.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.642+0000 7f6ce8600700 1 --2- 172.21.15.44:0/3241700054 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6cc80b2880 0x7f6cc80b4d40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:57.645 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.642+0000 7f6ce8600700 1 --2- 172.21.15.44:0/3241700054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ce0108850 0x7f6ce01a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:57.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.642+0000 7f6ce8600700 1 --2- 172.21.15.44:0/3241700054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ce0103750 0x7f6ce019be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:57.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.642+0000 7f6ce8600700 1 --2- 172.21.15.44:0/3241700054 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ce0104100 0x7f6ce019c360 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:39:57.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.642+0000 7f6ce8600700 1 -- 172.21.15.44:0/3241700054 >> 172.21.15.44:0/3241700054 conn(0x7f6ce007a600 msgr2=0x7f6ce0102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:39:57.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.642+0000 7f6ce8600700 1 -- 172.21.15.44:0/3241700054 shutdown_connections 2024-05-03T22:39:57.646 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:39:57.642+0000 7f6ce8600700 1 -- 172.21.15.44:0/3241700054 wait complete. 2024-05-03T22:39:57.646 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 13 2024-05-03T22:39:58.495 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:58 smithi044 ceph-mon[28604]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:58.495 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:58 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:39:58.495 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:58 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3241700054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:58.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:58 smithi060 ceph-mon[31721]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:58.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:58 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:39:58.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:58 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3241700054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:58.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:58 smithi160 ceph-mon[32531]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:39:58.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:58 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:39:58.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:58 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3241700054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:39:58.557 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-05-03T22:39:59.006 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:39:59.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:59 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:59.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:59 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:39:59.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:39:59 smithi044 ceph-mon[28604]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:00.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:59 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:00.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:59 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:00.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:39:59 smithi060 ceph-mon[31721]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:00.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:59 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:00.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:59 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:00.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:39:59 smithi160 ceph-mon[32531]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:01.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:00 smithi044 ceph-mon[28604]: overall HEALTH_OK 2024-05-03T22:40:01.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:00 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:01.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:00 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:01.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:00 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:01.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:00 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:01.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:00 smithi060 ceph-mon[31721]: overall HEALTH_OK 2024-05-03T22:40:01.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:00 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:01.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:00 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:01.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:00 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:01.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:00 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:01.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:00 smithi160 ceph-mon[32531]: overall HEALTH_OK 2024-05-03T22:40:01.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:00 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:01.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:00 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:01.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:00 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:01.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:00 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:01.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.410+0000 7fd697200700 1 -- 172.21.15.44:0/2784406020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6981055d0 msgr2=0x7fd698105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:01.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.410+0000 7fd697200700 1 --2- 172.21.15.44:0/2784406020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6981055d0 0x7fd698105a50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd680009990 tx=0x7fd680009ca0 comp rx=0 tx=0).stop 2024-05-03T22:40:01.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.410+0000 7fd697200700 1 -- 172.21.15.44:0/2784406020 shutdown_connections 2024-05-03T22:40:01.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.410+0000 7fd697200700 1 --2- 172.21.15.44:0/2784406020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd698105f90 0x7fd6981124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:01.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.410+0000 7fd697200700 1 --2- 172.21.15.44:0/2784406020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd69810b660 0x7fd69810ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:01.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.410+0000 7fd697200700 1 --2- 172.21.15.44:0/2784406020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd6981055d0 0x7fd698105a50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:01.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.410+0000 7fd697200700 1 -- 172.21.15.44:0/2784406020 >> 172.21.15.44:0/2784406020 conn(0x7fd6981010c0 msgr2=0x7fd6981034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:01.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.410+0000 7fd697200700 1 -- 172.21.15.44:0/2784406020 shutdown_connections 2024-05-03T22:40:01.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.410+0000 7fd697200700 1 -- 172.21.15.44:0/2784406020 wait complete. 2024-05-03T22:40:01.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.411+0000 7fd697200700 1 Processor -- start 2024-05-03T22:40:01.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.412+0000 7fd697200700 1 -- start start 2024-05-03T22:40:01.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.412+0000 7fd697200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6981055d0 0x7fd6981a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:01.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.412+0000 7fd697200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd698105f90 0x7fd6981a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:01.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.412+0000 7fd697200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd69810b660 0x7fd69819bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:01.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.412+0000 7fd697200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd6981158e0 con 0x7fd69810b660 2024-05-03T22:40:01.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.412+0000 7fd697200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd698115760 con 0x7fd6981055d0 2024-05-03T22:40:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.412+0000 7fd697200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd698115a60 con 0x7fd698105f90 2024-05-03T22:40:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.412+0000 7fd696800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd69810b660 0x7fd69819bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.412+0000 7fd696800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd69810b660 0x7fd69819bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39244/0 (socket says 172.21.15.44:39244) 2024-05-03T22:40:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.412+0000 7fd696800700 1 -- 172.21.15.44:0/1097174070 learned_addr learned my addr 172.21.15.44:0/1097174070 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:40:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.412+0000 7fd695e00700 1 --2- 172.21.15.44:0/1097174070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6981055d0 0x7fd6981a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.413+0000 7fd68d400700 1 --2- 172.21.15.44:0/1097174070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd698105f90 0x7fd6981a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.413+0000 7fd696800700 1 -- 172.21.15.44:0/1097174070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd698105f90 msgr2=0x7fd6981a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.413+0000 7fd696800700 1 --2- 172.21.15.44:0/1097174070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd698105f90 0x7fd6981a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.413+0000 7fd696800700 1 -- 172.21.15.44:0/1097174070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6981055d0 msgr2=0x7fd6981a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.413+0000 7fd696800700 1 --2- 172.21.15.44:0/1097174070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6981055d0 0x7fd6981a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.413+0000 7fd696800700 1 -- 172.21.15.44:0/1097174070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69819c280 con 0x7fd69810b660 2024-05-03T22:40:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.413+0000 7fd696800700 1 --2- 172.21.15.44:0/1097174070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd69810b660 0x7fd69819bb20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd69000c970 tx=0x7fd69000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:01.470 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.414+0000 7fd68f400700 1 -- 172.21.15.44:0/1097174070 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd690004a30 con 0x7fd69810b660 2024-05-03T22:40:01.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.414+0000 7fd68f400700 1 -- 172.21.15.44:0/1097174070 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fd6900054f0 con 0x7fd69810b660 2024-05-03T22:40:01.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.414+0000 7fd697200700 1 -- 172.21.15.44:0/1097174070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69819c570 con 0x7fd69810b660 2024-05-03T22:40:01.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.414+0000 7fd68f400700 1 -- 172.21.15.44:0/1097174070 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69000ec80 con 0x7fd69810b660 2024-05-03T22:40:01.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.414+0000 7fd697200700 1 -- 172.21.15.44:0/1097174070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6981a87e0 con 0x7fd69810b660 2024-05-03T22:40:01.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.415+0000 7fd697200700 1 -- 172.21.15.44:0/1097174070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd69806a190 con 0x7fd69810b660 2024-05-03T22:40:01.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.417+0000 7fd68f400700 1 -- 172.21.15.44:0/1097174070 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd690005020 con 0x7fd69810b660 2024-05-03T22:40:01.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.419+0000 7fd68f400700 1 --2- 172.21.15.44:0/1097174070 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd67c0b2880 0x7fd67c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:01.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.419+0000 7fd68f400700 1 -- 172.21.15.44:0/1097174070 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7fd6900e1c60 con 0x7fd69810b660 2024-05-03T22:40:01.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.419+0000 7fd695e00700 1 --2- 172.21.15.44:0/1097174070 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd67c0b2880 0x7fd67c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:01.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.420+0000 7fd695e00700 1 --2- 172.21.15.44:0/1097174070 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd67c0b2880 0x7fd67c0b4d40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd698106710 tx=0x7fd68800c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:01.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.423+0000 7fd68f400700 1 -- 172.21.15.44:0/1097174070 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd690014030 con 0x7fd69810b660 2024-05-03T22:40:01.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.665+0000 7fd697200700 1 -- 172.21.15.44:0/1097174070 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd69819cfc0 con 0x7fd69810b660 2024-05-03T22:40:01.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.670+0000 7fd68f400700 1 -- 172.21.15.44:0/1097174070 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) ==== 84+0+65 (secure 0 0 0) 0x7fd690005310 con 0x7fd69810b660 2024-05-03T22:40:01.671 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:40:01.672 INFO:teuthology.orchestra.run.smithi044.stdout:[ 2024-05-03T22:40:01.672 INFO:teuthology.orchestra.run.smithi044.stdout: { 2024-05-03T22:40:01.672 INFO:teuthology.orchestra.run.smithi044.stdout: "poolnum": 1, 2024-05-03T22:40:01.672 INFO:teuthology.orchestra.run.smithi044.stdout: "poolname": ".mgr" 2024-05-03T22:40:01.672 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-03T22:40:01.672 INFO:teuthology.orchestra.run.smithi044.stdout:] 2024-05-03T22:40:01.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.673+0000 7fd697200700 1 -- 172.21.15.44:0/1097174070 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd67c0b2880 msgr2=0x7fd67c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:01.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.673+0000 7fd697200700 1 --2- 172.21.15.44:0/1097174070 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd67c0b2880 0x7fd67c0b4d40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd698106710 tx=0x7fd68800c040 comp rx=0 tx=0).stop 2024-05-03T22:40:01.674 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.673+0000 7fd697200700 1 -- 172.21.15.44:0/1097174070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd69810b660 msgr2=0x7fd69819bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:01.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.673+0000 7fd697200700 1 --2- 172.21.15.44:0/1097174070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd69810b660 0x7fd69819bb20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd69000c970 tx=0x7fd69000cc80 comp rx=0 tx=0).stop 2024-05-03T22:40:01.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.673+0000 7fd697200700 1 -- 172.21.15.44:0/1097174070 shutdown_connections 2024-05-03T22:40:01.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.673+0000 7fd697200700 1 --2- 172.21.15.44:0/1097174070 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd69810b660 0x7fd69819bb20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:01.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.673+0000 7fd697200700 1 --2- 172.21.15.44:0/1097174070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6981055d0 0x7fd6981a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:01.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.673+0000 7fd697200700 1 --2- 172.21.15.44:0/1097174070 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd67c0b2880 0x7fd67c0b4d40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:01.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.673+0000 7fd697200700 1 --2- 172.21.15.44:0/1097174070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd698105f90 0x7fd6981a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:01.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.673+0000 7fd697200700 1 -- 172.21.15.44:0/1097174070 >> 172.21.15.44:0/1097174070 conn(0x7fd6981010c0 msgr2=0x7fd6981026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:01.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.673+0000 7fd697200700 1 -- 172.21.15.44:0/1097174070 shutdown_connections 2024-05-03T22:40:01.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:01.673+0000 7fd697200700 1 -- 172.21.15.44:0/1097174070 wait complete. 2024-05-03T22:40:02.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:01 smithi044 ceph-mon[28604]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:02.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:01 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1097174070' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-03T22:40:02.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:01 smithi060 ceph-mon[31721]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:02.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:01 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1097174070' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-03T22:40:02.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:01 smithi160 ceph-mon[32531]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:02.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:01 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1097174070' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-03T22:40:02.627 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-03T22:40:02.627 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-03T22:40:03.105 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:40:04.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:04 smithi160 ceph-mon[32531]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:04.298 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:04 smithi044 ceph-mon[28604]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:04.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:04 smithi060 ceph-mon[31721]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:05.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.239+0000 7f80d0400700 1 -- 172.21.15.44:0/1699538156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80c8075ff0 msgr2=0x7f80c810f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:05.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.239+0000 7f80d0400700 1 --2- 172.21.15.44:0/1699538156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80c8075ff0 0x7f80c810f960 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009990 tx=0x7f80b4009ca0 comp rx=0 tx=0).stop 2024-05-03T22:40:05.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.239+0000 7f80d0400700 1 -- 172.21.15.44:0/1699538156 shutdown_connections 2024-05-03T22:40:05.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.239+0000 7f80d0400700 1 --2- 172.21.15.44:0/1699538156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80c810fea0 0x7f80c8112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:05.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.239+0000 7f80d0400700 1 --2- 172.21.15.44:0/1699538156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c80756d0 0x7f80c8075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:05.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.239+0000 7f80d0400700 1 --2- 172.21.15.44:0/1699538156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80c8075ff0 0x7f80c810f960 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:05.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.239+0000 7f80d0400700 1 -- 172.21.15.44:0/1699538156 >> 172.21.15.44:0/1699538156 conn(0x7f80c807a600 msgr2=0x7f80c807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:05.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.239+0000 7f80d0400700 1 -- 172.21.15.44:0/1699538156 shutdown_connections 2024-05-03T22:40:05.241 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.239+0000 7f80d0400700 1 -- 172.21.15.44:0/1699538156 wait complete. 2024-05-03T22:40:05.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.240+0000 7f80d0400700 1 Processor -- start 2024-05-03T22:40:05.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.240+0000 7f80d0400700 1 -- start start 2024-05-03T22:40:05.242 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.241+0000 7f80d0400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c80756d0 0x7f80c819be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:05.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.241+0000 7f80d0400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80c8075ff0 0x7f80c819c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:05.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.241+0000 7f80d0400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80c810fea0 0x7f80c81a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:05.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.241+0000 7f80d0400700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f80c81159f0 con 0x7f80c8075ff0 2024-05-03T22:40:05.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.241+0000 7f80d0400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f80c8115870 con 0x7f80c810fea0 2024-05-03T22:40:05.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.241+0000 7f80d0400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f80c8115b70 con 0x7f80c80756d0 2024-05-03T22:40:05.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.241+0000 7f80cd000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80c8075ff0 0x7f80c819c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:05.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.241+0000 7f80cd000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80c8075ff0 0x7f80c819c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39252/0 (socket says 172.21.15.44:39252) 2024-05-03T22:40:05.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.241+0000 7f80cd000700 1 -- 172.21.15.44:0/1357791270 learned_addr learned my addr 172.21.15.44:0/1357791270 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:40:05.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.241+0000 7f80ce400700 1 --2- 172.21.15.44:0/1357791270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80c810fea0 0x7f80c81a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:05.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.241+0000 7f80cda00700 1 --2- 172.21.15.44:0/1357791270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c80756d0 0x7f80c819be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:05.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.242+0000 7f80cd000700 1 -- 172.21.15.44:0/1357791270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c80756d0 msgr2=0x7f80c819be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:05.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.242+0000 7f80cd000700 1 --2- 172.21.15.44:0/1357791270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c80756d0 0x7f80c819be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:05.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.242+0000 7f80cd000700 1 -- 172.21.15.44:0/1357791270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80c810fea0 msgr2=0x7f80c81a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:05.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.242+0000 7f80cd000700 1 --2- 172.21.15.44:0/1357791270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80c810fea0 0x7f80c81a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:05.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.242+0000 7f80cd000700 1 -- 172.21.15.44:0/1357791270 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c81a0e50 con 0x7f80c8075ff0 2024-05-03T22:40:05.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.242+0000 7f80cd000700 1 --2- 172.21.15.44:0/1357791270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80c8075ff0 0x7f80c819c380 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f80b4000c00 tx=0x7f80b4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:05.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.242+0000 7f80c6000700 1 -- 172.21.15.44:0/1357791270 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b4027070 con 0x7f80c8075ff0 2024-05-03T22:40:05.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.242+0000 7f80c6000700 1 -- 172.21.15.44:0/1357791270 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f80b4003f70 con 0x7f80c8075ff0 2024-05-03T22:40:05.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.242+0000 7f80d0400700 1 -- 172.21.15.44:0/1357791270 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c81a10e0 con 0x7f80c8075ff0 2024-05-03T22:40:05.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.242+0000 7f80c6000700 1 -- 172.21.15.44:0/1357791270 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b4022df0 con 0x7f80c8075ff0 2024-05-03T22:40:05.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.243+0000 7f80d0400700 1 -- 172.21.15.44:0/1357791270 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c81a89c0 con 0x7f80c8075ff0 2024-05-03T22:40:05.245 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.244+0000 7f80d0400700 1 -- 172.21.15.44:0/1357791270 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c806a190 con 0x7f80c8075ff0 2024-05-03T22:40:05.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.246+0000 7f80c6000700 1 -- 172.21.15.44:0/1357791270 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f80b402a070 con 0x7f80c8075ff0 2024-05-03T22:40:05.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.248+0000 7f80c6000700 1 --2- 172.21.15.44:0/1357791270 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f80b00b2880 0x7f80b00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:05.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.249+0000 7f80c6000700 1 -- 172.21.15.44:0/1357791270 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7127+0+0 (secure 0 0 0) 0x7f80b40e33b0 con 0x7f80c8075ff0 2024-05-03T22:40:05.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.249+0000 7f80cda00700 1 --2- 172.21.15.44:0/1357791270 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f80b00b2880 0x7f80b00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:05.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.250+0000 7f80cda00700 1 --2- 172.21.15.44:0/1357791270 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f80b00b2880 0x7f80b00b4d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f80bc005950 tx=0x7f80bc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:05.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.251+0000 7f80c6000700 1 -- 172.21.15.44:0/1357791270 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f80b4031020 con 0x7f80c8075ff0 2024-05-03T22:40:05.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.488+0000 7f80d0400700 1 -- 172.21.15.44:0/1357791270 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f80c802e510 con 0x7f80c8075ff0 2024-05-03T22:40:05.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.648+0000 7f80c6000700 1 -- 172.21.15.44:0/1357791270 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) ==== 138+0+0 (secure 0 0 0) 0x7f80b4013070 con 0x7f80c8075ff0 2024-05-03T22:40:05.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.653+0000 7f80d0400700 1 -- 172.21.15.44:0/1357791270 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f80b00b2880 msgr2=0x7f80b00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:05.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.653+0000 7f80d0400700 1 --2- 172.21.15.44:0/1357791270 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f80b00b2880 0x7f80b00b4d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f80bc005950 tx=0x7f80bc0058e0 comp rx=0 tx=0).stop 2024-05-03T22:40:05.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.653+0000 7f80d0400700 1 -- 172.21.15.44:0/1357791270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80c8075ff0 msgr2=0x7f80c819c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:05.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.653+0000 7f80d0400700 1 --2- 172.21.15.44:0/1357791270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80c8075ff0 0x7f80c819c380 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f80b4000c00 tx=0x7f80b4005ef0 comp rx=0 tx=0).stop 2024-05-03T22:40:05.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.654+0000 7f80d0400700 1 -- 172.21.15.44:0/1357791270 shutdown_connections 2024-05-03T22:40:05.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.654+0000 7f80d0400700 1 --2- 172.21.15.44:0/1357791270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80c810fea0 0x7f80c81a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:05.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.654+0000 7f80d0400700 1 --2- 172.21.15.44:0/1357791270 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f80b00b2880 0x7f80b00b4d40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:05.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.654+0000 7f80d0400700 1 --2- 172.21.15.44:0/1357791270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f80c80756d0 0x7f80c819be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:05.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.654+0000 7f80d0400700 1 --2- 172.21.15.44:0/1357791270 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f80c8075ff0 0x7f80c819c380 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:05.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.654+0000 7f80d0400700 1 -- 172.21.15.44:0/1357791270 >> 172.21.15.44:0/1357791270 conn(0x7f80c807a600 msgr2=0x7f80c8100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:05.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.655+0000 7f80d0400700 1 -- 172.21.15.44:0/1357791270 shutdown_connections 2024-05-03T22:40:05.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:05.655+0000 7f80d0400700 1 -- 172.21.15.44:0/1357791270 wait complete. 2024-05-03T22:40:05.663 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' created 2024-05-03T22:40:05.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:05.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:05.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:40:05.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:40:05.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:05.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:05 smithi044 ceph-mon[28604]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:05.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:05 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1357791270' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-03T22:40:06.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:06.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:06.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:40:06.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:40:06.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:06.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:05 smithi060 ceph-mon[31721]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:06.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:05 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1357791270' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-03T22:40:06.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:06.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:06.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:40:06.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:40:06.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:40:06.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:05 smithi160 ceph-mon[32531]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:06.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:05 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1357791270' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-03T22:40:06.682 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-03T22:40:07.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:06 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1357791270' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-03T22:40:07.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:06 smithi044 ceph-mon[28604]: osdmap e72: 12 total, 12 up, 12 in 2024-05-03T22:40:07.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:06 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1357791270' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-03T22:40:07.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:06 smithi060 ceph-mon[31721]: osdmap e72: 12 total, 12 up, 12 in 2024-05-03T22:40:07.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:06 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1357791270' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-03T22:40:07.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:06 smithi160 ceph-mon[32531]: osdmap e72: 12 total, 12 up, 12 in 2024-05-03T22:40:07.123 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:40:07.923 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:07 smithi044 ceph-mon[28604]: osdmap e73: 12 total, 12 up, 12 in 2024-05-03T22:40:07.923 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:07 smithi044 ceph-mon[28604]: pgmap v362: 33 pgs: 8 creating+peering, 1 active+clean, 24 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:08.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:07 smithi060 ceph-mon[31721]: osdmap e73: 12 total, 12 up, 12 in 2024-05-03T22:40:08.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:07 smithi060 ceph-mon[31721]: pgmap v362: 33 pgs: 8 creating+peering, 1 active+clean, 24 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:08.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:07 smithi160 ceph-mon[32531]: osdmap e73: 12 total, 12 up, 12 in 2024-05-03T22:40:08.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:07 smithi160 ceph-mon[32531]: pgmap v362: 33 pgs: 8 creating+peering, 1 active+clean, 24 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:08.897 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:08 smithi044 ceph-mon[28604]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T22:40:08.897 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:08 smithi044 ceph-mon[28604]: osdmap e74: 12 total, 12 up, 12 in 2024-05-03T22:40:09.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:08 smithi060 ceph-mon[31721]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T22:40:09.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:08 smithi060 ceph-mon[31721]: osdmap e74: 12 total, 12 up, 12 in 2024-05-03T22:40:09.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:08 smithi160 ceph-mon[32531]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T22:40:09.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:08 smithi160 ceph-mon[32531]: osdmap e74: 12 total, 12 up, 12 in 2024-05-03T22:40:09.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.466+0000 7f153d600700 1 -- 172.21.15.44:0/572033404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1538104eb0 msgr2=0x7f153810d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:09.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.466+0000 7f153d600700 1 --2- 172.21.15.44:0/572033404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1538104eb0 0x7f153810d3a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1520009990 tx=0x7f1520009ca0 comp rx=0 tx=0).stop 2024-05-03T22:40:09.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.466+0000 7f153d600700 1 -- 172.21.15.44:0/572033404 shutdown_connections 2024-05-03T22:40:09.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.466+0000 7f153d600700 1 --2- 172.21.15.44:0/572033404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f153810d9c0 0x7f153810fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:09.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.466+0000 7f153d600700 1 --2- 172.21.15.44:0/572033404 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1538104590 0x7f1538104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:09.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.466+0000 7f153d600700 1 --2- 172.21.15.44:0/572033404 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1538104eb0 0x7f153810d3a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:09.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.466+0000 7f153d600700 1 -- 172.21.15.44:0/572033404 >> 172.21.15.44:0/572033404 conn(0x7f15380fddc0 msgr2=0x7f15381001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:09.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.466+0000 7f153d600700 1 -- 172.21.15.44:0/572033404 shutdown_connections 2024-05-03T22:40:09.469 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.466+0000 7f153d600700 1 -- 172.21.15.44:0/572033404 wait complete. 2024-05-03T22:40:09.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.467+0000 7f153d600700 1 Processor -- start 2024-05-03T22:40:09.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.468+0000 7f153d600700 1 -- start start 2024-05-03T22:40:09.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.468+0000 7f153d600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1538104590 0x7f15381a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:09.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.468+0000 7f153d600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1538104eb0 0x7f15381a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:09.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.468+0000 7f153d600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f153810d9c0 0x7f153819baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:09.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.468+0000 7f153d600700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1538113720 con 0x7f1538104590 2024-05-03T22:40:09.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.468+0000 7f153d600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f15381135a0 con 0x7f1538104eb0 2024-05-03T22:40:09.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.468+0000 7f153d600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f15381138a0 con 0x7f153810d9c0 2024-05-03T22:40:09.471 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.469+0000 7f1537e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1538104590 0x7f15381a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:09.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.469+0000 7f1537e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1538104590 0x7f15381a1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:39284/0 (socket says 172.21.15.44:39284) 2024-05-03T22:40:09.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.469+0000 7f1537e00700 1 -- 172.21.15.44:0/52679847 learned_addr learned my addr 172.21.15.44:0/52679847 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:40:09.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.469+0000 7f153cc00700 1 --2- 172.21.15.44:0/52679847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f153810d9c0 0x7f153819baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:09.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.469+0000 7f152f400700 1 --2- 172.21.15.44:0/52679847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1538104eb0 0x7f15381a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:09.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.469+0000 7f1537e00700 1 -- 172.21.15.44:0/52679847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f153810d9c0 msgr2=0x7f153819baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:09.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.469+0000 7f1537e00700 1 --2- 172.21.15.44:0/52679847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f153810d9c0 0x7f153819baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:09.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.469+0000 7f1537e00700 1 -- 172.21.15.44:0/52679847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1538104eb0 msgr2=0x7f15381a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:09.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.469+0000 7f1537e00700 1 --2- 172.21.15.44:0/52679847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1538104eb0 0x7f15381a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:09.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.469+0000 7f1537e00700 1 -- 172.21.15.44:0/52679847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f153819c250 con 0x7f1538104590 2024-05-03T22:40:09.472 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.470+0000 7f1537e00700 1 --2- 172.21.15.44:0/52679847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1538104590 0x7f15381a1930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1528007e20 tx=0x7f152800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:09.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.470+0000 7f1535600700 1 -- 172.21.15.44:0/52679847 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1528016020 con 0x7f1538104590 2024-05-03T22:40:09.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.470+0000 7f1535600700 1 -- 172.21.15.44:0/52679847 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f152800ae00 con 0x7f1538104590 2024-05-03T22:40:09.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.470+0000 7f153d600700 1 -- 172.21.15.44:0/52679847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f153819c540 con 0x7f1538104590 2024-05-03T22:40:09.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.470+0000 7f1535600700 1 -- 172.21.15.44:0/52679847 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1528011760 con 0x7f1538104590 2024-05-03T22:40:09.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.470+0000 7f153d600700 1 -- 172.21.15.44:0/52679847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15381a8800 con 0x7f1538104590 2024-05-03T22:40:09.473 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.471+0000 7f153d600700 1 -- 172.21.15.44:0/52679847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f153806a190 con 0x7f1538104590 2024-05-03T22:40:09.475 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.474+0000 7f1535600700 1 -- 172.21.15.44:0/52679847 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f1528019020 con 0x7f1538104590 2024-05-03T22:40:09.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.475+0000 7f1535600700 1 --2- 172.21.15.44:0/52679847 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f151c0b2900 0x7f151c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:09.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.475+0000 7f1535600700 1 -- 172.21.15.44:0/52679847 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7497+0+0 (secure 0 0 0) 0x7f15280e24a0 con 0x7f1538104590 2024-05-03T22:40:09.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.476+0000 7f152f400700 1 --2- 172.21.15.44:0/52679847 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f151c0b2900 0x7f151c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:09.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.476+0000 7f152f400700 1 --2- 172.21.15.44:0/52679847 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f151c0b2900 0x7f151c0b4dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f152000b5c0 tx=0x7f1520005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:09.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.478+0000 7f1535600700 1 -- 172.21.15.44:0/52679847 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f15280aa450 con 0x7f1538104590 2024-05-03T22:40:09.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:09.717+0000 7f153d600700 1 -- 172.21.15.44:0/52679847 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f153819cfe0 con 0x7f1538104590 2024-05-03T22:40:10.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:09 smithi044 ceph-mon[28604]: pgmap v364: 33 pgs: 8 creating+peering, 9 active+clean, 16 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:10.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:09 smithi060 ceph-mon[31721]: pgmap v364: 33 pgs: 8 creating+peering, 9 active+clean, 16 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:10.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:09 smithi160 ceph-mon[32531]: pgmap v364: 33 pgs: 8 creating+peering, 9 active+clean, 16 unknown; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:10.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:10.717+0000 7f1535600700 1 -- 172.21.15.44:0/52679847 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v75) ==== 171+0+0 (secure 0 0 0) 0x7f15280a9d50 con 0x7f1538104590 2024-05-03T22:40:10.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:10.722+0000 7f153d600700 1 -- 172.21.15.44:0/52679847 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f151c0b2900 msgr2=0x7f151c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:10.724 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:10.722+0000 7f153d600700 1 --2- 172.21.15.44:0/52679847 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f151c0b2900 0x7f151c0b4dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f152000b5c0 tx=0x7f1520005fd0 comp rx=0 tx=0).stop 2024-05-03T22:40:10.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:10.723+0000 7f153d600700 1 -- 172.21.15.44:0/52679847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1538104590 msgr2=0x7f15381a1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:10.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:10.723+0000 7f153d600700 1 --2- 172.21.15.44:0/52679847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1538104590 0x7f15381a1930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1528007e20 tx=0x7f152800a340 comp rx=0 tx=0).stop 2024-05-03T22:40:10.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:10.723+0000 7f153d600700 1 -- 172.21.15.44:0/52679847 shutdown_connections 2024-05-03T22:40:10.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:10.723+0000 7f153d600700 1 --2- 172.21.15.44:0/52679847 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f151c0b2900 0x7f151c0b4dc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:10.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:10.723+0000 7f153d600700 1 --2- 172.21.15.44:0/52679847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f153810d9c0 0x7f153819baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:10.725 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:10.723+0000 7f153d600700 1 --2- 172.21.15.44:0/52679847 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1538104590 0x7f15381a1930 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:10.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:10.723+0000 7f153d600700 1 --2- 172.21.15.44:0/52679847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1538104eb0 0x7f15381a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:10.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:10.723+0000 7f153d600700 1 -- 172.21.15.44:0/52679847 >> 172.21.15.44:0/52679847 conn(0x7f15380fddc0 msgr2=0x7f153810fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:10.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:10.723+0000 7f153d600700 1 -- 172.21.15.44:0/52679847 shutdown_connections 2024-05-03T22:40:10.726 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:10.723+0000 7f153d600700 1 -- 172.21.15.44:0/52679847 wait complete. 2024-05-03T22:40:10.728 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' created 2024-05-03T22:40:11.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:10 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/52679847' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-03T22:40:11.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:10 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/52679847' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-03T22:40:11.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:10 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/52679847' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-03T22:40:11.644 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-03T22:40:12.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:11 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/52679847' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-03T22:40:12.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:11 smithi044 ceph-mon[28604]: osdmap e75: 12 total, 12 up, 12 in 2024-05-03T22:40:12.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:11 smithi044 ceph-mon[28604]: pgmap v366: 97 pgs: 64 unknown, 8 creating+peering, 25 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:12.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:11 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/52679847' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-03T22:40:12.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:11 smithi060 ceph-mon[31721]: osdmap e75: 12 total, 12 up, 12 in 2024-05-03T22:40:12.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:11 smithi060 ceph-mon[31721]: pgmap v366: 97 pgs: 64 unknown, 8 creating+peering, 25 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:12.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:11 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/52679847' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-03T22:40:12.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:11 smithi160 ceph-mon[32531]: osdmap e75: 12 total, 12 up, 12 in 2024-05-03T22:40:12.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:11 smithi160 ceph-mon[32531]: pgmap v366: 97 pgs: 64 unknown, 8 creating+peering, 25 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:12.159 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:40:13.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:12 smithi044 ceph-mon[28604]: osdmap e76: 12 total, 12 up, 12 in 2024-05-03T22:40:13.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:12 smithi060 ceph-mon[31721]: osdmap e76: 12 total, 12 up, 12 in 2024-05-03T22:40:13.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:12 smithi160 ceph-mon[32531]: osdmap e76: 12 total, 12 up, 12 in 2024-05-03T22:40:14.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:13 smithi160 ceph-mon[32531]: osdmap e77: 12 total, 12 up, 12 in 2024-05-03T22:40:14.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:13 smithi160 ceph-mon[32531]: pgmap v369: 97 pgs: 7 creating+peering, 50 unknown, 40 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:14.098 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:13 smithi044 ceph-mon[28604]: osdmap e77: 12 total, 12 up, 12 in 2024-05-03T22:40:14.098 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:13 smithi044 ceph-mon[28604]: pgmap v369: 97 pgs: 7 creating+peering, 50 unknown, 40 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:14.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:13 smithi060 ceph-mon[31721]: osdmap e77: 12 total, 12 up, 12 in 2024-05-03T22:40:14.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:13 smithi060 ceph-mon[31721]: pgmap v369: 97 pgs: 7 creating+peering, 50 unknown, 40 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:14.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.451+0000 7f6657a00700 1 -- 172.21.15.44:0/1621412482 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f665010fb60 msgr2=0x7f665010ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:14.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.451+0000 7f6657a00700 1 --2- 172.21.15.44:0/1621412482 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f665010fb60 0x7f665010ff40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6644009990 tx=0x7f6644009ca0 comp rx=0 tx=0).stop 2024-05-03T22:40:14.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.451+0000 7f6657a00700 1 -- 172.21.15.44:0/1621412482 shutdown_connections 2024-05-03T22:40:14.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.451+0000 7f6657a00700 1 --2- 172.21.15.44:0/1621412482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f665010a490 0x7f66501169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:14.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.451+0000 7f6657a00700 1 --2- 172.21.15.44:0/1621412482 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f665010fb60 0x7f665010ff40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:14.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.451+0000 7f6657a00700 1 --2- 172.21.15.44:0/1621412482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6650109ad0 0x7f6650109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:14.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.451+0000 7f6657a00700 1 -- 172.21.15.44:0/1621412482 >> 172.21.15.44:0/1621412482 conn(0x7f6650076c70 msgr2=0x7f66501082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:14.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.451+0000 7f6657a00700 1 -- 172.21.15.44:0/1621412482 shutdown_connections 2024-05-03T22:40:14.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.451+0000 7f6657a00700 1 -- 172.21.15.44:0/1621412482 wait complete. 2024-05-03T22:40:14.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.452+0000 7f6657a00700 1 Processor -- start 2024-05-03T22:40:14.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.453+0000 7f6657a00700 1 -- start start 2024-05-03T22:40:14.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.453+0000 7f6657a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6650109ad0 0x7f66501a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:14.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.453+0000 7f6657a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f665010a490 0x7f66501a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:14.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.453+0000 7f6657a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f665010fb60 0x7f66501a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:14.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.453+0000 7f6657a00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6650119df0 con 0x7f665010fb60 2024-05-03T22:40:14.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.453+0000 7f6657a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6650119c70 con 0x7f6650109ad0 2024-05-03T22:40:14.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.453+0000 7f6657a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6650119f70 con 0x7f665010a490 2024-05-03T22:40:14.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.453+0000 7f6655a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f665010fb60 0x7f66501a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:14.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.454+0000 7f6655a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f665010fb60 0x7f66501a4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58792/0 (socket says 172.21.15.44:58792) 2024-05-03T22:40:14.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.454+0000 7f6655a00700 1 -- 172.21.15.44:0/2398853471 learned_addr learned my addr 172.21.15.44:0/2398853471 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:40:14.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.454+0000 7f6655000700 1 --2- 172.21.15.44:0/2398853471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6650109ad0 0x7f66501a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:14.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.454+0000 7f664fe00700 1 --2- 172.21.15.44:0/2398853471 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f665010a490 0x7f66501a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:14.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.454+0000 7f6655a00700 1 -- 172.21.15.44:0/2398853471 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f665010a490 msgr2=0x7f66501a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:14.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.454+0000 7f6655a00700 1 --2- 172.21.15.44:0/2398853471 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f665010a490 0x7f66501a07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:14.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.454+0000 7f6655a00700 1 -- 172.21.15.44:0/2398853471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6650109ad0 msgr2=0x7f66501a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:14.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.454+0000 7f6655a00700 1 --2- 172.21.15.44:0/2398853471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6650109ad0 0x7f66501a02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:14.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.454+0000 7f6655a00700 1 -- 172.21.15.44:0/2398853471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66501a5260 con 0x7f665010fb60 2024-05-03T22:40:14.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.454+0000 7f6655a00700 1 --2- 172.21.15.44:0/2398853471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f665010fb60 0x7f66501a4b20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f664800ef30 tx=0x7f664800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:14.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.455+0000 7f664d600700 1 -- 172.21.15.44:0/2398853471 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66480092e0 con 0x7f665010fb60 2024-05-03T22:40:14.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.455+0000 7f664d600700 1 -- 172.21.15.44:0/2398853471 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f6648004bb0 con 0x7f665010fb60 2024-05-03T22:40:14.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.455+0000 7f6657a00700 1 -- 172.21.15.44:0/2398853471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66501a54f0 con 0x7f665010fb60 2024-05-03T22:40:14.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.455+0000 7f664d600700 1 -- 172.21.15.44:0/2398853471 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648004280 con 0x7f665010fb60 2024-05-03T22:40:14.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.455+0000 7f6657a00700 1 -- 172.21.15.44:0/2398853471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66501acdd0 con 0x7f665010fb60 2024-05-03T22:40:14.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.456+0000 7f6657a00700 1 -- 172.21.15.44:0/2398853471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6650112060 con 0x7f665010fb60 2024-05-03T22:40:14.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.459+0000 7f664d600700 1 -- 172.21.15.44:0/2398853471 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f664801b030 con 0x7f665010fb60 2024-05-03T22:40:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.460+0000 7f664d600700 1 --2- 172.21.15.44:0/2398853471 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f66380b2980 0x7f66380b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:14.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.460+0000 7f664d600700 1 -- 172.21.15.44:0/2398853471 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7879+0+0 (secure 0 0 0) 0x7f66480e24f0 con 0x7f665010fb60 2024-05-03T22:40:14.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.460+0000 7f6655000700 1 --2- 172.21.15.44:0/2398853471 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f66380b2980 0x7f66380b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:14.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.461+0000 7f6655000700 1 --2- 172.21.15.44:0/2398853471 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f66380b2980 0x7f66380b4e40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f664400b2e0 tx=0x7f6644005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.463+0000 7f664d600700 1 -- 172.21.15.44:0/2398853471 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f6648022020 con 0x7f665010fb60 2024-05-03T22:40:14.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.757+0000 7f6657a00700 1 -- 172.21.15.44:0/2398853471 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f665006a190 con 0x7f665010fb60 2024-05-03T22:40:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.813+0000 7f664d600700 1 -- 172.21.15.44:0/2398853471 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f6648010040 con 0x7f665010fb60 2024-05-03T22:40:14.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.818+0000 7f6657a00700 1 -- 172.21.15.44:0/2398853471 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f66380b2980 msgr2=0x7f66380b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:14.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.818+0000 7f6657a00700 1 --2- 172.21.15.44:0/2398853471 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f66380b2980 0x7f66380b4e40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f664400b2e0 tx=0x7f6644005960 comp rx=0 tx=0).stop 2024-05-03T22:40:14.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.818+0000 7f6657a00700 1 -- 172.21.15.44:0/2398853471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f665010fb60 msgr2=0x7f66501a4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:14.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.818+0000 7f6657a00700 1 --2- 172.21.15.44:0/2398853471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f665010fb60 0x7f66501a4b20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f664800ef30 tx=0x7f664800c3a0 comp rx=0 tx=0).stop 2024-05-03T22:40:14.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.818+0000 7f6657a00700 1 -- 172.21.15.44:0/2398853471 shutdown_connections 2024-05-03T22:40:14.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.818+0000 7f6657a00700 1 --2- 172.21.15.44:0/2398853471 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f665010fb60 0x7f66501a4b20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:14.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.818+0000 7f6657a00700 1 --2- 172.21.15.44:0/2398853471 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6650109ad0 0x7f66501a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:14.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.818+0000 7f6657a00700 1 --2- 172.21.15.44:0/2398853471 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f66380b2980 0x7f66380b4e40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:14.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.818+0000 7f6657a00700 1 --2- 172.21.15.44:0/2398853471 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f665010a490 0x7f66501a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:14.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.818+0000 7f6657a00700 1 -- 172.21.15.44:0/2398853471 >> 172.21.15.44:0/2398853471 conn(0x7f6650076c70 msgr2=0x7f6650077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:14.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.818+0000 7f6657a00700 1 -- 172.21.15.44:0/2398853471 shutdown_connections 2024-05-03T22:40:14.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:14.818+0000 7f6657a00700 1 -- 172.21.15.44:0/2398853471 wait complete. 2024-05-03T22:40:14.821 INFO:teuthology.orchestra.run.smithi044.stderr:new fs with metadata pool 2 and data pool 3 2024-05-03T22:40:15.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:14 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2398853471' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-03T22:40:15.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:14 smithi060 ceph-mon[31721]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-03T22:40:15.229 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:14 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2398853471' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-03T22:40:15.229 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:14 smithi044 ceph-mon[28604]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-03T22:40:15.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:14 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2398853471' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-03T22:40:15.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:14 smithi160 ceph-mon[32531]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-03T22:40:15.785 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-03T22:40:15.785 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-03T22:40:15.842 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:15 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2398853471' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-03T22:40:15.842 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:15 smithi060 ceph-mon[31721]: osdmap e78: 12 total, 12 up, 12 in 2024-05-03T22:40:15.842 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:15 smithi060 ceph-mon[31721]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-03T22:40:15.842 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:15 smithi060 ceph-mon[31721]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-03T22:40:16.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:15 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2398853471' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-03T22:40:16.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:15 smithi044 ceph-mon[28604]: osdmap e78: 12 total, 12 up, 12 in 2024-05-03T22:40:16.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:15 smithi044 ceph-mon[28604]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-03T22:40:16.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:15 smithi044 ceph-mon[28604]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-03T22:40:16.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:15 smithi044 ceph-mon[28604]: pgmap v371: 97 pgs: 7 creating+peering, 6 unknown, 84 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:16.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:15 smithi060 ceph-mon[31721]: pgmap v371: 97 pgs: 7 creating+peering, 6 unknown, 84 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:16.263 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:40:16.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:15 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2398853471' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-03T22:40:16.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:15 smithi160 ceph-mon[32531]: osdmap e78: 12 total, 12 up, 12 in 2024-05-03T22:40:16.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:15 smithi160 ceph-mon[32531]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-03T22:40:16.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:15 smithi160 ceph-mon[32531]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-03T22:40:16.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:15 smithi160 ceph-mon[32531]: pgmap v371: 97 pgs: 7 creating+peering, 6 unknown, 84 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:17.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:16 smithi044 ceph-mon[28604]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-03T22:40:17.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:16 smithi044 ceph-mon[28604]: Cluster is now healthy 2024-05-03T22:40:17.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:16 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] up:active 2024-05-03T22:40:17.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:16 smithi044 ceph-mon[28604]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:40:17.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:16 smithi044 ceph-mon[28604]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:40:17.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:16 smithi060 ceph-mon[31721]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-03T22:40:17.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:16 smithi060 ceph-mon[31721]: Cluster is now healthy 2024-05-03T22:40:17.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:16 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] up:active 2024-05-03T22:40:17.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:16 smithi060 ceph-mon[31721]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:40:17.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:16 smithi060 ceph-mon[31721]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:40:17.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:16 smithi160 ceph-mon[32531]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-03T22:40:17.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:16 smithi160 ceph-mon[32531]: Cluster is now healthy 2024-05-03T22:40:17.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:16 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] up:active 2024-05-03T22:40:17.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:16 smithi160 ceph-mon[32531]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:40:17.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:16 smithi160 ceph-mon[32531]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:40:17.755 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 22:40:17 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-b[62484]: 2024-05-03T22:40:17.370+0000 7f3849e00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-03T22:40:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:17 smithi044 ceph-mon[28604]: pgmap v372: 97 pgs: 97 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2024-05-03T22:40:18.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:17 smithi060 ceph-mon[31721]: pgmap v372: 97 pgs: 97 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2024-05-03T22:40:18.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:17 smithi160 ceph-mon[32531]: pgmap v372: 97 pgs: 97 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 1 op/s 2024-05-03T22:40:18.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.565+0000 7f6ee8c00700 1 -- 172.21.15.44:0/3288882476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ee410b680 msgr2=0x7f6ee410ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:18.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.566+0000 7f6ee8c00700 1 --2- 172.21.15.44:0/3288882476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ee410b680 0x7f6ee410ba60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6ed40099c0 tx=0x7f6ed4009cd0 comp rx=0 tx=0).stop 2024-05-03T22:40:18.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.566+0000 7f6ee8c00700 1 -- 172.21.15.44:0/3288882476 shutdown_connections 2024-05-03T22:40:18.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.566+0000 7f6ee8c00700 1 --2- 172.21.15.44:0/3288882476 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ee4105f90 0x7f6ee4112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:18.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.566+0000 7f6ee8c00700 1 --2- 172.21.15.44:0/3288882476 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ee410b680 0x7f6ee410ba60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:18.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.566+0000 7f6ee8c00700 1 --2- 172.21.15.44:0/3288882476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee41055d0 0x7f6ee4105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:18.568 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.566+0000 7f6ee8c00700 1 -- 172.21.15.44:0/3288882476 >> 172.21.15.44:0/3288882476 conn(0x7f6ee4101080 msgr2=0x7f6ee41034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:18.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.566+0000 7f6ee8c00700 1 -- 172.21.15.44:0/3288882476 shutdown_connections 2024-05-03T22:40:18.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.566+0000 7f6ee8c00700 1 -- 172.21.15.44:0/3288882476 wait complete. 2024-05-03T22:40:18.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.567+0000 7f6ee8c00700 1 Processor -- start 2024-05-03T22:40:18.569 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.568+0000 7f6ee8c00700 1 -- start start 2024-05-03T22:40:18.570 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.568+0000 7f6ee8c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ee41055d0 0x7f6ee41a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.568+0000 7f6ee8c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee4105f90 0x7f6ee41a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.568+0000 7f6ee8c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ee410b680 0x7f6ee419bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.568+0000 7f6ee8c00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee41158f0 con 0x7f6ee410b680 2024-05-03T22:40:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.568+0000 7f6ee8c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee4115770 con 0x7f6ee4105f90 2024-05-03T22:40:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.568+0000 7f6ee8c00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee4115a70 con 0x7f6ee41055d0 2024-05-03T22:40:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.569+0000 7f6ee3e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ee410b680 0x7f6ee419bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.569+0000 7f6ee3e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ee410b680 0x7f6ee419bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:58816/0 (socket says 172.21.15.44:58816) 2024-05-03T22:40:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.569+0000 7f6ee3e00700 1 -- 172.21.15.44:0/1817373468 learned_addr learned my addr 172.21.15.44:0/1817373468 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:40:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.569+0000 7f6ee3400700 1 --2- 172.21.15.44:0/1817373468 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ee41055d0 0x7f6ee41a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.569+0000 7f6ee2a00700 1 --2- 172.21.15.44:0/1817373468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee4105f90 0x7f6ee41a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.569+0000 7f6ee3e00700 1 -- 172.21.15.44:0/1817373468 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ee41055d0 msgr2=0x7f6ee41a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.569+0000 7f6ee3e00700 1 --2- 172.21.15.44:0/1817373468 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ee41055d0 0x7f6ee41a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.569+0000 7f6ee3e00700 1 -- 172.21.15.44:0/1817373468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee4105f90 msgr2=0x7f6ee41a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:18.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.569+0000 7f6ee3e00700 1 --2- 172.21.15.44:0/1817373468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee4105f90 0x7f6ee41a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:18.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.569+0000 7f6ee3e00700 1 -- 172.21.15.44:0/1817373468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee419c230 con 0x7f6ee410b680 2024-05-03T22:40:18.572 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.569+0000 7f6ee2a00700 1 --2- 172.21.15.44:0/1817373468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee4105f90 0x7f6ee41a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:40:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.570+0000 7f6ee3e00700 1 --2- 172.21.15.44:0/1817373468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ee410b680 0x7f6ee419bad0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6edc007d70 tx=0x7f6edc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.570+0000 7f6edbe00700 1 -- 172.21.15.44:0/1817373468 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc016020 con 0x7f6ee410b680 2024-05-03T22:40:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.570+0000 7f6edbe00700 1 -- 172.21.15.44:0/1817373468 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f6edc00ad40 con 0x7f6ee410b680 2024-05-03T22:40:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.570+0000 7f6edbe00700 1 -- 172.21.15.44:0/1817373468 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc011600 con 0x7f6ee410b680 2024-05-03T22:40:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.570+0000 7f6ee8c00700 1 -- 172.21.15.44:0/1817373468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee419c520 con 0x7f6ee410b680 2024-05-03T22:40:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.570+0000 7f6ee8c00700 1 -- 172.21.15.44:0/1817373468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee41a8790 con 0x7f6ee410b680 2024-05-03T22:40:18.573 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.571+0000 7f6ee8c00700 1 -- 172.21.15.44:0/1817373468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee410db10 con 0x7f6ee410b680 2024-05-03T22:40:18.575 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.574+0000 7f6edbe00700 1 -- 172.21.15.44:0/1817373468 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f6edc019020 con 0x7f6ee410b680 2024-05-03T22:40:18.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.575+0000 7f6edbe00700 1 --2- 172.21.15.44:0/1817373468 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6ec80b2880 0x7f6ec80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:18.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.575+0000 7f6edbe00700 1 -- 172.21.15.44:0/1817373468 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7979+0+0 (secure 0 0 0) 0x7f6edc0e20c0 con 0x7f6ee410b680 2024-05-03T22:40:18.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.575+0000 7f6ee3400700 1 --2- 172.21.15.44:0/1817373468 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6ec80b2880 0x7f6ec80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:18.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.576+0000 7f6ee3400700 1 --2- 172.21.15.44:0/1817373468 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6ec80b2880 0x7f6ec80b4d40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4000c00 tx=0x7f6ed4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:18.581 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.580+0000 7f6edbe00700 1 -- 172.21.15.44:0/1817373468 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f6edc020020 con 0x7f6ee410b680 2024-05-03T22:40:18.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.832+0000 7f6ee8c00700 1 -- 172.21.15.44:0/1817373468 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f6ee419cfb0 con 0x7f6ee410b680 2024-05-03T22:40:18.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.863+0000 7f6edbe00700 1 -- 172.21.15.44:0/1817373468 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v79) ==== 157+0+0 (secure 0 0 0) 0x7f6edc0a9e90 con 0x7f6ee410b680 2024-05-03T22:40:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.867+0000 7f6ee8c00700 1 -- 172.21.15.44:0/1817373468 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6ec80b2880 msgr2=0x7f6ec80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.867+0000 7f6ee8c00700 1 --2- 172.21.15.44:0/1817373468 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6ec80b2880 0x7f6ec80b4d40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4000c00 tx=0x7f6ed4005fb0 comp rx=0 tx=0).stop 2024-05-03T22:40:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.867+0000 7f6ee8c00700 1 -- 172.21.15.44:0/1817373468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ee410b680 msgr2=0x7f6ee419bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.867+0000 7f6ee8c00700 1 --2- 172.21.15.44:0/1817373468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ee410b680 0x7f6ee419bad0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6edc007d70 tx=0x7f6edc00a340 comp rx=0 tx=0).stop 2024-05-03T22:40:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.867+0000 7f6ee8c00700 1 -- 172.21.15.44:0/1817373468 shutdown_connections 2024-05-03T22:40:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.867+0000 7f6ee8c00700 1 --2- 172.21.15.44:0/1817373468 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ee410b680 0x7f6ee419bad0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.867+0000 7f6ee8c00700 1 --2- 172.21.15.44:0/1817373468 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6ec80b2880 0x7f6ec80b4d40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.867+0000 7f6ee8c00700 1 --2- 172.21.15.44:0/1817373468 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ee41055d0 0x7f6ee41a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.867+0000 7f6ee8c00700 1 --2- 172.21.15.44:0/1817373468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ee4105f90 0x7f6ee41a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.867+0000 7f6ee8c00700 1 -- 172.21.15.44:0/1817373468 >> 172.21.15.44:0/1817373468 conn(0x7f6ee4101080 msgr2=0x7f6ee4102640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:18.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.868+0000 7f6ee8c00700 1 -- 172.21.15.44:0/1817373468 shutdown_connections 2024-05-03T22:40:18.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:18.868+0000 7f6ee8c00700 1 -- 172.21.15.44:0/1817373468 wait complete. 2024-05-03T22:40:19.250 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:18 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1817373468' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-03T22:40:19.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:18 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1817373468' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-03T22:40:19.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:18 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1817373468' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-03T22:40:19.654 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-03T22:40:20.127 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:40:20.167 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:19 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1817373468' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-03T22:40:20.167 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:19 smithi160 ceph-mon[32531]: osdmap e79: 12 total, 12 up, 12 in 2024-05-03T22:40:20.167 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:19 smithi160 ceph-mon[32531]: pgmap v374: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 988 B/s wr, 2 op/s 2024-05-03T22:40:20.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:19 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1817373468' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-03T22:40:20.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:19 smithi044 ceph-mon[28604]: osdmap e79: 12 total, 12 up, 12 in 2024-05-03T22:40:20.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:19 smithi044 ceph-mon[28604]: pgmap v374: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 988 B/s wr, 2 op/s 2024-05-03T22:40:20.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:19 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1817373468' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-03T22:40:20.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:19 smithi060 ceph-mon[31721]: osdmap e79: 12 total, 12 up, 12 in 2024-05-03T22:40:20.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:19 smithi060 ceph-mon[31721]: pgmap v374: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 988 B/s wr, 2 op/s 2024-05-03T22:40:22.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:22 smithi160 ceph-mon[32531]: pgmap v375: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-03T22:40:22.266 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:22 smithi044 ceph-mon[28604]: pgmap v375: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-03T22:40:22.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:22 smithi060 ceph-mon[31721]: pgmap v375: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-03T22:40:22.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.580+0000 7f9ad2600700 1 -- 172.21.15.44:0/1352639659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9acc10b5e0 msgr2=0x7f9acc10b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:22.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.580+0000 7f9ad2600700 1 --2- 172.21.15.44:0/1352639659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9acc10b5e0 0x7f9acc10b9c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9abc0099c0 tx=0x7f9abc009cd0 comp rx=0 tx=0).stop 2024-05-03T22:40:22.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.580+0000 7f9ad2600700 1 -- 172.21.15.44:0/1352639659 shutdown_connections 2024-05-03T22:40:22.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.580+0000 7f9ad2600700 1 --2- 172.21.15.44:0/1352639659 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9acc105ef0 0x7f9acc1123b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:22.582 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.580+0000 7f9ad2600700 1 --2- 172.21.15.44:0/1352639659 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9acc10b5e0 0x7f9acc10b9c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:22.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.580+0000 7f9ad2600700 1 --2- 172.21.15.44:0/1352639659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9acc105530 0x7f9acc1059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:22.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.580+0000 7f9ad2600700 1 -- 172.21.15.44:0/1352639659 >> 172.21.15.44:0/1352639659 conn(0x7f9acc101020 msgr2=0x7f9acc103440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:22.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.580+0000 7f9ad2600700 1 -- 172.21.15.44:0/1352639659 shutdown_connections 2024-05-03T22:40:22.583 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.580+0000 7f9ad2600700 1 -- 172.21.15.44:0/1352639659 wait complete. 2024-05-03T22:40:22.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.581+0000 7f9ad2600700 1 Processor -- start 2024-05-03T22:40:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.581+0000 7f9ad2600700 1 -- start start 2024-05-03T22:40:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.582+0000 7f9ad2600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9acc105530 0x7f9acc1a16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.582+0000 7f9ad2600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9acc105ef0 0x7f9acc1a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.582+0000 7f9ad2600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9acc10b5e0 0x7f9acc19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.582+0000 7f9ad2600700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc115850 con 0x7f9acc105530 2024-05-03T22:40:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.582+0000 7f9ad2600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc1156d0 con 0x7f9acc10b5e0 2024-05-03T22:40:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.582+0000 7f9ad2600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9acc1159d0 con 0x7f9acc105ef0 2024-05-03T22:40:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.582+0000 7f9ad1200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9acc105530 0x7f9acc1a16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.582+0000 7f9ad1200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9acc105530 0x7f9acc1a16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52380/0 (socket says 172.21.15.44:52380) 2024-05-03T22:40:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.582+0000 7f9ad1200700 1 -- 172.21.15.44:0/3332952563 learned_addr learned my addr 172.21.15.44:0/3332952563 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:40:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.582+0000 7f9ad1c00700 1 --2- 172.21.15.44:0/3332952563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9acc10b5e0 0x7f9acc19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:22.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.582+0000 7f9ac3e00700 1 --2- 172.21.15.44:0/3332952563 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9acc105ef0 0x7f9acc1a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.583+0000 7f9ad1200700 1 -- 172.21.15.44:0/3332952563 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9acc105ef0 msgr2=0x7f9acc1a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.583+0000 7f9ad1200700 1 --2- 172.21.15.44:0/3332952563 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9acc105ef0 0x7f9acc1a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.583+0000 7f9ad1200700 1 -- 172.21.15.44:0/3332952563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9acc10b5e0 msgr2=0x7f9acc19b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.583+0000 7f9ad1200700 1 --2- 172.21.15.44:0/3332952563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9acc10b5e0 0x7f9acc19b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.583+0000 7f9ad1200700 1 -- 172.21.15.44:0/3332952563 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9acc19c010 con 0x7f9acc105530 2024-05-03T22:40:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.583+0000 7f9ac3e00700 1 --2- 172.21.15.44:0/3332952563 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9acc105ef0 0x7f9acc1a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:40:22.586 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.583+0000 7f9ad1200700 1 --2- 172.21.15.44:0/3332952563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9acc105530 0x7f9acc1a16f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9abc005b40 tx=0x7f9abc005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:22.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.584+0000 7f9aca000700 1 -- 172.21.15.44:0/3332952563 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc027070 con 0x7f9acc105530 2024-05-03T22:40:22.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.584+0000 7f9aca000700 1 -- 172.21.15.44:0/3332952563 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f9abc004160 con 0x7f9acc105530 2024-05-03T22:40:22.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.584+0000 7f9aca000700 1 -- 172.21.15.44:0/3332952563 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9abc00f460 con 0x7f9acc105530 2024-05-03T22:40:22.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.584+0000 7f9ad2600700 1 -- 172.21.15.44:0/3332952563 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9acc19c2a0 con 0x7f9acc105530 2024-05-03T22:40:22.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.584+0000 7f9ad2600700 1 -- 172.21.15.44:0/3332952563 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9acc1a85c0 con 0x7f9acc105530 2024-05-03T22:40:22.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.585+0000 7f9ad2600700 1 -- 172.21.15.44:0/3332952563 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9acc064b00 con 0x7f9acc105530 2024-05-03T22:40:22.589 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.588+0000 7f9aca000700 1 -- 172.21.15.44:0/3332952563 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9abc02a070 con 0x7f9acc105530 2024-05-03T22:40:22.590 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.589+0000 7f9aca000700 1 --2- 172.21.15.44:0/3332952563 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9ab00b29b0 0x7f9ab00b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:22.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.589+0000 7f9aca000700 1 -- 172.21.15.44:0/3332952563 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8277+0+0 (secure 0 0 0) 0x7f9abc0e39f0 con 0x7f9acc105530 2024-05-03T22:40:22.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.589+0000 7f9ac3e00700 1 --2- 172.21.15.44:0/3332952563 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9ab00b29b0 0x7f9ab00b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:22.591 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.590+0000 7f9ac3e00700 1 --2- 172.21.15.44:0/3332952563 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9ab00b29b0 0x7f9ab00b4e70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4005fd0 tx=0x7f9ab4005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:22.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.592+0000 7f9aca000700 1 -- 172.21.15.44:0/3332952563 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f9abc031020 con 0x7f9acc105530 2024-05-03T22:40:22.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:22.836+0000 7f9ad2600700 1 -- 172.21.15.44:0/3332952563 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f9acc19cde0 con 0x7f9acc105530 2024-05-03T22:40:23.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:23 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3332952563' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-03T22:40:23.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:23 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3332952563' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-03T22:40:23.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:23 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3332952563' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-03T22:40:24.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:24.033+0000 7f9aca000700 1 -- 172.21.15.44:0/3332952563 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v81) ==== 228+0+0 (secure 0 0 0) 0x7f9abc013070 con 0x7f9acc105530 2024-05-03T22:40:24.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:24.037+0000 7f9ad2600700 1 -- 172.21.15.44:0/3332952563 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9ab00b29b0 msgr2=0x7f9ab00b4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:24.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:24.037+0000 7f9ad2600700 1 --2- 172.21.15.44:0/3332952563 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9ab00b29b0 0x7f9ab00b4e70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4005fd0 tx=0x7f9ab4005e30 comp rx=0 tx=0).stop 2024-05-03T22:40:24.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:24.037+0000 7f9ad2600700 1 -- 172.21.15.44:0/3332952563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9acc105530 msgr2=0x7f9acc1a16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:24.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:24.037+0000 7f9ad2600700 1 --2- 172.21.15.44:0/3332952563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9acc105530 0x7f9acc1a16f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9abc005b40 tx=0x7f9abc005640 comp rx=0 tx=0).stop 2024-05-03T22:40:24.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:24.038+0000 7f9ad2600700 1 -- 172.21.15.44:0/3332952563 shutdown_connections 2024-05-03T22:40:24.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:24.038+0000 7f9ad2600700 1 --2- 172.21.15.44:0/3332952563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9acc10b5e0 0x7f9acc19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:24.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:24.038+0000 7f9ad2600700 1 --2- 172.21.15.44:0/3332952563 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9acc105530 0x7f9acc1a16f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:24.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:24.038+0000 7f9ad2600700 1 --2- 172.21.15.44:0/3332952563 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9ab00b29b0 0x7f9ab00b4e70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:24.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:24.038+0000 7f9ad2600700 1 --2- 172.21.15.44:0/3332952563 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9acc105ef0 0x7f9acc1a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:24.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:24.038+0000 7f9ad2600700 1 -- 172.21.15.44:0/3332952563 >> 172.21.15.44:0/3332952563 conn(0x7f9acc101020 msgr2=0x7f9acc10c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:24.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:24.038+0000 7f9ad2600700 1 -- 172.21.15.44:0/3332952563 shutdown_connections 2024-05-03T22:40:24.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:24.039+0000 7f9ad2600700 1 -- 172.21.15.44:0/3332952563 wait complete. 2024-05-03T22:40:24.043 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data_ec' created 2024-05-03T22:40:24.286 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:24 smithi044 ceph-mon[28604]: pgmap v376: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-03T22:40:24.287 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:24 smithi044 ceph-mon[28604]: osdmap e80: 12 total, 12 up, 12 in 2024-05-03T22:40:24.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:24 smithi060 ceph-mon[31721]: pgmap v376: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-03T22:40:24.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:24 smithi060 ceph-mon[31721]: osdmap e80: 12 total, 12 up, 12 in 2024-05-03T22:40:24.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:24 smithi160 ceph-mon[32531]: pgmap v376: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-03T22:40:24.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:24 smithi160 ceph-mon[32531]: osdmap e80: 12 total, 12 up, 12 in 2024-05-03T22:40:25.205 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-03T22:40:25.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:25 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3332952563' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-03T22:40:25.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:25 smithi044 ceph-mon[28604]: osdmap e81: 12 total, 12 up, 12 in 2024-05-03T22:40:25.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:25 smithi044 ceph-mon[28604]: osdmap e82: 12 total, 12 up, 12 in 2024-05-03T22:40:25.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:25 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3332952563' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-03T22:40:25.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:25 smithi060 ceph-mon[31721]: osdmap e81: 12 total, 12 up, 12 in 2024-05-03T22:40:25.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:25 smithi060 ceph-mon[31721]: osdmap e82: 12 total, 12 up, 12 in 2024-05-03T22:40:25.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:25 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3332952563' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-03T22:40:25.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:25 smithi160 ceph-mon[32531]: osdmap e81: 12 total, 12 up, 12 in 2024-05-03T22:40:25.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:25 smithi160 ceph-mon[32531]: osdmap e82: 12 total, 12 up, 12 in 2024-05-03T22:40:25.649 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:40:26.387 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:26 smithi044 ceph-mon[28604]: pgmap v379: 129 pgs: 13 creating+peering, 19 unknown, 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-05-03T22:40:26.387 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:26 smithi044 ceph-mon[28604]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T22:40:26.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:26 smithi060 ceph-mon[31721]: pgmap v379: 129 pgs: 13 creating+peering, 19 unknown, 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-05-03T22:40:26.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:26 smithi060 ceph-mon[31721]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T22:40:26.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:26 smithi160 ceph-mon[32531]: pgmap v379: 129 pgs: 13 creating+peering, 19 unknown, 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s wr, 4 op/s 2024-05-03T22:40:26.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:26 smithi160 ceph-mon[32531]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-03T22:40:27.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:27 smithi044 ceph-mon[28604]: osdmap e83: 12 total, 12 up, 12 in 2024-05-03T22:40:27.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:27 smithi060 ceph-mon[31721]: osdmap e83: 12 total, 12 up, 12 in 2024-05-03T22:40:27.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:27 smithi160 ceph-mon[32531]: osdmap e83: 12 total, 12 up, 12 in 2024-05-03T22:40:28.180 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:28 smithi044 ceph-mon[28604]: pgmap v382: 129 pgs: 13 creating+peering, 10 unknown, 106 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:28.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.179+0000 7fcc2de00700 1 -- 172.21.15.44:0/2468171239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc281055d0 msgr2=0x7fcc28105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:28.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.179+0000 7fcc2de00700 1 --2- 172.21.15.44:0/2468171239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc281055d0 0x7fcc28105a50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcc140099c0 tx=0x7fcc14009cd0 comp rx=0 tx=0).stop 2024-05-03T22:40:28.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.179+0000 7fcc2de00700 1 -- 172.21.15.44:0/2468171239 shutdown_connections 2024-05-03T22:40:28.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.179+0000 7fcc2de00700 1 --2- 172.21.15.44:0/2468171239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc28105f90 0x7fcc28112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:28.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.179+0000 7fcc2de00700 1 --2- 172.21.15.44:0/2468171239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc2810b680 0x7fcc2810ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:28.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.179+0000 7fcc2de00700 1 --2- 172.21.15.44:0/2468171239 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc281055d0 0x7fcc28105a50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:28.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.179+0000 7fcc2de00700 1 -- 172.21.15.44:0/2468171239 >> 172.21.15.44:0/2468171239 conn(0x7fcc281010e0 msgr2=0x7fcc28103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:28.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.180+0000 7fcc2de00700 1 -- 172.21.15.44:0/2468171239 shutdown_connections 2024-05-03T22:40:28.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.180+0000 7fcc2de00700 1 -- 172.21.15.44:0/2468171239 wait complete. 2024-05-03T22:40:28.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.181+0000 7fcc2de00700 1 Processor -- start 2024-05-03T22:40:28.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.181+0000 7fcc2de00700 1 -- start start 2024-05-03T22:40:28.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.181+0000 7fcc2de00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc281055d0 0x7fcc281a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:28.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.181+0000 7fcc2de00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc28105f90 0x7fcc281a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:28.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.181+0000 7fcc2de00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc2810b680 0x7fcc2819bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:28.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.181+0000 7fcc2de00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fcc28115900 con 0x7fcc28105f90 2024-05-03T22:40:28.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.182+0000 7fcc2de00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcc28115780 con 0x7fcc281055d0 2024-05-03T22:40:28.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.182+0000 7fcc2de00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcc28115a80 con 0x7fcc2810b680 2024-05-03T22:40:28.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.182+0000 7fcc27e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc28105f90 0x7fcc281a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:28.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.182+0000 7fcc27e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc28105f90 0x7fcc281a1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52394/0 (socket says 172.21.15.44:52394) 2024-05-03T22:40:28.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.182+0000 7fcc27e00700 1 -- 172.21.15.44:0/1500306929 learned_addr learned my addr 172.21.15.44:0/1500306929 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:40:28.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.182+0000 7fcc2ca00700 1 --2- 172.21.15.44:0/1500306929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc281055d0 0x7fcc281a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:28.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.182+0000 7fcc2d400700 1 --2- 172.21.15.44:0/1500306929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc2810b680 0x7fcc2819bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:28.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.182+0000 7fcc27e00700 1 -- 172.21.15.44:0/1500306929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc2810b680 msgr2=0x7fcc2819bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:28.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.182+0000 7fcc27e00700 1 --2- 172.21.15.44:0/1500306929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc2810b680 0x7fcc2819bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:28.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.182+0000 7fcc27e00700 1 -- 172.21.15.44:0/1500306929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc281055d0 msgr2=0x7fcc281a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:28.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.182+0000 7fcc27e00700 1 --2- 172.21.15.44:0/1500306929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc281055d0 0x7fcc281a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:28.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.182+0000 7fcc27e00700 1 -- 172.21.15.44:0/1500306929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2819c260 con 0x7fcc28105f90 2024-05-03T22:40:28.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.182+0000 7fcc2ca00700 1 --2- 172.21.15.44:0/1500306929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc281055d0 0x7fcc281a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:40:28.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.183+0000 7fcc27e00700 1 --2- 172.21.15.44:0/1500306929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc28105f90 0x7fcc281a1e30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcc14006010 tx=0x7fcc14009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:28.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.183+0000 7fcc25600700 1 -- 172.21.15.44:0/1500306929 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc14026070 con 0x7fcc28105f90 2024-05-03T22:40:28.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.183+0000 7fcc2de00700 1 -- 172.21.15.44:0/1500306929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc2819c4f0 con 0x7fcc28105f90 2024-05-03T22:40:28.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.183+0000 7fcc25600700 1 -- 172.21.15.44:0/1500306929 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fcc14004cc0 con 0x7fcc28105f90 2024-05-03T22:40:28.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.183+0000 7fcc2de00700 1 -- 172.21.15.44:0/1500306929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc281a87c0 con 0x7fcc28105f90 2024-05-03T22:40:28.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.183+0000 7fcc25600700 1 -- 172.21.15.44:0/1500306929 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc14003d50 con 0x7fcc28105f90 2024-05-03T22:40:28.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.185+0000 7fcc2de00700 1 -- 172.21.15.44:0/1500306929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc2810db10 con 0x7fcc28105f90 2024-05-03T22:40:28.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.187+0000 7fcc25600700 1 -- 172.21.15.44:0/1500306929 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fcc14029070 con 0x7fcc28105f90 2024-05-03T22:40:28.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.188+0000 7fcc25600700 1 --2- 172.21.15.44:0/1500306929 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fcc100b2880 0x7fcc100b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:28.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.189+0000 7fcc25600700 1 -- 172.21.15.44:0/1500306929 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8770+0+0 (secure 0 0 0) 0x7fcc140e2de0 con 0x7fcc28105f90 2024-05-03T22:40:28.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.189+0000 7fcc2ca00700 1 --2- 172.21.15.44:0/1500306929 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fcc100b2880 0x7fcc100b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:28.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.189+0000 7fcc2ca00700 1 --2- 172.21.15.44:0/1500306929 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fcc100b2880 0x7fcc100b4d40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcc2810a6f0 tx=0x7fcc1c00b2c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:28.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.194+0000 7fcc25600700 1 -- 172.21.15.44:0/1500306929 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fcc14013070 con 0x7fcc28105f90 2024-05-03T22:40:28.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:28.437+0000 7fcc2de00700 1 -- 172.21.15.44:0/1500306929 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fcc2806a190 con 0x7fcc28105f90 2024-05-03T22:40:28.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:28 smithi060 ceph-mon[31721]: pgmap v382: 129 pgs: 13 creating+peering, 10 unknown, 106 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:28.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:28 smithi160 ceph-mon[32531]: pgmap v382: 129 pgs: 13 creating+peering, 10 unknown, 106 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:29.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:29.105+0000 7fcc25600700 1 -- 172.21.15.44:0/1500306929 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v84) ==== 169+0+0 (secure 0 0 0) 0x7fcc140aa910 con 0x7fcc28105f90 2024-05-03T22:40:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:29.109+0000 7fcc2de00700 1 -- 172.21.15.44:0/1500306929 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fcc100b2880 msgr2=0x7fcc100b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:29.109+0000 7fcc2de00700 1 --2- 172.21.15.44:0/1500306929 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fcc100b2880 0x7fcc100b4d40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcc2810a6f0 tx=0x7fcc1c00b2c0 comp rx=0 tx=0).stop 2024-05-03T22:40:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:29.109+0000 7fcc2de00700 1 -- 172.21.15.44:0/1500306929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc28105f90 msgr2=0x7fcc281a1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:29.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:29.109+0000 7fcc2de00700 1 --2- 172.21.15.44:0/1500306929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc28105f90 0x7fcc281a1e30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcc14006010 tx=0x7fcc14009f80 comp rx=0 tx=0).stop 2024-05-03T22:40:29.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:29.110+0000 7fcc2de00700 1 -- 172.21.15.44:0/1500306929 shutdown_connections 2024-05-03T22:40:29.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:29.110+0000 7fcc2de00700 1 --2- 172.21.15.44:0/1500306929 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fcc100b2880 0x7fcc100b4d40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:29.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:29.110+0000 7fcc2de00700 1 --2- 172.21.15.44:0/1500306929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc2810b680 0x7fcc2819bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:29.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:29.110+0000 7fcc2de00700 1 --2- 172.21.15.44:0/1500306929 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc281055d0 0x7fcc281a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:29.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:29.110+0000 7fcc2de00700 1 --2- 172.21.15.44:0/1500306929 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fcc28105f90 0x7fcc281a1e30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:29.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:29.110+0000 7fcc2de00700 1 -- 172.21.15.44:0/1500306929 >> 172.21.15.44:0/1500306929 conn(0x7fcc281010e0 msgr2=0x7fcc28102700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:29.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:29.111+0000 7fcc2de00700 1 -- 172.21.15.44:0/1500306929 shutdown_connections 2024-05-03T22:40:29.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:29.111+0000 7fcc2de00700 1 -- 172.21.15.44:0/1500306929 wait complete. 2024-05-03T22:40:29.113 INFO:teuthology.orchestra.run.smithi044.stderr:set pool 4 allow_ec_overwrites to true 2024-05-03T22:40:29.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:29 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1500306929' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-03T22:40:29.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:29 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1500306929' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-03T22:40:29.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:29 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1500306929' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-03T22:40:30.060 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-03T22:40:30.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:30 smithi044 ceph-mon[28604]: pgmap v383: 129 pgs: 13 creating+peering, 116 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:30.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:30 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1500306929' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-03T22:40:30.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:30 smithi044 ceph-mon[28604]: osdmap e84: 12 total, 12 up, 12 in 2024-05-03T22:40:30.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:30 smithi060 ceph-mon[31721]: pgmap v383: 129 pgs: 13 creating+peering, 116 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:30.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:30 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1500306929' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-03T22:40:30.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:30 smithi060 ceph-mon[31721]: osdmap e84: 12 total, 12 up, 12 in 2024-05-03T22:40:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:30 smithi160 ceph-mon[32531]: pgmap v383: 129 pgs: 13 creating+peering, 116 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:30 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1500306929' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-03T22:40:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:30 smithi160 ceph-mon[32531]: osdmap e84: 12 total, 12 up, 12 in 2024-05-03T22:40:30.531 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:40:32.379 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:32 smithi044 ceph-mon[28604]: pgmap v385: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:32.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:32 smithi060 ceph-mon[31721]: pgmap v385: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:32.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:32 smithi160 ceph-mon[32531]: pgmap v385: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:32.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.943+0000 7fb1a9600700 1 -- 172.21.15.44:0/623521585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1a4101a90 msgr2=0x7fb1a4101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:32.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.943+0000 7fb1a9600700 1 --2- 172.21.15.44:0/623521585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1a4101a90 0x7fb1a4101f10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb190009990 tx=0x7fb190009ca0 comp rx=0 tx=0).stop 2024-05-03T22:40:32.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.943+0000 7fb1a9600700 1 -- 172.21.15.44:0/623521585 shutdown_connections 2024-05-03T22:40:32.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.943+0000 7fb1a9600700 1 --2- 172.21.15.44:0/623521585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1a4102450 0x7fb1a4110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:32.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.943+0000 7fb1a9600700 1 --2- 172.21.15.44:0/623521585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1a4109520 0x7fb1a4109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:32.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.943+0000 7fb1a9600700 1 --2- 172.21.15.44:0/623521585 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1a4101a90 0x7fb1a4101f10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:32.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.943+0000 7fb1a9600700 1 -- 172.21.15.44:0/623521585 >> 172.21.15.44:0/623521585 conn(0x7fb1a4078a10 msgr2=0x7fb1a40ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:32.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.943+0000 7fb1a9600700 1 -- 172.21.15.44:0/623521585 shutdown_connections 2024-05-03T22:40:32.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.943+0000 7fb1a9600700 1 -- 172.21.15.44:0/623521585 wait complete. 2024-05-03T22:40:32.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.944+0000 7fb1a9600700 1 Processor -- start 2024-05-03T22:40:32.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.944+0000 7fb1a9600700 1 -- start start 2024-05-03T22:40:32.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.945+0000 7fb1a9600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1a4101a90 0x7fb1a419be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:32.947 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.945+0000 7fb1a9600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1a4102450 0x7fb1a419c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:32.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.945+0000 7fb1a9600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1a4109520 0x7fb1a41a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:32.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.945+0000 7fb1a9600700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a41137f0 con 0x7fb1a4101a90 2024-05-03T22:40:32.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.945+0000 7fb1a9600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a4113670 con 0x7fb1a4109520 2024-05-03T22:40:32.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.945+0000 7fb1a9600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a4113970 con 0x7fb1a4102450 2024-05-03T22:40:32.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.945+0000 7fb1a2a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1a4101a90 0x7fb1a419be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:32.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.945+0000 7fb1a2a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1a4101a90 0x7fb1a419be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55924/0 (socket says 172.21.15.44:55924) 2024-05-03T22:40:32.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.945+0000 7fb1a2a00700 1 -- 172.21.15.44:0/3810795234 learned_addr learned my addr 172.21.15.44:0/3810795234 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:40:32.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.945+0000 7fb1a2000700 1 --2- 172.21.15.44:0/3810795234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1a4102450 0x7fb1a419c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:32.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.946+0000 7fb1a3400700 1 --2- 172.21.15.44:0/3810795234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1a4109520 0x7fb1a41a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:32.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.946+0000 7fb1a2a00700 1 -- 172.21.15.44:0/3810795234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1a4102450 msgr2=0x7fb1a419c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:32.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.946+0000 7fb1a2a00700 1 --2- 172.21.15.44:0/3810795234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1a4102450 0x7fb1a419c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:32.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.946+0000 7fb1a2a00700 1 -- 172.21.15.44:0/3810795234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1a4109520 msgr2=0x7fb1a41a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:32.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.946+0000 7fb1a2a00700 1 --2- 172.21.15.44:0/3810795234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1a4109520 0x7fb1a41a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:32.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.946+0000 7fb1a2a00700 1 -- 172.21.15.44:0/3810795234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a41a0e30 con 0x7fb1a4101a90 2024-05-03T22:40:32.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.946+0000 7fb1a2a00700 1 --2- 172.21.15.44:0/3810795234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1a4101a90 0x7fb1a419be70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb19400c920 tx=0x7fb19400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:32.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.946+0000 7fb19b400700 1 -- 172.21.15.44:0/3810795234 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194007b00 con 0x7fb1a4101a90 2024-05-03T22:40:32.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.946+0000 7fb1a9600700 1 -- 172.21.15.44:0/3810795234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a41a1120 con 0x7fb1a4101a90 2024-05-03T22:40:32.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.947+0000 7fb19b400700 1 -- 172.21.15.44:0/3810795234 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fb194004d00 con 0x7fb1a4101a90 2024-05-03T22:40:32.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.947+0000 7fb19b400700 1 -- 172.21.15.44:0/3810795234 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1940056c0 con 0x7fb1a4101a90 2024-05-03T22:40:32.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.947+0000 7fb1a9600700 1 -- 172.21.15.44:0/3810795234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a41a89a0 con 0x7fb1a4101a90 2024-05-03T22:40:32.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.948+0000 7fb1a9600700 1 -- 172.21.15.44:0/3810795234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1a406a190 con 0x7fb1a4101a90 2024-05-03T22:40:32.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.950+0000 7fb19b400700 1 -- 172.21.15.44:0/3810795234 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fb194004750 con 0x7fb1a4101a90 2024-05-03T22:40:32.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.952+0000 7fb19b400700 1 --2- 172.21.15.44:0/3810795234 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb1880b2900 0x7fb1880b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:32.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.952+0000 7fb19b400700 1 -- 172.21.15.44:0/3810795234 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8770+0+0 (secure 0 0 0) 0x7fb1940e20f0 con 0x7fb1a4101a90 2024-05-03T22:40:32.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.952+0000 7fb1a2000700 1 --2- 172.21.15.44:0/3810795234 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb1880b2900 0x7fb1880b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:32.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.953+0000 7fb1a2000700 1 --2- 172.21.15.44:0/3810795234 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb1880b2900 0x7fb1880b4dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb190009750 tx=0x7fb19000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:32.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:32.956+0000 7fb19b400700 1 -- 172.21.15.44:0/3810795234 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb194014030 con 0x7fb1a4101a90 2024-05-03T22:40:33.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:33.254+0000 7fb1a9600700 1 -- 172.21.15.44:0/3810795234 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fb1a41a8cf0 con 0x7fb1a4101a90 2024-05-03T22:40:34.136 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:34.134+0000 7fb19b400700 1 -- 172.21.15.44:0/3810795234 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7fb1940a9b90 con 0x7fb1a4101a90 2024-05-03T22:40:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:34.138+0000 7fb1a9600700 1 -- 172.21.15.44:0/3810795234 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb1880b2900 msgr2=0x7fb1880b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:34.138+0000 7fb1a9600700 1 --2- 172.21.15.44:0/3810795234 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb1880b2900 0x7fb1880b4dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb190009750 tx=0x7fb19000b540 comp rx=0 tx=0).stop 2024-05-03T22:40:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:34.138+0000 7fb1a9600700 1 -- 172.21.15.44:0/3810795234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1a4101a90 msgr2=0x7fb1a419be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:34.138+0000 7fb1a9600700 1 --2- 172.21.15.44:0/3810795234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1a4101a90 0x7fb1a419be70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb19400c920 tx=0x7fb19400cce0 comp rx=0 tx=0).stop 2024-05-03T22:40:34.140 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:34.139+0000 7fb1a9600700 1 -- 172.21.15.44:0/3810795234 shutdown_connections 2024-05-03T22:40:34.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:34.139+0000 7fb1a9600700 1 --2- 172.21.15.44:0/3810795234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1a4109520 0x7fb1a41a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:34.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:34.139+0000 7fb1a9600700 1 --2- 172.21.15.44:0/3810795234 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb1a4101a90 0x7fb1a419be70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:34.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:34.139+0000 7fb1a9600700 1 --2- 172.21.15.44:0/3810795234 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb1880b2900 0x7fb1880b4dc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:34.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:34.139+0000 7fb1a9600700 1 --2- 172.21.15.44:0/3810795234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb1a4102450 0x7fb1a419c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:34.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:34.139+0000 7fb1a9600700 1 -- 172.21.15.44:0/3810795234 >> 172.21.15.44:0/3810795234 conn(0x7fb1a4078a10 msgr2=0x7fb1a40ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:34.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:34.139+0000 7fb1a9600700 1 -- 172.21.15.44:0/3810795234 shutdown_connections 2024-05-03T22:40:34.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:34.139+0000 7fb1a9600700 1 -- 172.21.15.44:0/3810795234 wait complete. 2024-05-03T22:40:34.142 INFO:teuthology.orchestra.run.smithi044.stderr:added data pool 4 to fsmap 2024-05-03T22:40:34.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:34 smithi044 ceph-mon[28604]: pgmap v386: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:34.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:34 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3810795234' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-03T22:40:34.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:34 smithi060 ceph-mon[31721]: pgmap v386: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:34.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:34 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3810795234' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-03T22:40:34.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:34 smithi160 ceph-mon[32531]: pgmap v386: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:34.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:34 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3810795234' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-03T22:40:35.092 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:40:35.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:35 smithi044 ceph-mon[28604]: osdmap e85: 12 total, 12 up, 12 in 2024-05-03T22:40:35.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:35 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3810795234' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-03T22:40:35.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:35 smithi044 ceph-mon[28604]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:40:35.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:35 smithi060 ceph-mon[31721]: osdmap e85: 12 total, 12 up, 12 in 2024-05-03T22:40:35.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:35 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3810795234' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-03T22:40:35.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:35 smithi060 ceph-mon[31721]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:40:35.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:35 smithi160 ceph-mon[32531]: osdmap e85: 12 total, 12 up, 12 in 2024-05-03T22:40:35.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:35 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3810795234' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-03T22:40:35.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:35 smithi160 ceph-mon[32531]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:40:35.557 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:40:36.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:36 smithi044 ceph-mon[28604]: pgmap v388: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:36.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:36 smithi044 ceph-mon[28604]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-03T22:40:36.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:36 smithi044 ceph-mon[28604]: Cluster is now healthy 2024-05-03T22:40:36.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:36 smithi060 ceph-mon[31721]: pgmap v388: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:36.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:36 smithi060 ceph-mon[31721]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-03T22:40:36.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:36 smithi060 ceph-mon[31721]: Cluster is now healthy 2024-05-03T22:40:36.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:36 smithi160 ceph-mon[32531]: pgmap v388: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:36.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:36 smithi160 ceph-mon[32531]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-03T22:40:36.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:36 smithi160 ceph-mon[32531]: Cluster is now healthy 2024-05-03T22:40:37.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.906+0000 7f11ae600700 1 -- 172.21.15.44:0/413450672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11a8109510 msgr2=0x7f11a81098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:37.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.906+0000 7f11ae600700 1 --2- 172.21.15.44:0/413450672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11a8109510 0x7f11a81098f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1198009990 tx=0x7f1198009ca0 comp rx=0 tx=0).stop 2024-05-03T22:40:37.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.906+0000 7f11ae600700 1 -- 172.21.15.44:0/413450672 shutdown_connections 2024-05-03T22:40:37.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.906+0000 7f11ae600700 1 --2- 172.21.15.44:0/413450672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11a806bb40 0x7f11a8110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:37.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.906+0000 7f11ae600700 1 --2- 172.21.15.44:0/413450672 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11a8109510 0x7f11a81098f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:37.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.906+0000 7f11ae600700 1 --2- 172.21.15.44:0/413450672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11a806b180 0x7f11a806b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:37.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.906+0000 7f11ae600700 1 -- 172.21.15.44:0/413450672 >> 172.21.15.44:0/413450672 conn(0x7f11a8079350 msgr2=0x7f11a8079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:37.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.906+0000 7f11ae600700 1 -- 172.21.15.44:0/413450672 shutdown_connections 2024-05-03T22:40:37.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.906+0000 7f11ae600700 1 -- 172.21.15.44:0/413450672 wait complete. 2024-05-03T22:40:37.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.908+0000 7f11ae600700 1 Processor -- start 2024-05-03T22:40:37.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.908+0000 7f11ae600700 1 -- start start 2024-05-03T22:40:37.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.908+0000 7f11ae600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11a806b180 0x7f11a819be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:37.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.908+0000 7f11ae600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11a806bb40 0x7f11a819c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:37.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.908+0000 7f11ae600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11a8109510 0x7f11a81a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:37.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.908+0000 7f11ae600700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f11a81137b0 con 0x7f11a806bb40 2024-05-03T22:40:37.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.908+0000 7f11ae600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f11a8113630 con 0x7f11a8109510 2024-05-03T22:40:37.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.908+0000 7f11ae600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f11a8113930 con 0x7f11a806b180 2024-05-03T22:40:37.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.909+0000 7f119ea00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11a806bb40 0x7f11a819c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:37.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.909+0000 7f119ea00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11a806bb40 0x7f11a819c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55944/0 (socket says 172.21.15.44:55944) 2024-05-03T22:40:37.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.909+0000 7f119ea00700 1 -- 172.21.15.44:0/4294908312 learned_addr learned my addr 172.21.15.44:0/4294908312 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:40:37.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.909+0000 7f11a7400700 1 --2- 172.21.15.44:0/4294908312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11a806b180 0x7f11a819be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:37.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.909+0000 7f11a7e00700 1 --2- 172.21.15.44:0/4294908312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11a8109510 0x7f11a81a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:37.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.909+0000 7f119ea00700 1 -- 172.21.15.44:0/4294908312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11a806b180 msgr2=0x7f11a819be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:37.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.909+0000 7f119ea00700 1 --2- 172.21.15.44:0/4294908312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11a806b180 0x7f11a819be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:37.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.909+0000 7f119ea00700 1 -- 172.21.15.44:0/4294908312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11a8109510 msgr2=0x7f11a81a0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:37.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.909+0000 7f119ea00700 1 --2- 172.21.15.44:0/4294908312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11a8109510 0x7f11a81a0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:37.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.909+0000 7f119ea00700 1 -- 172.21.15.44:0/4294908312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a81a0e80 con 0x7f11a806bb40 2024-05-03T22:40:37.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.909+0000 7f119ea00700 1 --2- 172.21.15.44:0/4294908312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11a806bb40 0x7f11a819c3b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f119000d980 tx=0x7f119000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:37.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.910+0000 7f11a4c00700 1 -- 172.21.15.44:0/4294908312 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1190016070 con 0x7f11a806bb40 2024-05-03T22:40:37.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.910+0000 7f11a4c00700 1 -- 172.21.15.44:0/4294908312 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f11900044f0 con 0x7f11a806bb40 2024-05-03T22:40:37.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.910+0000 7f11ae600700 1 -- 172.21.15.44:0/4294908312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11a81a1170 con 0x7f11a806bb40 2024-05-03T22:40:37.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.910+0000 7f11a4c00700 1 -- 172.21.15.44:0/4294908312 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1190004cf0 con 0x7f11a806bb40 2024-05-03T22:40:37.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.910+0000 7f11ae600700 1 -- 172.21.15.44:0/4294908312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11a81a89f0 con 0x7f11a806bb40 2024-05-03T22:40:37.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.911+0000 7f11ae600700 1 -- 172.21.15.44:0/4294908312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11a806a190 con 0x7f11a806bb40 2024-05-03T22:40:37.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.913+0000 7f11a4c00700 1 -- 172.21.15.44:0/4294908312 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f119000bc80 con 0x7f11a806bb40 2024-05-03T22:40:37.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.915+0000 7f11a4c00700 1 --2- 172.21.15.44:0/4294908312 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f118c0b2900 0x7f118c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:37.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.915+0000 7f11a4c00700 1 -- 172.21.15.44:0/4294908312 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f11900e27a0 con 0x7f11a806bb40 2024-05-03T22:40:37.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.915+0000 7f11a7400700 1 --2- 172.21.15.44:0/4294908312 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f118c0b2900 0x7f118c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:37.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.916+0000 7f11a7400700 1 --2- 172.21.15.44:0/4294908312 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f118c0b2900 0x7f118c0b4dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f119800b5c0 tx=0x7f1198005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:37.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:37.918+0000 7f11a4c00700 1 -- 172.21.15.44:0/4294908312 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f119001f020 con 0x7f11a806bb40 2024-05-03T22:40:38.210 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:38.208+0000 7f11ae600700 1 -- 172.21.15.44:0/4294908312 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11a819d1d0 con 0x7f11a806bb40 2024-05-03T22:40:38.210 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:38 smithi044 ceph-mon[28604]: pgmap v389: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:38.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:38.209+0000 7f11a4c00700 1 -- 172.21.15.44:0/4294908312 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11797 (secure 0 0 0) 0x7f1190055e20 con 0x7f11a806bb40 2024-05-03T22:40:38.211 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:40:38.211 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2550955759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2550955759},{"type":"v1","addr":"172.21.15.44:6835","nonce":2550955759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3118490782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3118490782},{"type":"v1","addr":"172.21.15.44:6837","nonce":3118490782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6839/1408147232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1408147232},{"type":"v1","addr":"172.21.15.44:6839","nonce":1408147232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6841/4262223160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":4262223160},{"type":"v1","addr":"172.21.15.44:6841","nonce":4262223160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1332937382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1332937382},{"type":"v1","addr":"172.21.15.160:6835","nonce":1332937382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/3735287805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3735287805},{"type":"v1","addr":"172.21.15.160:6837","nonce":3735287805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/861756806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":861756806},{"type":"v1","addr":"172.21.15.160:6839","nonce":861756806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34391,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/153110190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":153110190},{"type":"v1","addr":"172.21.15.60:6833","nonce":153110190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34409,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3390425489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3390425489},{"type":"v1","addr":"172.21.15.60:6835","nonce":3390425489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34427,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3568217572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3568217572},{"type":"v1","addr":"172.21.15.60:6837","nonce":3568217572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-03T22:40:14.758857+0000","modified":"2024-05-03T22:40:33.256090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34463":{"gid":34463,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.60:6839/2420093605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2420093605},{"type":"v1","addr":"172.21.15.60:6839","nonce":2420093605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34463,"qdb_cluster":[34463]},"id":1}]} 2024-05-03T22:40:38.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:38.212+0000 7f11ae600700 1 -- 172.21.15.44:0/4294908312 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f118c0b2900 msgr2=0x7f118c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:38.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:38.212+0000 7f11ae600700 1 --2- 172.21.15.44:0/4294908312 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f118c0b2900 0x7f118c0b4dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f119800b5c0 tx=0x7f1198005fd0 comp rx=0 tx=0).stop 2024-05-03T22:40:38.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:38.212+0000 7f11ae600700 1 -- 172.21.15.44:0/4294908312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11a806bb40 msgr2=0x7f11a819c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:38.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:38.212+0000 7f11ae600700 1 --2- 172.21.15.44:0/4294908312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11a806bb40 0x7f11a819c3b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f119000d980 tx=0x7f119000dd40 comp rx=0 tx=0).stop 2024-05-03T22:40:38.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:38.213+0000 7f11ae600700 1 -- 172.21.15.44:0/4294908312 shutdown_connections 2024-05-03T22:40:38.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:38.213+0000 7f11ae600700 1 --2- 172.21.15.44:0/4294908312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11a8109510 0x7f11a81a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:38.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:38.213+0000 7f11ae600700 1 --2- 172.21.15.44:0/4294908312 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f118c0b2900 0x7f118c0b4dc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:38.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:38.213+0000 7f11ae600700 1 --2- 172.21.15.44:0/4294908312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11a806b180 0x7f11a819be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:38.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:38.213+0000 7f11ae600700 1 --2- 172.21.15.44:0/4294908312 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11a806bb40 0x7f11a819c3b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:38.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:38.213+0000 7f11ae600700 1 -- 172.21.15.44:0/4294908312 >> 172.21.15.44:0/4294908312 conn(0x7f11a8079350 msgr2=0x7f11a810e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:38.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:38.213+0000 7f11ae600700 1 -- 172.21.15.44:0/4294908312 shutdown_connections 2024-05-03T22:40:38.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:38.213+0000 7f11ae600700 1 -- 172.21.15.44:0/4294908312 wait complete. 2024-05-03T22:40:38.216 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 17 2024-05-03T22:40:38.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:38 smithi060 ceph-mon[31721]: pgmap v389: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:38.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:38 smithi160 ceph-mon[32531]: pgmap v389: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:39.200 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:39 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/4294908312' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:40:39.203 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:40:39.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:39 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/4294908312' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:40:39.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:39 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/4294908312' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:40:39.642 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:40:40.388 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:40 smithi044 ceph-mon[28604]: pgmap v390: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:40.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:40 smithi060 ceph-mon[31721]: pgmap v390: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:40.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:40 smithi160 ceph-mon[32531]: pgmap v390: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:42.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.139+0000 7f40f7000700 1 -- 172.21.15.44:0/1822796657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40f006b180 msgr2=0x7f40f006b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:42.141 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.139+0000 7f40f7000700 1 --2- 172.21.15.44:0/1822796657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40f006b180 0x7f40f006b600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f40dc009990 tx=0x7f40dc009ca0 comp rx=0 tx=0).stop 2024-05-03T22:40:42.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.139+0000 7f40f7000700 1 -- 172.21.15.44:0/1822796657 shutdown_connections 2024-05-03T22:40:42.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.139+0000 7f40f7000700 1 --2- 172.21.15.44:0/1822796657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40f006bb40 0x7f40f0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:42.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.139+0000 7f40f7000700 1 --2- 172.21.15.44:0/1822796657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40f0109510 0x7f40f01098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:42.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.139+0000 7f40f7000700 1 --2- 172.21.15.44:0/1822796657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40f006b180 0x7f40f006b600 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:42.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.139+0000 7f40f7000700 1 -- 172.21.15.44:0/1822796657 >> 172.21.15.44:0/1822796657 conn(0x7f40f0079350 msgr2=0x7f40f0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:42.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.139+0000 7f40f7000700 1 -- 172.21.15.44:0/1822796657 shutdown_connections 2024-05-03T22:40:42.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.139+0000 7f40f7000700 1 -- 172.21.15.44:0/1822796657 wait complete. 2024-05-03T22:40:42.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.140+0000 7f40f7000700 1 Processor -- start 2024-05-03T22:40:42.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.141+0000 7f40f7000700 1 -- start start 2024-05-03T22:40:42.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.141+0000 7f40f7000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40f006b180 0x7f40f019f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:42.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.141+0000 7f40f7000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40f006bb40 0x7f40f019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:42.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.141+0000 7f40f7000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40f0109510 0x7f40f01999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:42.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.141+0000 7f40f7000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f40f0113760 con 0x7f40f006b180 2024-05-03T22:40:42.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.141+0000 7f40f7000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f40f01135e0 con 0x7f40f006bb40 2024-05-03T22:40:42.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.141+0000 7f40f7000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f40f01138e0 con 0x7f40f0109510 2024-05-03T22:40:42.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.141+0000 7f40efe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40f006b180 0x7f40f019f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:42.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.141+0000 7f40efe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40f006b180 0x7f40f019f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60538/0 (socket says 172.21.15.44:60538) 2024-05-03T22:40:42.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.141+0000 7f40efe00700 1 -- 172.21.15.44:0/3811531224 learned_addr learned my addr 172.21.15.44:0/3811531224 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:40:42.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.142+0000 7f40ef400700 1 --2- 172.21.15.44:0/3811531224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40f006bb40 0x7f40f019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:42.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.142+0000 7f40f5000700 1 --2- 172.21.15.44:0/3811531224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40f0109510 0x7f40f01999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:42.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.142+0000 7f40efe00700 1 -- 172.21.15.44:0/3811531224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40f0109510 msgr2=0x7f40f01999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:42.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.142+0000 7f40efe00700 1 --2- 172.21.15.44:0/3811531224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40f0109510 0x7f40f01999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:42.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.142+0000 7f40efe00700 1 -- 172.21.15.44:0/3811531224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40f006bb40 msgr2=0x7f40f019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:42.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.142+0000 7f40efe00700 1 --2- 172.21.15.44:0/3811531224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40f006bb40 0x7f40f019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:42.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.142+0000 7f40efe00700 1 -- 172.21.15.44:0/3811531224 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40f019a100 con 0x7f40f006b180 2024-05-03T22:40:42.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.142+0000 7f40efe00700 1 --2- 172.21.15.44:0/3811531224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40f006b180 0x7f40f019f7e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f40e000c9b0 tx=0x7f40e000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:42.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.142+0000 7f40ecc00700 1 -- 172.21.15.44:0/3811531224 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e0007b00 con 0x7f40f006b180 2024-05-03T22:40:42.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.142+0000 7f40f7000700 1 -- 172.21.15.44:0/3811531224 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40f019a3f0 con 0x7f40f006b180 2024-05-03T22:40:42.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.142+0000 7f40ecc00700 1 -- 172.21.15.44:0/3811531224 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f40e0007ca0 con 0x7f40f006b180 2024-05-03T22:40:42.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.143+0000 7f40ecc00700 1 -- 172.21.15.44:0/3811531224 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e0004a30 con 0x7f40f006b180 2024-05-03T22:40:42.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.143+0000 7f40f7000700 1 -- 172.21.15.44:0/3811531224 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40f01a66b0 con 0x7f40f006b180 2024-05-03T22:40:42.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.144+0000 7f40f7000700 1 -- 172.21.15.44:0/3811531224 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40f006a190 con 0x7f40f006b180 2024-05-03T22:40:42.147 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.146+0000 7f40ecc00700 1 -- 172.21.15.44:0/3811531224 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f40e000f450 con 0x7f40f006b180 2024-05-03T22:40:42.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.148+0000 7f40ecc00700 1 --2- 172.21.15.44:0/3811531224 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f40d40b2880 0x7f40d40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:42.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.148+0000 7f40ecc00700 1 -- 172.21.15.44:0/3811531224 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f40e00e2660 con 0x7f40f006b180 2024-05-03T22:40:42.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.148+0000 7f40ef400700 1 --2- 172.21.15.44:0/3811531224 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f40d40b2880 0x7f40d40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:42.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.149+0000 7f40ef400700 1 --2- 172.21.15.44:0/3811531224 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f40d40b2880 0x7f40d40b4d40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f40dc006010 tx=0x7f40dc00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:42.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.150+0000 7f40ecc00700 1 -- 172.21.15.44:0/3811531224 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f40e0014030 con 0x7f40f006b180 2024-05-03T22:40:42.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:42 smithi044 ceph-mon[28604]: pgmap v391: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:42.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.391+0000 7f40f7000700 1 -- 172.21.15.44:0/3811531224 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40f002e510 con 0x7f40f006b180 2024-05-03T22:40:42.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.395+0000 7f40ecc00700 1 -- 172.21.15.44:0/3811531224 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24068 (secure 0 0 0) 0x7f40e00aa170 con 0x7f40f006b180 2024-05-03T22:40:42.397 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:40:42.398 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":85,"fsid":"5b0efdca-099c-11ef-bc97-c7b262605968","created":"2024-05-03T22:28:49.471963+0000","modified":"2024-05-03T22:40:33.255872+0000","last_up_change":"2024-05-03T22:38:41.446244+0000","last_in_change":"2024-05-03T22:38:16.952689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:33:24.956832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:40:05.501996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:40:09.732161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:40:23.052845+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05869397-bdc9-4c38-b1c6-deb466454dd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6803","nonce":4219032560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6805","nonce":4219032560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6809","nonce":4219032560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6807","nonce":4219032560}]},"public_addr":"172.21.15.44:6803/4219032560","cluster_addr":"172.21.15.44:6805/4219032560","heartbeat_back_addr":"172.21.15.44:6809/4219032560","heartbeat_front_addr":"172.21.15.44:6807/4219032560","state":["exists","up"]},{"osd":1,"uuid":"ff61ca27-e36b-41c9-898f-1cd7af1d9db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6801","nonce":563003638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6803","nonce":563003638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6807","nonce":563003638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6805","nonce":563003638}]},"public_addr":"172.21.15.60:6801/563003638","cluster_addr":"172.21.15.60:6803/563003638","heartbeat_back_addr":"172.21.15.60:6807/563003638","heartbeat_front_addr":"172.21.15.60:6805/563003638","state":["exists","up"]},{"osd":2,"uuid":"e58f96dc-3486-452e-85a1-847a0e2c523a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6801","nonce":2524540447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6803","nonce":2524540447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6807","nonce":2524540447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6805","nonce":2524540447}]},"public_addr":"172.21.15.160:6801/2524540447","cluster_addr":"172.21.15.160:6803/2524540447","heartbeat_back_addr":"172.21.15.160:6807/2524540447","heartbeat_front_addr":"172.21.15.160:6805/2524540447","state":["exists","up"]},{"osd":3,"uuid":"75c56c3b-5807-4646-885c-1ef16541ff72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6811","nonce":3298926279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6813","nonce":3298926279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6817","nonce":3298926279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6815","nonce":3298926279}]},"public_addr":"172.21.15.44:6811/3298926279","cluster_addr":"172.21.15.44:6813/3298926279","heartbeat_back_addr":"172.21.15.44:6817/3298926279","heartbeat_front_addr":"172.21.15.44:6815/3298926279","state":["exists","up"]},{"osd":4,"uuid":"a8a322e4-6ca1-4727-8b41-5ff523acc591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6809","nonce":3794821539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6811","nonce":3794821539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6815","nonce":3794821539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6813","nonce":3794821539}]},"public_addr":"172.21.15.60:6809/3794821539","cluster_addr":"172.21.15.60:6811/3794821539","heartbeat_back_addr":"172.21.15.60:6815/3794821539","heartbeat_front_addr":"172.21.15.60:6813/3794821539","state":["exists","up"]},{"osd":5,"uuid":"bc718527-bacd-4d1b-90c6-758cbd859e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6809","nonce":429142335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6811","nonce":429142335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6815","nonce":429142335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6813","nonce":429142335}]},"public_addr":"172.21.15.160:6809/429142335","cluster_addr":"172.21.15.160:6811/429142335","heartbeat_back_addr":"172.21.15.160:6815/429142335","heartbeat_front_addr":"172.21.15.160:6813/429142335","state":["exists","up"]},{"osd":6,"uuid":"f95a1d05-a958-4e5c-a90a-6b0c3d9fad43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6819","nonce":2805326764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6821","nonce":2805326764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6825","nonce":2805326764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6823","nonce":2805326764}]},"public_addr":"172.21.15.44:6819/2805326764","cluster_addr":"172.21.15.44:6821/2805326764","heartbeat_back_addr":"172.21.15.44:6825/2805326764","heartbeat_front_addr":"172.21.15.44:6823/2805326764","state":["exists","up"]},{"osd":7,"uuid":"a515e4be-c607-4f4a-96bb-c3d395d7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6817","nonce":693512829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6819","nonce":693512829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6823","nonce":693512829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6821","nonce":693512829}]},"public_addr":"172.21.15.60:6817/693512829","cluster_addr":"172.21.15.60:6819/693512829","heartbeat_back_addr":"172.21.15.60:6823/693512829","heartbeat_front_addr":"172.21.15.60:6821/693512829","state":["exists","up"]},{"osd":8,"uuid":"717aeffb-6c51-4e4e-8344-fba70ac2c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6817","nonce":2920554498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6819","nonce":2920554498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6823","nonce":2920554498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6821","nonce":2920554498}]},"public_addr":"172.21.15.160:6817/2920554498","cluster_addr":"172.21.15.160:6819/2920554498","heartbeat_back_addr":"172.21.15.160:6823/2920554498","heartbeat_front_addr":"172.21.15.160:6821/2920554498","state":["exists","up"]},{"osd":9,"uuid":"ade31284-1246-42c8-9cee-e60dacc58a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6827","nonce":414763386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6829","nonce":414763386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6833","nonce":414763386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6831","nonce":414763386}]},"public_addr":"172.21.15.44:6827/414763386","cluster_addr":"172.21.15.44:6829/414763386","heartbeat_back_addr":"172.21.15.44:6833/414763386","heartbeat_front_addr":"172.21.15.44:6831/414763386","state":["exists","up"]},{"osd":10,"uuid":"e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6825","nonce":2396062554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6827","nonce":2396062554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6831","nonce":2396062554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6829","nonce":2396062554}]},"public_addr":"172.21.15.60:6825/2396062554","cluster_addr":"172.21.15.60:6827/2396062554","heartbeat_back_addr":"172.21.15.60:6831/2396062554","heartbeat_front_addr":"172.21.15.60:6829/2396062554","state":["exists","up"]},{"osd":11,"uuid":"b6951585-9337-4b5a-a691-e765deb4b825","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6825","nonce":1397967755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6827","nonce":1397967755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6831","nonce":1397967755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6829","nonce":1397967755}]},"public_addr":"172.21.15.160:6825/1397967755","cluster_addr":"172.21.15.160:6827/1397967755","heartbeat_back_addr":"172.21.15.160:6831/1397967755","heartbeat_front_addr":"172.21.15.160:6829/1397967755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:15.012060+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:48.390669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:21.227227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:56.388453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:34:31.079377+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:04.912058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:40.941904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:16.757849+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:51.591794+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:37:29.022917+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:05.506391+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:39.793901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2661810503":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3426728285":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/4246410673":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2328074241":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/1738155460":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3461866265":"2024-05-04T22:30:08.766919+0000","172.21.15.44:6800/950841500":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/950841500":"2024-05-04T22:29:32.846592+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:40:42.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.398+0000 7f40f7000700 1 -- 172.21.15.44:0/3811531224 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f40d40b2880 msgr2=0x7f40d40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:42.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.399+0000 7f40f7000700 1 --2- 172.21.15.44:0/3811531224 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f40d40b2880 0x7f40d40b4d40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f40dc006010 tx=0x7f40dc00b540 comp rx=0 tx=0).stop 2024-05-03T22:40:42.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.399+0000 7f40f7000700 1 -- 172.21.15.44:0/3811531224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40f006b180 msgr2=0x7f40f019f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:42.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.399+0000 7f40f7000700 1 --2- 172.21.15.44:0/3811531224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40f006b180 0x7f40f019f7e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f40e000c9b0 tx=0x7f40e000cd70 comp rx=0 tx=0).stop 2024-05-03T22:40:42.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.399+0000 7f40f7000700 1 -- 172.21.15.44:0/3811531224 shutdown_connections 2024-05-03T22:40:42.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.399+0000 7f40f7000700 1 --2- 172.21.15.44:0/3811531224 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f40d40b2880 0x7f40d40b4d40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:42.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.399+0000 7f40f7000700 1 --2- 172.21.15.44:0/3811531224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40f0109510 0x7f40f01999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:42.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.399+0000 7f40f7000700 1 --2- 172.21.15.44:0/3811531224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f40f006b180 0x7f40f019f7e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:42.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.399+0000 7f40f7000700 1 --2- 172.21.15.44:0/3811531224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40f006bb40 0x7f40f019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:42.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.399+0000 7f40f7000700 1 -- 172.21.15.44:0/3811531224 >> 172.21.15.44:0/3811531224 conn(0x7f40f0079350 msgr2=0x7f40f0101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:42.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.399+0000 7f40f7000700 1 -- 172.21.15.44:0/3811531224 shutdown_connections 2024-05-03T22:40:42.401 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:42.399+0000 7f40f7000700 1 -- 172.21.15.44:0/3811531224 wait complete. 2024-05-03T22:40:42.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:42 smithi060 ceph-mon[31721]: pgmap v391: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:42.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:42 smithi160 ceph-mon[32531]: pgmap v391: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:43.364 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:40:43.447 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:43 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3811531224' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:40:43.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:43 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3811531224' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:40:43.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:43 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3811531224' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:40:43.843 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:40:44.248 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:44 smithi044 ceph-mon[28604]: pgmap v392: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:44.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:44 smithi060 ceph-mon[31721]: pgmap v392: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:44.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:44 smithi160 ceph-mon[32531]: pgmap v392: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:46.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.100+0000 7fc02c000700 1 -- 172.21.15.44:0/1975439429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc02406c530 msgr2=0x7fc024110350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:46.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.100+0000 7fc02c000700 1 --2- 172.21.15.44:0/1975439429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc02406c530 0x7fc024110350 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00b0a0 tx=0x7fc01c00b3b0 comp rx=0 tx=0).stop 2024-05-03T22:40:46.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.101+0000 7fc02c000700 1 -- 172.21.15.44:0/1975439429 shutdown_connections 2024-05-03T22:40:46.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.101+0000 7fc02c000700 1 --2- 172.21.15.44:0/1975439429 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc02406c530 0x7fc024110350 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:46.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.101+0000 7fc02c000700 1 --2- 172.21.15.44:0/1975439429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc024109530 0x7fc024109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:46.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.101+0000 7fc02c000700 1 --2- 172.21.15.44:0/1975439429 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc02406bb70 0x7fc02406bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:46.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.101+0000 7fc02c000700 1 -- 172.21.15.44:0/1975439429 >> 172.21.15.44:0/1975439429 conn(0x7fc024079350 msgr2=0x7fc024079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:46.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.101+0000 7fc02c000700 1 -- 172.21.15.44:0/1975439429 shutdown_connections 2024-05-03T22:40:46.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.101+0000 7fc02c000700 1 -- 172.21.15.44:0/1975439429 wait complete. 2024-05-03T22:40:46.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.102+0000 7fc02c000700 1 Processor -- start 2024-05-03T22:40:46.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.102+0000 7fc02c000700 1 -- start start 2024-05-03T22:40:46.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.102+0000 7fc02c000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc02406bb70 0x7fc02419be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:46.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.102+0000 7fc02c000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc02406c530 0x7fc02419c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:46.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.102+0000 7fc02c000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc024109530 0x7fc0241a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:46.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.103+0000 7fc02c000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc0241137f0 con 0x7fc02406bb70 2024-05-03T22:40:46.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.103+0000 7fc02c000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc024113670 con 0x7fc024109530 2024-05-03T22:40:46.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.103+0000 7fc02c000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc024113970 con 0x7fc02406c530 2024-05-03T22:40:46.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.103+0000 7fc029600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc02406bb70 0x7fc02419be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:46.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.103+0000 7fc029600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc02406bb70 0x7fc02419be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60558/0 (socket says 172.21.15.44:60558) 2024-05-03T22:40:46.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.103+0000 7fc029600700 1 -- 172.21.15.44:0/4159848088 learned_addr learned my addr 172.21.15.44:0/4159848088 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:40:46.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.103+0000 7fc028c00700 1 --2- 172.21.15.44:0/4159848088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc02406c530 0x7fc02419c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:46.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.103+0000 7fc02a000700 1 --2- 172.21.15.44:0/4159848088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc024109530 0x7fc0241a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:46.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.103+0000 7fc029600700 1 -- 172.21.15.44:0/4159848088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc02406c530 msgr2=0x7fc02419c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:46.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.103+0000 7fc029600700 1 --2- 172.21.15.44:0/4159848088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc02406c530 0x7fc02419c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:46.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.103+0000 7fc029600700 1 -- 172.21.15.44:0/4159848088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc024109530 msgr2=0x7fc0241a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:46.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.103+0000 7fc029600700 1 --2- 172.21.15.44:0/4159848088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc024109530 0x7fc0241a06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:46.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.103+0000 7fc029600700 1 -- 172.21.15.44:0/4159848088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0241a0e30 con 0x7fc02406bb70 2024-05-03T22:40:46.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.103+0000 7fc028c00700 1 --2- 172.21.15.44:0/4159848088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc02406c530 0x7fc02419c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:40:46.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.104+0000 7fc029600700 1 --2- 172.21.15.44:0/4159848088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc02406bb70 0x7fc02419be20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc01800d950 tx=0x7fc01800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:46.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.104+0000 7fc022000700 1 -- 172.21.15.44:0/4159848088 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc018016070 con 0x7fc02406bb70 2024-05-03T22:40:46.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.104+0000 7fc022000700 1 -- 172.21.15.44:0/4159848088 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fc018009b40 con 0x7fc02406bb70 2024-05-03T22:40:46.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.104+0000 7fc022000700 1 -- 172.21.15.44:0/4159848088 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01800f620 con 0x7fc02406bb70 2024-05-03T22:40:46.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.104+0000 7fc02c000700 1 -- 172.21.15.44:0/4159848088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0241a1120 con 0x7fc02406bb70 2024-05-03T22:40:46.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.104+0000 7fc02c000700 1 -- 172.21.15.44:0/4159848088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0241a89a0 con 0x7fc02406bb70 2024-05-03T22:40:46.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.105+0000 7fc02c000700 1 -- 172.21.15.44:0/4159848088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc024104bf0 con 0x7fc02406bb70 2024-05-03T22:40:46.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.109+0000 7fc022000700 1 -- 172.21.15.44:0/4159848088 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc018019070 con 0x7fc02406bb70 2024-05-03T22:40:46.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.111+0000 7fc022000700 1 --2- 172.21.15.44:0/4159848088 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc00c0b2900 0x7fc00c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:46.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.111+0000 7fc022000700 1 -- 172.21.15.44:0/4159848088 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fc0180e23d0 con 0x7fc02406bb70 2024-05-03T22:40:46.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.111+0000 7fc028c00700 1 --2- 172.21.15.44:0/4159848088 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc00c0b2900 0x7fc00c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:46.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.112+0000 7fc028c00700 1 --2- 172.21.15.44:0/4159848088 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc00c0b2900 0x7fc00c0b4dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc010005fd0 tx=0x7fc010005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:46.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.113+0000 7fc022000700 1 -- 172.21.15.44:0/4159848088 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc0180a9e50 con 0x7fc02406bb70 2024-05-03T22:40:46.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:46 smithi044 ceph-mon[28604]: pgmap v393: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:46.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.355+0000 7fc02c000700 1 -- 172.21.15.44:0/4159848088 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0241a8c40 con 0x7fc02406bb70 2024-05-03T22:40:46.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.360+0000 7fc022000700 1 -- 172.21.15.44:0/4159848088 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24068 (secure 0 0 0) 0x7fc0180a9750 con 0x7fc02406bb70 2024-05-03T22:40:46.363 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:40:46.363 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":85,"fsid":"5b0efdca-099c-11ef-bc97-c7b262605968","created":"2024-05-03T22:28:49.471963+0000","modified":"2024-05-03T22:40:33.255872+0000","last_up_change":"2024-05-03T22:38:41.446244+0000","last_in_change":"2024-05-03T22:38:16.952689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:33:24.956832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:40:05.501996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:40:09.732161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:40:23.052845+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05869397-bdc9-4c38-b1c6-deb466454dd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6803","nonce":4219032560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6805","nonce":4219032560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6809","nonce":4219032560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6807","nonce":4219032560}]},"public_addr":"172.21.15.44:6803/4219032560","cluster_addr":"172.21.15.44:6805/4219032560","heartbeat_back_addr":"172.21.15.44:6809/4219032560","heartbeat_front_addr":"172.21.15.44:6807/4219032560","state":["exists","up"]},{"osd":1,"uuid":"ff61ca27-e36b-41c9-898f-1cd7af1d9db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6801","nonce":563003638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6803","nonce":563003638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6807","nonce":563003638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6805","nonce":563003638}]},"public_addr":"172.21.15.60:6801/563003638","cluster_addr":"172.21.15.60:6803/563003638","heartbeat_back_addr":"172.21.15.60:6807/563003638","heartbeat_front_addr":"172.21.15.60:6805/563003638","state":["exists","up"]},{"osd":2,"uuid":"e58f96dc-3486-452e-85a1-847a0e2c523a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6801","nonce":2524540447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6803","nonce":2524540447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6807","nonce":2524540447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6805","nonce":2524540447}]},"public_addr":"172.21.15.160:6801/2524540447","cluster_addr":"172.21.15.160:6803/2524540447","heartbeat_back_addr":"172.21.15.160:6807/2524540447","heartbeat_front_addr":"172.21.15.160:6805/2524540447","state":["exists","up"]},{"osd":3,"uuid":"75c56c3b-5807-4646-885c-1ef16541ff72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6811","nonce":3298926279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6813","nonce":3298926279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6817","nonce":3298926279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6815","nonce":3298926279}]},"public_addr":"172.21.15.44:6811/3298926279","cluster_addr":"172.21.15.44:6813/3298926279","heartbeat_back_addr":"172.21.15.44:6817/3298926279","heartbeat_front_addr":"172.21.15.44:6815/3298926279","state":["exists","up"]},{"osd":4,"uuid":"a8a322e4-6ca1-4727-8b41-5ff523acc591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6809","nonce":3794821539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6811","nonce":3794821539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6815","nonce":3794821539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6813","nonce":3794821539}]},"public_addr":"172.21.15.60:6809/3794821539","cluster_addr":"172.21.15.60:6811/3794821539","heartbeat_back_addr":"172.21.15.60:6815/3794821539","heartbeat_front_addr":"172.21.15.60:6813/3794821539","state":["exists","up"]},{"osd":5,"uuid":"bc718527-bacd-4d1b-90c6-758cbd859e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6809","nonce":429142335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6811","nonce":429142335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6815","nonce":429142335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6813","nonce":429142335}]},"public_addr":"172.21.15.160:6809/429142335","cluster_addr":"172.21.15.160:6811/429142335","heartbeat_back_addr":"172.21.15.160:6815/429142335","heartbeat_front_addr":"172.21.15.160:6813/429142335","state":["exists","up"]},{"osd":6,"uuid":"f95a1d05-a958-4e5c-a90a-6b0c3d9fad43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6819","nonce":2805326764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6821","nonce":2805326764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6825","nonce":2805326764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6823","nonce":2805326764}]},"public_addr":"172.21.15.44:6819/2805326764","cluster_addr":"172.21.15.44:6821/2805326764","heartbeat_back_addr":"172.21.15.44:6825/2805326764","heartbeat_front_addr":"172.21.15.44:6823/2805326764","state":["exists","up"]},{"osd":7,"uuid":"a515e4be-c607-4f4a-96bb-c3d395d7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6817","nonce":693512829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6819","nonce":693512829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6823","nonce":693512829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6821","nonce":693512829}]},"public_addr":"172.21.15.60:6817/693512829","cluster_addr":"172.21.15.60:6819/693512829","heartbeat_back_addr":"172.21.15.60:6823/693512829","heartbeat_front_addr":"172.21.15.60:6821/693512829","state":["exists","up"]},{"osd":8,"uuid":"717aeffb-6c51-4e4e-8344-fba70ac2c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6817","nonce":2920554498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6819","nonce":2920554498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6823","nonce":2920554498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6821","nonce":2920554498}]},"public_addr":"172.21.15.160:6817/2920554498","cluster_addr":"172.21.15.160:6819/2920554498","heartbeat_back_addr":"172.21.15.160:6823/2920554498","heartbeat_front_addr":"172.21.15.160:6821/2920554498","state":["exists","up"]},{"osd":9,"uuid":"ade31284-1246-42c8-9cee-e60dacc58a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6827","nonce":414763386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6829","nonce":414763386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6833","nonce":414763386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6831","nonce":414763386}]},"public_addr":"172.21.15.44:6827/414763386","cluster_addr":"172.21.15.44:6829/414763386","heartbeat_back_addr":"172.21.15.44:6833/414763386","heartbeat_front_addr":"172.21.15.44:6831/414763386","state":["exists","up"]},{"osd":10,"uuid":"e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6825","nonce":2396062554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6827","nonce":2396062554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6831","nonce":2396062554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6829","nonce":2396062554}]},"public_addr":"172.21.15.60:6825/2396062554","cluster_addr":"172.21.15.60:6827/2396062554","heartbeat_back_addr":"172.21.15.60:6831/2396062554","heartbeat_front_addr":"172.21.15.60:6829/2396062554","state":["exists","up"]},{"osd":11,"uuid":"b6951585-9337-4b5a-a691-e765deb4b825","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6825","nonce":1397967755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6827","nonce":1397967755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6831","nonce":1397967755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6829","nonce":1397967755}]},"public_addr":"172.21.15.160:6825/1397967755","cluster_addr":"172.21.15.160:6827/1397967755","heartbeat_back_addr":"172.21.15.160:6831/1397967755","heartbeat_front_addr":"172.21.15.160:6829/1397967755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:15.012060+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:48.390669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:21.227227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:56.388453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:34:31.079377+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:04.912058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:40.941904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:16.757849+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:51.591794+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:37:29.022917+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:05.506391+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:39.793901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2661810503":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3426728285":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/4246410673":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2328074241":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/1738155460":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3461866265":"2024-05-04T22:30:08.766919+0000","172.21.15.44:6800/950841500":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/950841500":"2024-05-04T22:29:32.846592+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:40:46.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.363+0000 7fc02c000700 1 -- 172.21.15.44:0/4159848088 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc00c0b2900 msgr2=0x7fc00c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:46.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.363+0000 7fc02c000700 1 --2- 172.21.15.44:0/4159848088 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc00c0b2900 0x7fc00c0b4dc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc010005fd0 tx=0x7fc010005ee0 comp rx=0 tx=0).stop 2024-05-03T22:40:46.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.363+0000 7fc02c000700 1 -- 172.21.15.44:0/4159848088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc02406bb70 msgr2=0x7fc02419be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:46.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.363+0000 7fc02c000700 1 --2- 172.21.15.44:0/4159848088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc02406bb70 0x7fc02419be20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc01800d950 tx=0x7fc01800dd10 comp rx=0 tx=0).stop 2024-05-03T22:40:46.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.363+0000 7fc02c000700 1 -- 172.21.15.44:0/4159848088 shutdown_connections 2024-05-03T22:40:46.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.363+0000 7fc02c000700 1 --2- 172.21.15.44:0/4159848088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc024109530 0x7fc0241a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:46.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.363+0000 7fc02c000700 1 --2- 172.21.15.44:0/4159848088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc02406bb70 0x7fc02419be20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:46.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.363+0000 7fc02c000700 1 --2- 172.21.15.44:0/4159848088 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc00c0b2900 0x7fc00c0b4dc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:46.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.363+0000 7fc02c000700 1 --2- 172.21.15.44:0/4159848088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc02406c530 0x7fc02419c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:46.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.363+0000 7fc02c000700 1 -- 172.21.15.44:0/4159848088 >> 172.21.15.44:0/4159848088 conn(0x7fc024079350 msgr2=0x7fc02410e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:46.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.363+0000 7fc02c000700 1 -- 172.21.15.44:0/4159848088 shutdown_connections 2024-05-03T22:40:46.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:46.363+0000 7fc02c000700 1 -- 172.21.15.44:0/4159848088 wait complete. 2024-05-03T22:40:46.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:46 smithi060 ceph-mon[31721]: pgmap v393: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:46.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:46 smithi160 ceph-mon[32531]: pgmap v393: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:47.365 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:40:47.447 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:47 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/4159848088' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:40:47.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:47 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/4159848088' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:40:47.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:47 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/4159848088' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:40:47.831 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:40:48.242 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:48 smithi044 ceph-mon[28604]: pgmap v394: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:48.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:48 smithi060 ceph-mon[31721]: pgmap v394: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:48.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:48 smithi160 ceph-mon[32531]: pgmap v394: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:50.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.217+0000 7fd9c7a00700 1 -- 172.21.15.44:0/1660586020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9c0109510 msgr2=0x7fd9c01098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:50.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.217+0000 7fd9c7a00700 1 --2- 172.21.15.44:0/1660586020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9c0109510 0x7fd9c01098f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4009990 tx=0x7fd9b4009ca0 comp rx=0 tx=0).stop 2024-05-03T22:40:50.220 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.217+0000 7fd9c7a00700 1 -- 172.21.15.44:0/1660586020 shutdown_connections 2024-05-03T22:40:50.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.217+0000 7fd9c7a00700 1 --2- 172.21.15.44:0/1660586020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9c006bb40 0x7fd9c0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:50.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.217+0000 7fd9c7a00700 1 --2- 172.21.15.44:0/1660586020 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9c0109510 0x7fd9c01098f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:50.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.217+0000 7fd9c7a00700 1 --2- 172.21.15.44:0/1660586020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9c006b180 0x7fd9c006b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:50.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.217+0000 7fd9c7a00700 1 -- 172.21.15.44:0/1660586020 >> 172.21.15.44:0/1660586020 conn(0x7fd9c0079350 msgr2=0x7fd9c0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:50.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.217+0000 7fd9c7a00700 1 -- 172.21.15.44:0/1660586020 shutdown_connections 2024-05-03T22:40:50.221 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.217+0000 7fd9c7a00700 1 -- 172.21.15.44:0/1660586020 wait complete. 2024-05-03T22:40:50.222 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.219+0000 7fd9c7a00700 1 Processor -- start 2024-05-03T22:40:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.219+0000 7fd9c7a00700 1 -- start start 2024-05-03T22:40:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.219+0000 7fd9c7a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9c006b180 0x7fd9c019be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.219+0000 7fd9c7a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9c006bb40 0x7fd9c019c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.219+0000 7fd9c7a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9c0109510 0x7fd9c01a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.219+0000 7fd9c7a00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c01137b0 con 0x7fd9c006bb40 2024-05-03T22:40:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.219+0000 7fd9c7a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c0113630 con 0x7fd9c0109510 2024-05-03T22:40:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.219+0000 7fd9c7a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c0113930 con 0x7fd9c006b180 2024-05-03T22:40:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.220+0000 7fd9bfe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9c006bb40 0x7fd9c019c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.220+0000 7fd9bfe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9c006bb40 0x7fd9c019c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56564/0 (socket says 172.21.15.44:56564) 2024-05-03T22:40:50.223 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.220+0000 7fd9bfe00700 1 -- 172.21.15.44:0/2783937121 learned_addr learned my addr 172.21.15.44:0/2783937121 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:40:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.220+0000 7fd9c5000700 1 --2- 172.21.15.44:0/2783937121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9c006b180 0x7fd9c019be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.220+0000 7fd9c5a00700 1 --2- 172.21.15.44:0/2783937121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9c0109510 0x7fd9c01a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.220+0000 7fd9bfe00700 1 -- 172.21.15.44:0/2783937121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9c006b180 msgr2=0x7fd9c019be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.220+0000 7fd9bfe00700 1 --2- 172.21.15.44:0/2783937121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9c006b180 0x7fd9c019be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.220+0000 7fd9bfe00700 1 -- 172.21.15.44:0/2783937121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9c0109510 msgr2=0x7fd9c01a0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.220+0000 7fd9bfe00700 1 --2- 172.21.15.44:0/2783937121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9c0109510 0x7fd9c01a0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:50.224 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.220+0000 7fd9bfe00700 1 -- 172.21.15.44:0/2783937121 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c01a0e80 con 0x7fd9c006bb40 2024-05-03T22:40:50.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.221+0000 7fd9bfe00700 1 --2- 172.21.15.44:0/2783937121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9c006bb40 0x7fd9c019c3b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00c9b0 tx=0x7fd9ac00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:50.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.221+0000 7fd9bd600700 1 -- 172.21.15.44:0/2783937121 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac007b00 con 0x7fd9c006bb40 2024-05-03T22:40:50.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.221+0000 7fd9bd600700 1 -- 172.21.15.44:0/2783937121 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fd9ac007ca0 con 0x7fd9c006bb40 2024-05-03T22:40:50.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.221+0000 7fd9c7a00700 1 -- 172.21.15.44:0/2783937121 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c01a1170 con 0x7fd9c006bb40 2024-05-03T22:40:50.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.221+0000 7fd9bd600700 1 -- 172.21.15.44:0/2783937121 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac018660 con 0x7fd9c006bb40 2024-05-03T22:40:50.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.221+0000 7fd9c7a00700 1 -- 172.21.15.44:0/2783937121 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c01a89f0 con 0x7fd9c006bb40 2024-05-03T22:40:50.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.222+0000 7fd9c7a00700 1 -- 172.21.15.44:0/2783937121 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c006a190 con 0x7fd9c006bb40 2024-05-03T22:40:50.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.225+0000 7fd9bd600700 1 -- 172.21.15.44:0/2783937121 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd9ac00f450 con 0x7fd9c006bb40 2024-05-03T22:40:50.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.226+0000 7fd9bd600700 1 --2- 172.21.15.44:0/2783937121 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd9a80b2900 0x7fd9a80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:50.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.226+0000 7fd9bd600700 1 -- 172.21.15.44:0/2783937121 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fd9ac0e2460 con 0x7fd9c006bb40 2024-05-03T22:40:50.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.227+0000 7fd9c5000700 1 --2- 172.21.15.44:0/2783937121 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd9a80b2900 0x7fd9a80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:50.229 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.227+0000 7fd9c5000700 1 --2- 172.21.15.44:0/2783937121 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd9a80b2900 0x7fd9a80b4dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4006010 tx=0x7fd9b400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:50.233 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.231+0000 7fd9bd600700 1 -- 172.21.15.44:0/2783937121 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd9ac014030 con 0x7fd9c006bb40 2024-05-03T22:40:50.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:50 smithi044 ceph-mon[28604]: pgmap v395: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:50.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:50 smithi060 ceph-mon[31721]: pgmap v395: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:50.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:50 smithi160 ceph-mon[32531]: pgmap v395: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:50.527 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.524+0000 7fd9c7a00700 1 -- 172.21.15.44:0/2783937121 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9c01a8c80 con 0x7fd9c006bb40 2024-05-03T22:40:50.528 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.525+0000 7fd9bd600700 1 -- 172.21.15.44:0/2783937121 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11797 (secure 0 0 0) 0x7fd9ac0a9ee0 con 0x7fd9c006bb40 2024-05-03T22:40:50.528 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:40:50.529 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2550955759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2550955759},{"type":"v1","addr":"172.21.15.44:6835","nonce":2550955759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3118490782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3118490782},{"type":"v1","addr":"172.21.15.44:6837","nonce":3118490782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14595,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6839/1408147232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1408147232},{"type":"v1","addr":"172.21.15.44:6839","nonce":1408147232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14607,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6841/4262223160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":4262223160},{"type":"v1","addr":"172.21.15.44:6841","nonce":4262223160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24424,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24469,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/1332937382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1332937382},{"type":"v1","addr":"172.21.15.160:6835","nonce":1332937382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24478,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/3735287805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3735287805},{"type":"v1","addr":"172.21.15.160:6837","nonce":3735287805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24493,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/861756806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":861756806},{"type":"v1","addr":"172.21.15.160:6839","nonce":861756806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34391,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/153110190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":153110190},{"type":"v1","addr":"172.21.15.60:6833","nonce":153110190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34409,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3390425489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3390425489},{"type":"v1","addr":"172.21.15.60:6835","nonce":3390425489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34427,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3568217572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3568217572},{"type":"v1","addr":"172.21.15.60:6837","nonce":3568217572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-03T22:40:14.758857+0000","modified":"2024-05-03T22:40:33.256090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34463":{"gid":34463,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.60:6839/2420093605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2420093605},{"type":"v1","addr":"172.21.15.60:6839","nonce":2420093605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34463,"qdb_cluster":[34463]},"id":1}]} 2024-05-03T22:40:50.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.528+0000 7fd9c7a00700 1 -- 172.21.15.44:0/2783937121 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd9a80b2900 msgr2=0x7fd9a80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:50.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.528+0000 7fd9c7a00700 1 --2- 172.21.15.44:0/2783937121 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd9a80b2900 0x7fd9a80b4dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd9b4006010 tx=0x7fd9b400b540 comp rx=0 tx=0).stop 2024-05-03T22:40:50.531 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.528+0000 7fd9c7a00700 1 -- 172.21.15.44:0/2783937121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9c006bb40 msgr2=0x7fd9c019c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.528+0000 7fd9c7a00700 1 --2- 172.21.15.44:0/2783937121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9c006bb40 0x7fd9c019c3b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac00c9b0 tx=0x7fd9ac00ccc0 comp rx=0 tx=0).stop 2024-05-03T22:40:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.529+0000 7fd9c7a00700 1 -- 172.21.15.44:0/2783937121 shutdown_connections 2024-05-03T22:40:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.529+0000 7fd9c7a00700 1 --2- 172.21.15.44:0/2783937121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9c0109510 0x7fd9c01a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.529+0000 7fd9c7a00700 1 --2- 172.21.15.44:0/2783937121 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd9a80b2900 0x7fd9a80b4dc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.529+0000 7fd9c7a00700 1 --2- 172.21.15.44:0/2783937121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9c006b180 0x7fd9c019be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.529+0000 7fd9c7a00700 1 --2- 172.21.15.44:0/2783937121 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd9c006bb40 0x7fd9c019c3b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.529+0000 7fd9c7a00700 1 -- 172.21.15.44:0/2783937121 >> 172.21.15.44:0/2783937121 conn(0x7fd9c0079350 msgr2=0x7fd9c0100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.529+0000 7fd9c7a00700 1 -- 172.21.15.44:0/2783937121 shutdown_connections 2024-05-03T22:40:50.532 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:50.529+0000 7fd9c7a00700 1 -- 172.21.15.44:0/2783937121 wait complete. 2024-05-03T22:40:50.533 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 17 2024-05-03T22:40:51.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:51 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2783937121' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:40:51.397 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:40:51.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:51 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2783937121' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:40:51.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:51 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2783937121' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:40:51.873 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:40:52.276 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:52 smithi044 ceph-mon[28604]: pgmap v396: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:52.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:52 smithi060 ceph-mon[31721]: pgmap v396: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:52.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:52 smithi160 ceph-mon[32531]: pgmap v396: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:54.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.175+0000 7fe0de800700 1 -- 172.21.15.44:0/3677302821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0d81143d0 msgr2=0x7fe0d81167c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:54.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.175+0000 7fe0de800700 1 --2- 172.21.15.44:0/3677302821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0d81143d0 0x7fe0d81167c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000b0a0 tx=0x7fe0d000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:40:54.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.175+0000 7fe0de800700 1 -- 172.21.15.44:0/3677302821 shutdown_connections 2024-05-03T22:40:54.178 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.175+0000 7fe0de800700 1 --2- 172.21.15.44:0/3677302821 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0d81143d0 0x7fe0d81167c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.175+0000 7fe0de800700 1 --2- 172.21.15.44:0/3677302821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0d8075840 0x7fe0d8075c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.175+0000 7fe0de800700 1 --2- 172.21.15.44:0/3677302821 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0d8076160 0x7fe0d8113e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.175+0000 7fe0de800700 1 -- 172.21.15.44:0/3677302821 >> 172.21.15.44:0/3677302821 conn(0x7fe0d80feef0 msgr2=0x7fe0d8101310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.175+0000 7fe0de800700 1 -- 172.21.15.44:0/3677302821 shutdown_connections 2024-05-03T22:40:54.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.175+0000 7fe0de800700 1 -- 172.21.15.44:0/3677302821 wait complete. 2024-05-03T22:40:54.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.177+0000 7fe0de800700 1 Processor -- start 2024-05-03T22:40:54.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.177+0000 7fe0de800700 1 -- start start 2024-05-03T22:40:54.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.177+0000 7fe0de800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0d8075840 0x7fe0d81a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:54.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.177+0000 7fe0de800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0d8076160 0x7fe0d81a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:54.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.177+0000 7fe0de800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0d81143d0 0x7fe0d81a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:54.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.177+0000 7fe0de800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d8119cc0 con 0x7fe0d81143d0 2024-05-03T22:40:54.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.177+0000 7fe0de800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d8119b40 con 0x7fe0d8076160 2024-05-03T22:40:54.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.177+0000 7fe0de800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d8119e40 con 0x7fe0d8075840 2024-05-03T22:40:54.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.178+0000 7fe0dde00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0d81143d0 0x7fe0d81a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:54.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.178+0000 7fe0dde00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0d81143d0 0x7fe0d81a49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56588/0 (socket says 172.21.15.44:56588) 2024-05-03T22:40:54.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.178+0000 7fe0dde00700 1 -- 172.21.15.44:0/3816633196 learned_addr learned my addr 172.21.15.44:0/3816633196 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:40:54.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.178+0000 7fe0dd400700 1 --2- 172.21.15.44:0/3816633196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0d8075840 0x7fe0d81a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:54.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.178+0000 7fe0dca00700 1 --2- 172.21.15.44:0/3816633196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0d8076160 0x7fe0d81a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:54.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.178+0000 7fe0dde00700 1 -- 172.21.15.44:0/3816633196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0d8075840 msgr2=0x7fe0d81a0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:54.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.178+0000 7fe0dde00700 1 --2- 172.21.15.44:0/3816633196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0d8075840 0x7fe0d81a0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:54.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.178+0000 7fe0dde00700 1 -- 172.21.15.44:0/3816633196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0d8076160 msgr2=0x7fe0d81a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:54.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.178+0000 7fe0dde00700 1 --2- 172.21.15.44:0/3816633196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0d8076160 0x7fe0d81a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:54.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.178+0000 7fe0dde00700 1 -- 172.21.15.44:0/3816633196 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d81a5130 con 0x7fe0d81143d0 2024-05-03T22:40:54.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.179+0000 7fe0dde00700 1 --2- 172.21.15.44:0/3816633196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0d81143d0 0x7fe0d81a49f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000b070 tx=0x7fe0d0007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:54.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.179+0000 7fe0d6000700 1 -- 172.21.15.44:0/3816633196 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0021070 con 0x7fe0d81143d0 2024-05-03T22:40:54.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.179+0000 7fe0d6000700 1 -- 172.21.15.44:0/3816633196 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fe0d001db20 con 0x7fe0d81143d0 2024-05-03T22:40:54.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.179+0000 7fe0d6000700 1 -- 172.21.15.44:0/3816633196 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d001bc20 con 0x7fe0d81143d0 2024-05-03T22:40:54.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.179+0000 7fe0de800700 1 -- 172.21.15.44:0/3816633196 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d81a53c0 con 0x7fe0d81143d0 2024-05-03T22:40:54.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.179+0000 7fe0de800700 1 -- 172.21.15.44:0/3816633196 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d81acca0 con 0x7fe0d81143d0 2024-05-03T22:40:54.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.180+0000 7fe0de800700 1 -- 172.21.15.44:0/3816633196 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0d806a190 con 0x7fe0d81143d0 2024-05-03T22:40:54.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.183+0000 7fe0d6000700 1 -- 172.21.15.44:0/3816633196 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe0d0024070 con 0x7fe0d81143d0 2024-05-03T22:40:54.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.185+0000 7fe0d6000700 1 --2- 172.21.15.44:0/3816633196 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fe0c00b2880 0x7fe0c00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:54.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.185+0000 7fe0d6000700 1 -- 172.21.15.44:0/3816633196 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fe0d000f020 con 0x7fe0d81143d0 2024-05-03T22:40:54.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.185+0000 7fe0dd400700 1 --2- 172.21.15.44:0/3816633196 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fe0c00b2880 0x7fe0c00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:54.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.186+0000 7fe0dd400700 1 --2- 172.21.15.44:0/3816633196 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fe0c00b2880 0x7fe0c00b4d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00bb30 tx=0x7fe0cc00b510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:54.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.187+0000 7fe0d6000700 1 -- 172.21.15.44:0/3816633196 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe0d002b020 con 0x7fe0d81143d0 2024-05-03T22:40:54.306 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:54 smithi044 ceph-mon[28604]: pgmap v397: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:54.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.456+0000 7fe0de800700 1 -- 172.21.15.44:0/3816633196 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0d81a1480 con 0x7fe0d81143d0 2024-05-03T22:40:54.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.460+0000 7fe0d6000700 1 -- 172.21.15.44:0/3816633196 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24068 (secure 0 0 0) 0x7fe0d00abd50 con 0x7fe0d81143d0 2024-05-03T22:40:54.463 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:40:54.464 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":85,"fsid":"5b0efdca-099c-11ef-bc97-c7b262605968","created":"2024-05-03T22:28:49.471963+0000","modified":"2024-05-03T22:40:33.255872+0000","last_up_change":"2024-05-03T22:38:41.446244+0000","last_in_change":"2024-05-03T22:38:16.952689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:33:24.956832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:40:05.501996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:40:09.732161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:40:23.052845+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05869397-bdc9-4c38-b1c6-deb466454dd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6803","nonce":4219032560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6805","nonce":4219032560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6809","nonce":4219032560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6807","nonce":4219032560}]},"public_addr":"172.21.15.44:6803/4219032560","cluster_addr":"172.21.15.44:6805/4219032560","heartbeat_back_addr":"172.21.15.44:6809/4219032560","heartbeat_front_addr":"172.21.15.44:6807/4219032560","state":["exists","up"]},{"osd":1,"uuid":"ff61ca27-e36b-41c9-898f-1cd7af1d9db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6801","nonce":563003638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6803","nonce":563003638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6807","nonce":563003638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6805","nonce":563003638}]},"public_addr":"172.21.15.60:6801/563003638","cluster_addr":"172.21.15.60:6803/563003638","heartbeat_back_addr":"172.21.15.60:6807/563003638","heartbeat_front_addr":"172.21.15.60:6805/563003638","state":["exists","up"]},{"osd":2,"uuid":"e58f96dc-3486-452e-85a1-847a0e2c523a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6801","nonce":2524540447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6803","nonce":2524540447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6807","nonce":2524540447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6805","nonce":2524540447}]},"public_addr":"172.21.15.160:6801/2524540447","cluster_addr":"172.21.15.160:6803/2524540447","heartbeat_back_addr":"172.21.15.160:6807/2524540447","heartbeat_front_addr":"172.21.15.160:6805/2524540447","state":["exists","up"]},{"osd":3,"uuid":"75c56c3b-5807-4646-885c-1ef16541ff72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6811","nonce":3298926279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6813","nonce":3298926279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6817","nonce":3298926279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6815","nonce":3298926279}]},"public_addr":"172.21.15.44:6811/3298926279","cluster_addr":"172.21.15.44:6813/3298926279","heartbeat_back_addr":"172.21.15.44:6817/3298926279","heartbeat_front_addr":"172.21.15.44:6815/3298926279","state":["exists","up"]},{"osd":4,"uuid":"a8a322e4-6ca1-4727-8b41-5ff523acc591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6809","nonce":3794821539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6811","nonce":3794821539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6815","nonce":3794821539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6813","nonce":3794821539}]},"public_addr":"172.21.15.60:6809/3794821539","cluster_addr":"172.21.15.60:6811/3794821539","heartbeat_back_addr":"172.21.15.60:6815/3794821539","heartbeat_front_addr":"172.21.15.60:6813/3794821539","state":["exists","up"]},{"osd":5,"uuid":"bc718527-bacd-4d1b-90c6-758cbd859e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6809","nonce":429142335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6811","nonce":429142335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6815","nonce":429142335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6813","nonce":429142335}]},"public_addr":"172.21.15.160:6809/429142335","cluster_addr":"172.21.15.160:6811/429142335","heartbeat_back_addr":"172.21.15.160:6815/429142335","heartbeat_front_addr":"172.21.15.160:6813/429142335","state":["exists","up"]},{"osd":6,"uuid":"f95a1d05-a958-4e5c-a90a-6b0c3d9fad43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6819","nonce":2805326764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6821","nonce":2805326764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6825","nonce":2805326764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6823","nonce":2805326764}]},"public_addr":"172.21.15.44:6819/2805326764","cluster_addr":"172.21.15.44:6821/2805326764","heartbeat_back_addr":"172.21.15.44:6825/2805326764","heartbeat_front_addr":"172.21.15.44:6823/2805326764","state":["exists","up"]},{"osd":7,"uuid":"a515e4be-c607-4f4a-96bb-c3d395d7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6817","nonce":693512829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6819","nonce":693512829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6823","nonce":693512829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6821","nonce":693512829}]},"public_addr":"172.21.15.60:6817/693512829","cluster_addr":"172.21.15.60:6819/693512829","heartbeat_back_addr":"172.21.15.60:6823/693512829","heartbeat_front_addr":"172.21.15.60:6821/693512829","state":["exists","up"]},{"osd":8,"uuid":"717aeffb-6c51-4e4e-8344-fba70ac2c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6817","nonce":2920554498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6819","nonce":2920554498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6823","nonce":2920554498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6821","nonce":2920554498}]},"public_addr":"172.21.15.160:6817/2920554498","cluster_addr":"172.21.15.160:6819/2920554498","heartbeat_back_addr":"172.21.15.160:6823/2920554498","heartbeat_front_addr":"172.21.15.160:6821/2920554498","state":["exists","up"]},{"osd":9,"uuid":"ade31284-1246-42c8-9cee-e60dacc58a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6827","nonce":414763386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6829","nonce":414763386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6833","nonce":414763386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6831","nonce":414763386}]},"public_addr":"172.21.15.44:6827/414763386","cluster_addr":"172.21.15.44:6829/414763386","heartbeat_back_addr":"172.21.15.44:6833/414763386","heartbeat_front_addr":"172.21.15.44:6831/414763386","state":["exists","up"]},{"osd":10,"uuid":"e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6825","nonce":2396062554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6827","nonce":2396062554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6831","nonce":2396062554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6829","nonce":2396062554}]},"public_addr":"172.21.15.60:6825/2396062554","cluster_addr":"172.21.15.60:6827/2396062554","heartbeat_back_addr":"172.21.15.60:6831/2396062554","heartbeat_front_addr":"172.21.15.60:6829/2396062554","state":["exists","up"]},{"osd":11,"uuid":"b6951585-9337-4b5a-a691-e765deb4b825","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6825","nonce":1397967755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6827","nonce":1397967755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6831","nonce":1397967755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6829","nonce":1397967755}]},"public_addr":"172.21.15.160:6825/1397967755","cluster_addr":"172.21.15.160:6827/1397967755","heartbeat_back_addr":"172.21.15.160:6831/1397967755","heartbeat_front_addr":"172.21.15.160:6829/1397967755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:15.012060+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:48.390669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:21.227227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:56.388453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:34:31.079377+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:04.912058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:40.941904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:16.757849+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:51.591794+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:37:29.022917+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:05.506391+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:39.793901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2661810503":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3426728285":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/4246410673":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2328074241":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/1738155460":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3461866265":"2024-05-04T22:30:08.766919+0000","172.21.15.44:6800/950841500":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/950841500":"2024-05-04T22:29:32.846592+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:40:54.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.463+0000 7fe0de800700 1 -- 172.21.15.44:0/3816633196 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fe0c00b2880 msgr2=0x7fe0c00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:54.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.463+0000 7fe0de800700 1 --2- 172.21.15.44:0/3816633196 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fe0c00b2880 0x7fe0c00b4d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00bb30 tx=0x7fe0cc00b510 comp rx=0 tx=0).stop 2024-05-03T22:40:54.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.463+0000 7fe0de800700 1 -- 172.21.15.44:0/3816633196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0d81143d0 msgr2=0x7fe0d81a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:54.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.463+0000 7fe0de800700 1 --2- 172.21.15.44:0/3816633196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0d81143d0 0x7fe0d81a49f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe0d000b070 tx=0x7fe0d0007ad0 comp rx=0 tx=0).stop 2024-05-03T22:40:54.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.463+0000 7fe0de800700 1 -- 172.21.15.44:0/3816633196 shutdown_connections 2024-05-03T22:40:54.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.463+0000 7fe0de800700 1 --2- 172.21.15.44:0/3816633196 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe0d81143d0 0x7fe0d81a49f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:54.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.463+0000 7fe0de800700 1 --2- 172.21.15.44:0/3816633196 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fe0c00b2880 0x7fe0c00b4d40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:54.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.463+0000 7fe0de800700 1 --2- 172.21.15.44:0/3816633196 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0d8075840 0x7fe0d81a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:54.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.463+0000 7fe0de800700 1 --2- 172.21.15.44:0/3816633196 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0d8076160 0x7fe0d81a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:54.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.463+0000 7fe0de800700 1 -- 172.21.15.44:0/3816633196 >> 172.21.15.44:0/3816633196 conn(0x7fe0d80feef0 msgr2=0x7fe0d80ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:54.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.464+0000 7fe0de800700 1 -- 172.21.15.44:0/3816633196 shutdown_connections 2024-05-03T22:40:54.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:54.464+0000 7fe0de800700 1 -- 172.21.15.44:0/3816633196 wait complete. 2024-05-03T22:40:54.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:54 smithi060 ceph-mon[31721]: pgmap v397: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:54.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:54 smithi160 ceph-mon[32531]: pgmap v397: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:55.309 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-03T22:40:14.758857+0000', 'modified': '2024-05-03T22:40:33.256090+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34463}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34463': {'gid': 34463, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.60:6839/2420093605', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6838', 'nonce': 2420093605}, {'type': 'v1', 'addr': '172.21.15.60:6839', 'nonce': 2420093605}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 34463, 'qdb_cluster': [34463]} 2024-05-03T22:40:55.309 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-03T22:40:55.309 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-03T22:40:55.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:55 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3816633196' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:40:55.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:55 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3816633196' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:40:55.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:55 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3816633196' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:40:55.796 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:40:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:56 smithi044 ceph-mon[28604]: pgmap v398: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:56 smithi060 ceph-mon[31721]: pgmap v398: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:56.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:56 smithi160 ceph-mon[32531]: pgmap v398: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:58.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.047+0000 7f63ba800700 1 -- 172.21.15.44:0/830742431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b41021a0 msgr2=0x7f63b4102580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:58.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.047+0000 7f63ba800700 1 --2- 172.21.15.44:0/830742431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b41021a0 0x7f63b4102580 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f63a8009990 tx=0x7f63a8009ca0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.047+0000 7f63ba800700 1 -- 172.21.15.44:0/830742431 shutdown_connections 2024-05-03T22:40:58.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.047+0000 7f63ba800700 1 --2- 172.21.15.44:0/830742431 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63b410fd50 0x7f63b4112140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.047+0000 7f63ba800700 1 --2- 172.21.15.44:0/830742431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b41021a0 0x7f63b4102580 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.047+0000 7f63ba800700 1 --2- 172.21.15.44:0/830742431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b4102b50 0x7f63b410f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.047+0000 7f63ba800700 1 -- 172.21.15.44:0/830742431 >> 172.21.15.44:0/830742431 conn(0x7f63b40fddc0 msgr2=0x7f63b41001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:58.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.047+0000 7f63ba800700 1 -- 172.21.15.44:0/830742431 shutdown_connections 2024-05-03T22:40:58.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.047+0000 7f63ba800700 1 -- 172.21.15.44:0/830742431 wait complete. 2024-05-03T22:40:58.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.048+0000 7f63ba800700 1 Processor -- start 2024-05-03T22:40:58.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.049+0000 7f63ba800700 1 -- start start 2024-05-03T22:40:58.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.049+0000 7f63ba800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63b41021a0 0x7f63b41a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:58.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.049+0000 7f63ba800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b4102b50 0x7f63b41a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:58.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.049+0000 7f63ba800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b410fd50 0x7f63b419bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:58.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.049+0000 7f63ba800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f63b4115950 con 0x7f63b410fd50 2024-05-03T22:40:58.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.049+0000 7f63ba800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f63b41157d0 con 0x7f63b4102b50 2024-05-03T22:40:58.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.049+0000 7f63ba800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f63b4115ad0 con 0x7f63b41021a0 2024-05-03T22:40:58.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.050+0000 7f63b9e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b410fd50 0x7f63b419bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:58.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.050+0000 7f63b9e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b410fd50 0x7f63b419bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56604/0 (socket says 172.21.15.44:56604) 2024-05-03T22:40:58.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.050+0000 7f63b9e00700 1 -- 172.21.15.44:0/937145252 learned_addr learned my addr 172.21.15.44:0/937145252 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:40:58.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.050+0000 7f63b9400700 1 --2- 172.21.15.44:0/937145252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63b41021a0 0x7f63b41a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:58.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.050+0000 7f63b8a00700 1 --2- 172.21.15.44:0/937145252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b4102b50 0x7f63b41a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:58.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.050+0000 7f63b9e00700 1 -- 172.21.15.44:0/937145252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63b41021a0 msgr2=0x7f63b41a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:58.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.050+0000 7f63b9e00700 1 --2- 172.21.15.44:0/937145252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63b41021a0 0x7f63b41a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.050+0000 7f63b9e00700 1 -- 172.21.15.44:0/937145252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b4102b50 msgr2=0x7f63b41a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:58.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.050+0000 7f63b9e00700 1 --2- 172.21.15.44:0/937145252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b4102b50 0x7f63b41a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.050+0000 7f63b9e00700 1 -- 172.21.15.44:0/937145252 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b419c270 con 0x7f63b410fd50 2024-05-03T22:40:58.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.050+0000 7f63b9e00700 1 --2- 172.21.15.44:0/937145252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b410fd50 0x7f63b419bb10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f63ac007d30 tx=0x7f63ac00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:58.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.051+0000 7f63b2000700 1 -- 172.21.15.44:0/937145252 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac00ad40 con 0x7f63b410fd50 2024-05-03T22:40:58.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.051+0000 7f63b2000700 1 -- 172.21.15.44:0/937145252 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f63ac004030 con 0x7f63b410fd50 2024-05-03T22:40:58.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.051+0000 7f63b2000700 1 -- 172.21.15.44:0/937145252 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac012680 con 0x7f63b410fd50 2024-05-03T22:40:58.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.051+0000 7f63ba800700 1 -- 172.21.15.44:0/937145252 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b419c560 con 0x7f63b410fd50 2024-05-03T22:40:58.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.051+0000 7f63ba800700 1 -- 172.21.15.44:0/937145252 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b41a87d0 con 0x7f63b410fd50 2024-05-03T22:40:58.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.056+0000 7f63b2000700 1 -- 172.21.15.44:0/937145252 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f63ac0041e0 con 0x7f63b410fd50 2024-05-03T22:40:58.059 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.057+0000 7f63c680db80 1 Processor -- start 2024-05-03T22:40:58.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.057+0000 7f63c680db80 1 -- start start 2024-05-03T22:40:58.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.058+0000 7f63c680db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559919991b80 0x559919991f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:58.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.058+0000 7f63c680db80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55991998bee0 0x55991998c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:58.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.058+0000 7f63c680db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991998c8a0 0x559919998940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:58.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.058+0000 7f63c680db80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5599198de9d0 con 0x55991998bee0 2024-05-03T22:40:58.060 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.058+0000 7f63c680db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55991987c710 con 0x55991998c8a0 2024-05-03T22:40:58.061 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.058+0000 7f63c680db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5599198da990 con 0x559919991b80 2024-05-03T22:40:58.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.058+0000 7f63b9400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55991998bee0 0x55991998c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:58.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.058+0000 7f63b2000700 1 --2- 172.21.15.44:0/937145252 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f639c0b2900 0x7f639c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:58.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.058+0000 7f63b9400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55991998bee0 0x55991998c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56616/0 (socket says 172.21.15.44:56616) 2024-05-03T22:40:58.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.058+0000 7f63b9400700 1 -- 172.21.15.44:0/1834127620 learned_addr learned my addr 172.21.15.44:0/1834127620 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:40:58.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.058+0000 7f63b8a00700 1 --2- 172.21.15.44:0/1834127620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559919991b80 0x559919991f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:58.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.059+0000 7f63b2000700 1 -- 172.21.15.44:0/937145252 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f63ac0e2680 con 0x7f63b410fd50 2024-05-03T22:40:58.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.059+0000 7f63b9e00700 1 --2- 172.21.15.44:0/937145252 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f639c0b2900 0x7f639c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:58.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.059+0000 7f63b8a00700 1 --2- 172.21.15.44:0/1834127620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991998c8a0 0x559919998940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:58.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.059+0000 7f63b9400700 1 -- 172.21.15.44:0/1834127620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559919991b80 msgr2=0x559919991f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:40:58.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.059+0000 7f63b9400700 1 --2- 172.21.15.44:0/1834127620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559919991b80 0x559919991f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.059+0000 7f63b9400700 1 -- 172.21.15.44:0/1834127620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991998c8a0 msgr2=0x559919998940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:40:58.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.059+0000 7f63b9400700 1 --2- 172.21.15.44:0/1834127620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991998c8a0 0x559919998940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.059+0000 7f63b9400700 1 -- 172.21.15.44:0/1834127620 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55991982b880 con 0x55991998bee0 2024-05-03T22:40:58.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.059+0000 7f63b8a00700 1 --2- 172.21.15.44:0/1834127620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559919991b80 0x559919991f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:40:58.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.059+0000 7f63b9400700 1 --2- 172.21.15.44:0/1834127620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55991998bee0 0x55991998c360 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f63a8015000 tx=0x7f63a8005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1598fcc587927965 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:58.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.060+0000 7f63b9e00700 1 --2- 172.21.15.44:0/937145252 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f639c0b2900 0x7f639c0b4dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f63ac0a6c70 tx=0x7f63ac004880 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:58.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.060+0000 7f63a6a00700 1 -- 172.21.15.44:0/1834127620 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8028070 con 0x55991998bee0 2024-05-03T22:40:58.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.060+0000 7f63a6a00700 1 -- 172.21.15.44:0/1834127620 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f63a800b850 con 0x55991998bee0 2024-05-03T22:40:58.063 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.060+0000 7f63a6a00700 1 -- 172.21.15.44:0/1834127620 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a80054b0 con 0x55991998bee0 2024-05-03T22:40:58.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.061+0000 7f63c680db80 1 -- 172.21.15.44:0/1834127620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55991998bee0 msgr2=0x55991998c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:58.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.061+0000 7f63c680db80 1 --2- 172.21.15.44:0/1834127620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55991998bee0 0x55991998c360 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f63a8015000 tx=0x7f63a8005c70 comp rx=0 tx=0).stop 2024-05-03T22:40:58.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.061+0000 7f63c680db80 1 -- 172.21.15.44:0/1834127620 shutdown_connections 2024-05-03T22:40:58.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.061+0000 7f63c680db80 1 --2- 172.21.15.44:0/1834127620 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991998c8a0 0x559919998940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.061+0000 7f63c680db80 1 --2- 172.21.15.44:0/1834127620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559919991b80 0x559919991f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.061+0000 7f63c680db80 1 --2- 172.21.15.44:0/1834127620 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55991998bee0 0x55991998c360 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.061+0000 7f63c680db80 1 -- 172.21.15.44:0/1834127620 >> 172.21.15.44:0/1834127620 conn(0x559919904680 msgr2=0x559919986b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:58.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.061+0000 7f63c680db80 1 -- 172.21.15.44:0/1834127620 shutdown_connections 2024-05-03T22:40:58.066 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.061+0000 7f63c680db80 1 -- 172.21.15.44:0/1834127620 wait complete. 2024-05-03T22:40:58.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.061+0000 7f63c680db80 1 -- start start 2024-05-03T22:40:58.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.062+0000 7f63c680db80 1 Processor -- start 2024-05-03T22:40:58.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.062+0000 7f63c680db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55991998bee0 0x559919998510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:58.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.062+0000 7f63c680db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991998c8a0 0x5599199958b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:58.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.062+0000 7f63c680db80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559919991b80 0x559919995df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:58.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.062+0000 7f63c680db80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x559919998e80 con 0x559919991b80 2024-05-03T22:40:58.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.062+0000 7f63c680db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x559919844ad0 con 0x55991998c8a0 2024-05-03T22:40:58.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.062+0000 7f63c680db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x559919999000 con 0x55991998bee0 2024-05-03T22:40:58.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.062+0000 7f63c680db80 10 client.0 _ll_register_callbacks cb 0x559919885c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:40:58.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.063+0000 7f63b8a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559919991b80 0x559919995df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:58.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.063+0000 7f63b8a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559919991b80 0x559919995df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56624/0 (socket says 172.21.15.44:56624) 2024-05-03T22:40:58.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.063+0000 7f63b8a00700 1 -- 172.21.15.44:0/3652560980 learned_addr learned my addr 172.21.15.44:0/3652560980 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:40:58.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.063+0000 7f63b8a00700 1 --2- 172.21.15.44:0/3652560980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55991998bee0 0x559919998510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:58.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.063+0000 7f63b9400700 1 --2- 172.21.15.44:0/3652560980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991998c8a0 0x5599199958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:58.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.063+0000 7f63b8a00700 1 -- 172.21.15.44:0/3652560980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55991998bee0 msgr2=0x559919998510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:40:58.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.063+0000 7f63b8a00700 1 --2- 172.21.15.44:0/3652560980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55991998bee0 0x559919998510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.063+0000 7f63b8a00700 1 -- 172.21.15.44:0/3652560980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991998c8a0 msgr2=0x5599199958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:40:58.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.063+0000 7f63b8a00700 1 --2- 172.21.15.44:0/3652560980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991998c8a0 0x5599199958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.063+0000 7f63b8a00700 1 -- 172.21.15.44:0/3652560980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599198a43d0 con 0x559919991b80 2024-05-03T22:40:58.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.064+0000 7f63b8a00700 1 --2- 172.21.15.44:0/3652560980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559919991b80 0x559919995df0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f63a000b430 tx=0x7f63a00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55c006100cd8cda server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:58.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.064+0000 7f639b400700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:40:58.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.064+0000 7f639b400700 1 -- 172.21.15.44:0/3652560980 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a000ee20 con 0x559919991b80 2024-05-03T22:40:58.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.064+0000 7f639b400700 1 -- 172.21.15.44:0/3652560980 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f63a0004830 con 0x559919991b80 2024-05-03T22:40:58.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.064+0000 7f63c680db80 1 -- 172.21.15.44:0/3652560980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63a800b850 con 0x559919991b80 2024-05-03T22:40:58.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.064+0000 7f639b400700 1 -- 172.21.15.44:0/3652560980 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f63a0004a30 con 0x559919991b80 2024-05-03T22:40:58.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.064+0000 7f63c680db80 10 client.14715 fetch_fsmap learned FSMap version 17 2024-05-03T22:40:58.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.064+0000 7f63c680db80 1 -- 172.21.15.44:0/3652560980 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x5599199a3660 con 0x559919991b80 2024-05-03T22:40:58.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.065+0000 7f639b400700 1 -- 172.21.15.44:0/3652560980 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f63a800b850 con 0x559919991b80 2024-05-03T22:40:58.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.065+0000 7f639b400700 1 -- 172.21.15.44:0/3652560980 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7f63a00105d0 con 0x559919991b80 2024-05-03T22:40:58.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.065+0000 7f63c680db80 10 client.14715 fetch_fsmap finished waiting for FSMap version 17 2024-05-03T22:40:58.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.065+0000 7f63c680db80 10 client.14715 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-03T22:40:58.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.065+0000 7f63c680db80 20 client.14715 populate_metadata read hostname 'smithi044' 2024-05-03T22:40:58.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.065+0000 7f63c680db80 1 --2- 172.21.15.44:0/3652560980 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x5599199a5c90 0x5599199a7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:58.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.065+0000 7f63c680db80 4 client.14715 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:40:58.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.065+0000 7f63c680db80 1 -- 172.21.15.44:0/3652560980 --> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559919958fa0 con 0x5599199a5c90 2024-05-03T22:40:58.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.066+0000 7f63b9400700 1 --2- 172.21.15.44:0/3652560980 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x5599199a5c90 0x5599199a7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:58.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.067+0000 7f63b9400700 1 --2- 172.21.15.44:0/3652560980 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x5599199a5c90 0x5599199a7100 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da5f0747403521a7 server_cookie=612498c74ec3aa69 in_seq=0 out_seq=0 2024-05-03T22:40:58.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.067+0000 7f639b400700 10 client.14715 ms_handle_connect on v2:172.21.15.60:6838/2420093605 2024-05-03T22:40:58.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.069+0000 7f639b400700 1 -- 172.21.15.44:0/3652560980 <== mds.0 v2:172.21.15.60:6838/2420093605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559919958fa0 con 0x5599199a5c90 2024-05-03T22:40:58.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.069+0000 7f639b400700 10 client.14715 handle_command_reply: tid=0 2024-05-03T22:40:58.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.069+0000 7f63c680db80 1 client.14715 shutdown 2024-05-03T22:40:58.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.069+0000 7f63c680db80 1 -- 172.21.15.44:0/3652560980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559919991b80 msgr2=0x559919995df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:58.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.069+0000 7f63c680db80 1 --2- 172.21.15.44:0/3652560980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559919991b80 0x559919995df0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f63a000b430 tx=0x7f63a00047c0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.069+0000 7f63c680db80 1 -- 172.21.15.44:0/3652560980 shutdown_connections 2024-05-03T22:40:58.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.069+0000 7f63c680db80 1 --2- 172.21.15.44:0/3652560980 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x5599199a5c90 0x5599199a7100 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.069+0000 7f63c680db80 1 --2- 172.21.15.44:0/3652560980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559919991b80 0x559919995df0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.069+0000 7f63c680db80 1 --2- 172.21.15.44:0/3652560980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55991998bee0 0x559919998510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.069+0000 7f63c680db80 1 --2- 172.21.15.44:0/3652560980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991998c8a0 0x5599199958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.069+0000 7f63c680db80 1 -- 172.21.15.44:0/3652560980 >> 172.21.15.44:0/3652560980 conn(0x559919904680 msgr2=0x55991998aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:58.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.070+0000 7f639b400700 0 client.14715 ms_handle_reset on v2:172.21.15.60:6838/2420093605 2024-05-03T22:40:58.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.070+0000 7f63c680db80 1 -- 172.21.15.44:0/3652560980 shutdown_connections 2024-05-03T22:40:58.073 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.070+0000 7f63c680db80 1 -- 172.21.15.44:0/3652560980 wait complete. 2024-05-03T22:40:58.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.070+0000 7f63c680db80 20 client.14715 trim_cache size 0 max 16384 2024-05-03T22:40:58.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.093+0000 7f63c680db80 1 Processor -- start 2024-05-03T22:40:58.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.093+0000 7f63c680db80 1 -- start start 2024-05-03T22:40:58.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.093+0000 7f63c680db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55991998bee0 0x559919995870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:58.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.093+0000 7f63c680db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991998c8a0 0x559919995db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:58.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.093+0000 7f63c680db80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559919991b80 0x559919986660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:58.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.093+0000 7f63c680db80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5599199a5440 con 0x559919991b80 2024-05-03T22:40:58.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.093+0000 7f63c680db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5599199a5b10 con 0x55991998c8a0 2024-05-03T22:40:58.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.093+0000 7f63c680db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5599199a61e0 con 0x55991998bee0 2024-05-03T22:40:58.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.094+0000 7f63b8a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559919991b80 0x559919986660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:58.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.094+0000 7f63b8a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559919991b80 0x559919986660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56638/0 (socket says 172.21.15.44:56638) 2024-05-03T22:40:58.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.094+0000 7f63b8a00700 1 -- 172.21.15.44:0/230822350 learned_addr learned my addr 172.21.15.44:0/230822350 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:40:58.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.094+0000 7f63b9400700 1 --2- 172.21.15.44:0/230822350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991998c8a0 0x559919995db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:58.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.094+0000 7f63b8a00700 1 --2- 172.21.15.44:0/230822350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55991998bee0 0x559919995870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:58.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.094+0000 7f63b8a00700 1 -- 172.21.15.44:0/230822350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55991998bee0 msgr2=0x559919995870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:40:58.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.094+0000 7f63b8a00700 1 --2- 172.21.15.44:0/230822350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55991998bee0 0x559919995870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.094+0000 7f63b8a00700 1 -- 172.21.15.44:0/230822350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991998c8a0 msgr2=0x559919995db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:40:58.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.094+0000 7f63b8a00700 1 --2- 172.21.15.44:0/230822350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991998c8a0 0x559919995db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.094+0000 7f63b8a00700 1 -- 172.21.15.44:0/230822350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559919958f80 con 0x559919991b80 2024-05-03T22:40:58.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.095+0000 7f63b8a00700 1 --2- 172.21.15.44:0/230822350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559919991b80 0x559919986660 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f63a0005fd0 tx=0x7f63a000b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f657dcd32b69de76 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:58.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.095+0000 7f63a6000700 1 -- 172.21.15.44:0/230822350 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a002f070 con 0x559919991b80 2024-05-03T22:40:58.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.095+0000 7f63a6000700 1 -- 172.21.15.44:0/230822350 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f63a0004830 con 0x559919991b80 2024-05-03T22:40:58.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.095+0000 7f63a6000700 1 -- 172.21.15.44:0/230822350 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a0025030 con 0x559919991b80 2024-05-03T22:40:58.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.095+0000 7f63c680db80 1 -- 172.21.15.44:0/230822350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559919991b80 msgr2=0x559919986660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:58.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.095+0000 7f63c680db80 1 --2- 172.21.15.44:0/230822350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559919991b80 0x559919986660 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f63a0005fd0 tx=0x7f63a000b460 comp rx=0 tx=0).stop 2024-05-03T22:40:58.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.096+0000 7f63c680db80 1 -- 172.21.15.44:0/230822350 shutdown_connections 2024-05-03T22:40:58.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.096+0000 7f63c680db80 1 --2- 172.21.15.44:0/230822350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x559919991b80 0x559919986660 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.096+0000 7f63c680db80 1 --2- 172.21.15.44:0/230822350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55991998bee0 0x559919995870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.096+0000 7f63c680db80 1 --2- 172.21.15.44:0/230822350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55991998c8a0 0x559919995db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.096+0000 7f63c680db80 1 -- 172.21.15.44:0/230822350 >> 172.21.15.44:0/230822350 conn(0x559919904680 msgr2=0x559919980a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:58.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.096+0000 7f63c680db80 1 -- 172.21.15.44:0/230822350 shutdown_connections 2024-05-03T22:40:58.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.096+0000 7f63c680db80 1 -- 172.21.15.44:0/230822350 wait complete. 2024-05-03T22:40:58.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.096+0000 7f63c680db80 1 -- start start 2024-05-03T22:40:58.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.096+0000 7f63c680db80 1 Processor -- start 2024-05-03T22:40:58.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.097+0000 7f63c680db80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55991998bee0 0x5599199b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:58.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.097+0000 7f63c680db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55991998c8a0 0x5599199b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:58.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.097+0000 7f63c680db80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559919991b80 0x5599199ab530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:58.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.097+0000 7f63c680db80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5599199a6f80 con 0x55991998bee0 2024-05-03T22:40:58.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.097+0000 7f63c680db80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5599199a68b0 con 0x559919991b80 2024-05-03T22:40:58.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.097+0000 7f63c680db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5599199a7650 con 0x55991998c8a0 2024-05-03T22:40:58.111 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.097+0000 7f63c680db80 10 client.0 _ll_register_callbacks cb 0x559919885c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:40:58.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.097+0000 7f63b8a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55991998bee0 0x5599199b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:58.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.097+0000 7f63b8a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55991998bee0 0x5599199b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56648/0 (socket says 172.21.15.44:56648) 2024-05-03T22:40:58.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.097+0000 7f63b8a00700 1 -- 172.21.15.44:0/2831877117 learned_addr learned my addr 172.21.15.44:0/2831877117 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:40:58.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.097+0000 7f63b9400700 1 --2- 172.21.15.44:0/2831877117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55991998c8a0 0x5599199b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:58.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.098+0000 7f63b8a00700 1 -- 172.21.15.44:0/2831877117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55991998c8a0 msgr2=0x5599199b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:40:58.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.098+0000 7f63b8a00700 1 --2- 172.21.15.44:0/2831877117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55991998c8a0 0x5599199b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.098+0000 7f63b8a00700 1 -- 172.21.15.44:0/2831877117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559919991b80 msgr2=0x5599199ab530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:40:58.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.098+0000 7f63b8a00700 1 --2- 172.21.15.44:0/2831877117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559919991b80 0x5599199ab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.098+0000 7f63b8a00700 1 -- 172.21.15.44:0/2831877117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559919983450 con 0x55991998bee0 2024-05-03T22:40:58.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.098+0000 7f63b9400700 1 --2- 172.21.15.44:0/2831877117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55991998c8a0 0x5599199b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:40:58.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.098+0000 7f63b8a00700 1 --2- 172.21.15.44:0/2831877117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55991998bee0 0x5599199b0580 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f63a0004a00 tx=0x7f63a0011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65bbbd0179fe1788 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:40:58.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.098+0000 7f639b400700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:40:58.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.098+0000 7f639b400700 1 -- 172.21.15.44:0/2831877117 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a002f040 con 0x55991998bee0 2024-05-03T22:40:58.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.098+0000 7f639b400700 1 -- 172.21.15.44:0/2831877117 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7f63a0010c10 con 0x55991998bee0 2024-05-03T22:40:58.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.098+0000 7f63c680db80 1 -- 172.21.15.44:0/2831877117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63a0004830 con 0x55991998bee0 2024-05-03T22:40:58.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.099+0000 7f639b400700 1 -- 172.21.15.44:0/2831877117 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f63a0025040 con 0x55991998bee0 2024-05-03T22:40:58.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.099+0000 7f63c680db80 10 client.14721 fetch_fsmap learned FSMap version 17 2024-05-03T22:40:58.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.099+0000 7f63c680db80 1 -- 172.21.15.44:0/2831877117 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x559919a11880 con 0x55991998bee0 2024-05-03T22:40:58.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.099+0000 7f639b400700 1 -- 172.21.15.44:0/2831877117 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f63a0004830 con 0x55991998bee0 2024-05-03T22:40:58.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.099+0000 7f639b400700 1 -- 172.21.15.44:0/2831877117 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7f63a00364d0 con 0x55991998bee0 2024-05-03T22:40:58.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.099+0000 7f63c680db80 10 client.14721 fetch_fsmap finished waiting for FSMap version 17 2024-05-03T22:40:58.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.099+0000 7f63c680db80 10 client.14721 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-03T22:40:58.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.099+0000 7f63c680db80 20 client.14721 populate_metadata read hostname 'smithi044' 2024-05-03T22:40:58.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.099+0000 7f63c680db80 1 --2- 172.21.15.44:0/2831877117 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x559919a15fe0 0x559919a14cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:40:58.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.099+0000 7f63c680db80 4 client.14721 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:40:58.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.099+0000 7f63c680db80 1 -- 172.21.15.44:0/2831877117 --> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] -- command(tid 0: {"prefix": "status"}) -- 0x5599198ec3b0 con 0x559919a15fe0 2024-05-03T22:40:58.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.100+0000 7f63b9400700 1 --2- 172.21.15.44:0/2831877117 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x559919a15fe0 0x559919a14cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:40:58.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.101+0000 7f63b9400700 1 --2- 172.21.15.44:0/2831877117 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x559919a15fe0 0x559919a14cf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8024b60d53c795be server_cookie=801e3ce101e70b00 in_seq=0 out_seq=0 2024-05-03T22:40:58.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.101+0000 7f639b400700 10 client.14721 ms_handle_connect on v2:172.21.15.60:6838/2420093605 2024-05-03T22:40:58.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.101+0000 7f639b400700 1 -- 172.21.15.44:0/2831877117 <== mds.0 v2:172.21.15.60:6838/2420093605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5599198ec3b0 con 0x559919a15fe0 2024-05-03T22:40:58.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.101+0000 7f639b400700 10 client.14721 handle_command_reply: tid=0 2024-05-03T22:40:58.114 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.101+0000 7f63c680db80 1 client.14721 shutdown 2024-05-03T22:40:58.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.102+0000 7f63c680db80 1 -- 172.21.15.44:0/2831877117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55991998bee0 msgr2=0x5599199b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:58.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.102+0000 7f63c680db80 1 --2- 172.21.15.44:0/2831877117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55991998bee0 0x5599199b0580 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f63a0004a00 tx=0x7f63a0011c40 comp rx=0 tx=0).stop 2024-05-03T22:40:58.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.102+0000 7f63c680db80 1 -- 172.21.15.44:0/2831877117 shutdown_connections 2024-05-03T22:40:58.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.102+0000 7f63c680db80 1 --2- 172.21.15.44:0/2831877117 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x559919a15fe0 0x559919a14cf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.102+0000 7f63c680db80 1 --2- 172.21.15.44:0/2831877117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559919991b80 0x5599199ab530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.102+0000 7f63c680db80 1 --2- 172.21.15.44:0/2831877117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55991998bee0 0x5599199b0580 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.102+0000 7f63c680db80 1 --2- 172.21.15.44:0/2831877117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55991998c8a0 0x5599199b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.102+0000 7f63c680db80 1 -- 172.21.15.44:0/2831877117 >> 172.21.15.44:0/2831877117 conn(0x559919904680 msgr2=0x559919995870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:58.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.102+0000 7f639b400700 0 client.14721 ms_handle_reset on v2:172.21.15.60:6838/2420093605 2024-05-03T22:40:58.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.102+0000 7f63c680db80 1 -- 172.21.15.44:0/2831877117 shutdown_connections 2024-05-03T22:40:58.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.102+0000 7f63c680db80 1 -- 172.21.15.44:0/2831877117 wait complete. 2024-05-03T22:40:58.115 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.102+0000 7f63c680db80 20 client.14721 trim_cache size 0 max 16384 2024-05-03T22:40:58.116 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-03T22:40:58.116 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "5b0efdca-099c-11ef-bc97-c7b262605968", 2024-05-03T22:40:58.116 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-05-03T22:40:58.116 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 34463, 2024-05-03T22:40:58.116 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-05-03T22:40:58.116 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-05-03T22:40:58.116 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-05-03T22:40:58.116 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 43.285589461000001, 2024-05-03T22:40:58.116 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 17, 2024-05-03T22:40:58.116 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 85, 2024-05-03T22:40:58.116 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 85, 2024-05-03T22:40:58.117 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 66.342314352000002 2024-05-03T22:40:58.117 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-03T22:40:58.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.103+0000 7f63ba800700 1 -- 172.21.15.44:0/937145252 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f639c0b2900 msgr2=0x7f639c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:58.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.103+0000 7f63ba800700 1 --2- 172.21.15.44:0/937145252 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f639c0b2900 0x7f639c0b4dc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f63ac0a6c70 tx=0x7f63ac004880 comp rx=0 tx=0).stop 2024-05-03T22:40:58.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.103+0000 7f63ba800700 1 -- 172.21.15.44:0/937145252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b410fd50 msgr2=0x7f63b419bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:40:58.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.103+0000 7f63ba800700 1 --2- 172.21.15.44:0/937145252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b410fd50 0x7f63b419bb10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f63ac007d30 tx=0x7f63ac00a340 comp rx=0 tx=0).stop 2024-05-03T22:40:58.117 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.103+0000 7f63ba800700 1 -- 172.21.15.44:0/937145252 shutdown_connections 2024-05-03T22:40:58.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.103+0000 7f63ba800700 1 --2- 172.21.15.44:0/937145252 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f63b410fd50 0x7f63b419bb10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.103+0000 7f63ba800700 1 --2- 172.21.15.44:0/937145252 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f639c0b2900 0x7f639c0b4dc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.103+0000 7f63ba800700 1 --2- 172.21.15.44:0/937145252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63b41021a0 0x7f63b41a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.103+0000 7f63ba800700 1 --2- 172.21.15.44:0/937145252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63b4102b50 0x7f63b41a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:40:58.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.103+0000 7f63ba800700 1 -- 172.21.15.44:0/937145252 >> 172.21.15.44:0/937145252 conn(0x7f63b40fddc0 msgr2=0x7f63b4111f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:40:58.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.103+0000 7f63ba800700 1 -- 172.21.15.44:0/937145252 shutdown_connections 2024-05-03T22:40:58.118 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:40:58.103+0000 7f63ba800700 1 -- 172.21.15.44:0/937145252 wait complete. 2024-05-03T22:40:58.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:40:58 smithi044 ceph-mon[28604]: pgmap v399: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:58.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:40:58 smithi060 ceph-mon[31721]: pgmap v399: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:58.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:40:58 smithi160 ceph-mon[32531]: pgmap v399: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:40:59.048 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-03T22:40:59.048 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-03T22:40:59.049 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-03T22:40:59.512 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:41:00.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:00 smithi060 ceph-mon[31721]: pgmap v400: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:00.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:00 smithi160 ceph-mon[32531]: pgmap v400: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:00.609 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:00 smithi044 ceph-mon[28604]: pgmap v400: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:01.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.847+0000 7fc972e00700 1 -- 172.21.15.44:0/1641609639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc96c104590 msgr2=0x7fc96c104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:01.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.847+0000 7fc972e00700 1 --2- 172.21.15.44:0/1641609639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc96c104590 0x7fc96c104970 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc960009990 tx=0x7fc960009ca0 comp rx=0 tx=0).stop 2024-05-03T22:41:01.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.848+0000 7fc972e00700 1 -- 172.21.15.44:0/1641609639 shutdown_connections 2024-05-03T22:41:01.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.848+0000 7fc972e00700 1 --2- 172.21.15.44:0/1641609639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc96c10d9c0 0x7fc96c10fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:01.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.848+0000 7fc972e00700 1 --2- 172.21.15.44:0/1641609639 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc96c104590 0x7fc96c104970 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:01.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.848+0000 7fc972e00700 1 --2- 172.21.15.44:0/1641609639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc96c104eb0 0x7fc96c10d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:01.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.848+0000 7fc972e00700 1 -- 172.21.15.44:0/1641609639 >> 172.21.15.44:0/1641609639 conn(0x7fc96c0fddc0 msgr2=0x7fc96c1001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:01.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.848+0000 7fc972e00700 1 -- 172.21.15.44:0/1641609639 shutdown_connections 2024-05-03T22:41:01.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.848+0000 7fc972e00700 1 -- 172.21.15.44:0/1641609639 wait complete. 2024-05-03T22:41:01.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.849+0000 7fc972e00700 1 Processor -- start 2024-05-03T22:41:01.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.849+0000 7fc972e00700 1 -- start start 2024-05-03T22:41:01.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.849+0000 7fc972e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc96c104590 0x7fc96c19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:01.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.849+0000 7fc972e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc96c104eb0 0x7fc96c19c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:01.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.849+0000 7fc972e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc96c10d9c0 0x7fc96c1a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:01.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.849+0000 7fc972e00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc96c113760 con 0x7fc96c104eb0 2024-05-03T22:41:01.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.849+0000 7fc972e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc96c1135e0 con 0x7fc96c10d9c0 2024-05-03T22:41:01.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.849+0000 7fc972e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc96c1138e0 con 0x7fc96c104590 2024-05-03T22:41:01.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.850+0000 7fc971000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc96c104eb0 0x7fc96c19c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:01.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.850+0000 7fc971000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc96c104eb0 0x7fc96c19c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57120/0 (socket says 172.21.15.44:57120) 2024-05-03T22:41:01.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.850+0000 7fc971000700 1 -- 172.21.15.44:0/3567905038 learned_addr learned my addr 172.21.15.44:0/3567905038 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:41:01.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.850+0000 7fc971a00700 1 --2- 172.21.15.44:0/3567905038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc96c104590 0x7fc96c19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:01.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.850+0000 7fc972400700 1 --2- 172.21.15.44:0/3567905038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc96c10d9c0 0x7fc96c1a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:01.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.850+0000 7fc971000700 1 -- 172.21.15.44:0/3567905038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc96c104590 msgr2=0x7fc96c19bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:01.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.850+0000 7fc971000700 1 --2- 172.21.15.44:0/3567905038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc96c104590 0x7fc96c19bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:01.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.850+0000 7fc971000700 1 -- 172.21.15.44:0/3567905038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc96c10d9c0 msgr2=0x7fc96c1a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:01.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.850+0000 7fc971000700 1 --2- 172.21.15.44:0/3567905038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc96c10d9c0 0x7fc96c1a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:01.854 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.850+0000 7fc971000700 1 -- 172.21.15.44:0/3567905038 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc96c1a0d30 con 0x7fc96c104eb0 2024-05-03T22:41:01.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.850+0000 7fc972400700 1 --2- 172.21.15.44:0/3567905038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc96c10d9c0 0x7fc96c1a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:41:01.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.850+0000 7fc971000700 1 --2- 172.21.15.44:0/3567905038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc96c104eb0 0x7fc96c19c2b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc95800c970 tx=0x7fc95800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:01.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.851+0000 7fc96a000700 1 -- 172.21.15.44:0/3567905038 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc958007b00 con 0x7fc96c104eb0 2024-05-03T22:41:01.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.851+0000 7fc96a000700 1 -- 172.21.15.44:0/3567905038 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fc958007ca0 con 0x7fc96c104eb0 2024-05-03T22:41:01.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.851+0000 7fc972e00700 1 -- 172.21.15.44:0/3567905038 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc96c1a1020 con 0x7fc96c104eb0 2024-05-03T22:41:01.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.851+0000 7fc96a000700 1 -- 172.21.15.44:0/3567905038 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc958018640 con 0x7fc96c104eb0 2024-05-03T22:41:01.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.851+0000 7fc972e00700 1 -- 172.21.15.44:0/3567905038 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc96c1a88a0 con 0x7fc96c104eb0 2024-05-03T22:41:01.855 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.852+0000 7fc972e00700 1 -- 172.21.15.44:0/3567905038 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc96c06a190 con 0x7fc96c104eb0 2024-05-03T22:41:01.857 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.855+0000 7fc96a000700 1 -- 172.21.15.44:0/3567905038 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc958004870 con 0x7fc96c104eb0 2024-05-03T22:41:01.858 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.856+0000 7fc96a000700 1 --2- 172.21.15.44:0/3567905038 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc9540b2900 0x7fc9540b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:01.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.856+0000 7fc96a000700 1 -- 172.21.15.44:0/3567905038 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8802+0+0 (secure 0 0 0) 0x7fc9580e2460 con 0x7fc96c104eb0 2024-05-03T22:41:01.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.856+0000 7fc971a00700 1 --2- 172.21.15.44:0/3567905038 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc9540b2900 0x7fc9540b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:01.859 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.857+0000 7fc971a00700 1 --2- 172.21.15.44:0/3567905038 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc9540b2900 0x7fc9540b4dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc96000b5c0 tx=0x7fc960005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:01.863 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:01.861+0000 7fc96a000700 1 -- 172.21.15.44:0/3567905038 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc958014030 con 0x7fc96c104eb0 2024-05-03T22:41:02.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:02.152+0000 7fc972e00700 1 -- 172.21.15.44:0/3567905038 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc96c1a8b30 con 0x7fc96c104eb0 2024-05-03T22:41:02.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:02.153+0000 7fc96a000700 1 -- 172.21.15.44:0/3567905038 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fc9580a9ee0 con 0x7fc96c104eb0 2024-05-03T22:41:02.155 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-03T22:41:02.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:02.156+0000 7fc972e00700 1 -- 172.21.15.44:0/3567905038 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc9540b2900 msgr2=0x7fc9540b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:02.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:02.156+0000 7fc972e00700 1 --2- 172.21.15.44:0/3567905038 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc9540b2900 0x7fc9540b4dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc96000b5c0 tx=0x7fc960005fd0 comp rx=0 tx=0).stop 2024-05-03T22:41:02.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:02.156+0000 7fc972e00700 1 -- 172.21.15.44:0/3567905038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc96c104eb0 msgr2=0x7fc96c19c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:02.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:02.156+0000 7fc972e00700 1 --2- 172.21.15.44:0/3567905038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc96c104eb0 0x7fc96c19c2b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc95800c970 tx=0x7fc95800cd30 comp rx=0 tx=0).stop 2024-05-03T22:41:02.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:02.156+0000 7fc972e00700 1 -- 172.21.15.44:0/3567905038 shutdown_connections 2024-05-03T22:41:02.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:02.156+0000 7fc972e00700 1 --2- 172.21.15.44:0/3567905038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc96c10d9c0 0x7fc96c1a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:02.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:02.156+0000 7fc972e00700 1 --2- 172.21.15.44:0/3567905038 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc9540b2900 0x7fc9540b4dc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:02.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:02.156+0000 7fc972e00700 1 --2- 172.21.15.44:0/3567905038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc96c104590 0x7fc96c19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:02.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:02.156+0000 7fc972e00700 1 --2- 172.21.15.44:0/3567905038 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc96c104eb0 0x7fc96c19c2b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:02.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:02.156+0000 7fc972e00700 1 -- 172.21.15.44:0/3567905038 >> 172.21.15.44:0/3567905038 conn(0x7fc96c0fddc0 msgr2=0x7fc96c10fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:02.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:02.157+0000 7fc972e00700 1 -- 172.21.15.44:0/3567905038 shutdown_connections 2024-05-03T22:41:02.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:02.157+0000 7fc972e00700 1 -- 172.21.15.44:0/3567905038 wait complete. 2024-05-03T22:41:02.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:02 smithi044 ceph-mon[28604]: pgmap v401: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:02.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:02 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3567905038' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-03T22:41:02.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:02 smithi160 ceph-mon[32531]: pgmap v401: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:02.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:02 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3567905038' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-03T22:41:02.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:02 smithi060 ceph-mon[31721]: pgmap v401: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:02.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:02 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3567905038' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-03T22:41:03.024 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-03T22:41:03.024 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-03T22:41:03.024 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-05-03T22:41:03.024 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-03T22:41:03.024 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-03T22:41:03.024 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-03T22:41:03.024 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-03T22:41:03.024 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-03T22:41:03.024 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-03T22:41:03.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:41:03.025 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-05-03T22:41:03.084 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-03T22:41:03.085 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-03T22:41:03.085 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-05-03T22:41:03.085 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-05-03T22:41:03.085 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-05-03T22:41:03.085 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-05-03T22:41:03.085 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-03T22:41:03.085 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-05-03T22:41:03.085 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-05-03T22:41:03.085 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-03T22:41:03.085 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-05-03T22:41:03.085 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-05-03T22:41:03.085 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-03T22:41:03.086 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-05-03T22:41:03.086 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-05-03T22:41:03.086 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-03T22:41:03.086 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 41866sec preferred_lft 41866sec 2024-05-03T22:41:03.086 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link noprefixroute 2024-05-03T22:41:03.086 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-05-03T22:41:03.086 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-03T22:41:03.086 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-05-03T22:41:03.086 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-05-03T22:41:03.087 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-03T22:41:03.088 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:41:03.088 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-05-03T22:41:03.088 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add name ceph-brx type bridge 2024-05-03T22:41:03.088 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr flush dev ceph-brx 2024-05-03T22:41:03.088 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set ceph-brx up 2024-05-03T22:41:03.088 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-03T22:41:03.088 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-05-03T22:41:03.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:41:03.587 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:41:03.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:41:03.597 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-03T22:41:03.669 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-05-03T22:41:03.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:41:03.673 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-05-03T22:41:03.730 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-05-03T22:41:03.730 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-03T22:41:03.730 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-03T22:41:03.730 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-03T22:41:03.730 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-03T22:41:03.730 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:41:03.731 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-05-03T22:41:03.731 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-03T22:41:03.731 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-03T22:41:03.731 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-03T22:41:03.731 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-05-03T22:41:03.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:41:04.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:04 smithi044 ceph-mon[28604]: pgmap v402: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:04.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:04 smithi160 ceph-mon[32531]: pgmap v402: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:04.534 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:41:04.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:41:04.544 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-05-03T22:41:04.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:41:04.600 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list-id 2024-05-03T22:41:04.654 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:41:04.654 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-05-03T22:41:04.655 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T22:41:04.655 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-03T22:41:04.655 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-05-03T22:41:04.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:04 smithi060 ceph-mon[31721]: pgmap v402: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:04.766 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:41:04.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:41:04.852 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-03T22:41:04.852 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:41:04.852 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-05-03T22:41:04.852 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-03T22:41:04.852 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-03T22:41:04.852 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-03T22:41:04.852 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-03T22:41:04.852 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-03T22:41:04.852 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-05-03T22:41:04.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:41:05.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:41:05.159 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:41:05.159 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-05-03T22:41:05.159 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-05-03T22:41:05.159 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set dev brx.0 master ceph-brx 2024-05-03T22:41:05.159 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-05-03T22:41:05.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:41:05.297 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:05 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:41:05.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:41:05.353 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-03T22:41:05.353 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-03T22:41:05.354 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-03T22:41:05.397 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-03T22:41:05.397 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-03T22:41:05.397 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-03T22:41:05.486 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-05-03T22:41:05.561 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2024-05-03T22:41:05.608 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2024-05-03T22:41:05.608 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2024-05-03T22:41:05.608 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2024-05-03T22:41:05.608 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2024-05-03T22:41:05.608 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2024-05-03T22:41:05.608 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2024-05-03T22:41:05.609 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2024-05-03T22:41:05.609 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2024-05-03T22:41:05.609 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2024-05-03T22:41:05.609 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2024-05-03T22:41:05.609 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2024-05-03T22:41:05.609 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2024-05-03T22:41:05.609 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:41:05.609 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2024-05-03T22:41:05.609 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2024-05-03T22:41:05.609 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2024-05-03T22:41:05.609 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2024-05-03T22:41:05.609 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2024-05-03T22:41:05.609 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2024-05-03T22:41:05.609 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2024-05-03T22:41:05.610 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-03T22:41:05.610 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-03T22:41:05.610 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2024-05-03T22:41:05.610 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2024-05-03T22:41:05.610 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2024-05-03T22:41:05.610 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay 2024-05-03T22:41:05.610 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/0ea2a48e895445700f7c6d984c2a58ef4b24195cb5fb110ad65763e73cccfa8a/merged 2024-05-03T22:41:05.610 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/53330e09ce6a9454c5ed19cc9efe6665c8e7fef8a55876e8b5162e69f91bd934/merged 2024-05-03T22:41:05.610 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/0 2024-05-03T22:41:05.610 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:41:05.610 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/7174c4ec555050ccf6e3c43ec69c172e8bd96ad992ae43930c16c360cd478d99/merged 2024-05-03T22:41:05.610 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/05dc6aa61bcc7f06dbdb172a313c96a505fc8c85f32019792c932a72e1ffd829/merged 2024-05-03T22:41:05.610 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/255d587fca2dad33c52e23349192ee7a8f7e15e2580a44b4f7eb256b4f602e9c/merged 2024-05-03T22:41:05.610 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/fb1e24b165b5a1da4a958d4dfa8ae8d1d1c7b0df3cedb4d82909f142d5d840cc/merged 2024-05-03T22:41:05.611 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/c506b8d78ced46b166c1aad49d768cb18f6c9cca3bcb313364bebe4492093adb/merged 2024-05-03T22:41:05.611 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/d90015af22e21f2b49a08aa5a1ef53350d10a148dac17ccbc51d639e2a8157ee/merged 2024-05-03T22:41:05.611 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/493f4f9a51c8134b8576580f654d85963d8e6f3ce099468d5eb54a7f2cfeb795/merged 2024-05-03T22:41:05.611 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/ff4826b91a72da3ddde9eb0cdcd9d6066167f6c7e397354f8ab54d5675adeba8/merged 2024-05-03T22:41:05.611 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2024-05-03T22:41:05.611 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T22:41:05.611 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T22:41:05.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:41:05.612 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-05-03T22:41:05.655 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-03T22:41:05.655 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-03T22:41:05.703 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-05-03T22:41:05.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:05 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:41:05.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:05 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:41:05.773 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2024-05-03T22:41:05.817 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2024-05-03T22:41:05.817 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2024-05-03T22:41:05.817 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2024-05-03T22:41:05.817 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2024-05-03T22:41:05.817 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2024-05-03T22:41:05.817 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2024-05-03T22:41:05.817 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2024-05-03T22:41:05.817 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2024-05-03T22:41:05.817 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2024-05-03T22:41:05.818 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2024-05-03T22:41:05.818 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2024-05-03T22:41:05.818 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2024-05-03T22:41:05.818 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:41:05.818 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2024-05-03T22:41:05.818 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2024-05-03T22:41:05.818 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2024-05-03T22:41:05.818 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2024-05-03T22:41:05.818 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2024-05-03T22:41:05.818 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2024-05-03T22:41:05.818 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2024-05-03T22:41:05.818 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-03T22:41:05.818 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-03T22:41:05.818 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2024-05-03T22:41:05.818 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2024-05-03T22:41:05.819 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2024-05-03T22:41:05.819 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay 2024-05-03T22:41:05.819 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/0ea2a48e895445700f7c6d984c2a58ef4b24195cb5fb110ad65763e73cccfa8a/merged 2024-05-03T22:41:05.819 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/53330e09ce6a9454c5ed19cc9efe6665c8e7fef8a55876e8b5162e69f91bd934/merged 2024-05-03T22:41:05.819 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/0 2024-05-03T22:41:05.819 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:41:05.819 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/7174c4ec555050ccf6e3c43ec69c172e8bd96ad992ae43930c16c360cd478d99/merged 2024-05-03T22:41:05.819 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/05dc6aa61bcc7f06dbdb172a313c96a505fc8c85f32019792c932a72e1ffd829/merged 2024-05-03T22:41:05.819 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/255d587fca2dad33c52e23349192ee7a8f7e15e2580a44b4f7eb256b4f602e9c/merged 2024-05-03T22:41:05.819 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/fb1e24b165b5a1da4a958d4dfa8ae8d1d1c7b0df3cedb4d82909f142d5d840cc/merged 2024-05-03T22:41:05.819 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/c506b8d78ced46b166c1aad49d768cb18f6c9cca3bcb313364bebe4492093adb/merged 2024-05-03T22:41:05.819 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/d90015af22e21f2b49a08aa5a1ef53350d10a148dac17ccbc51d639e2a8157ee/merged 2024-05-03T22:41:05.819 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/493f4f9a51c8134b8576580f654d85963d8e6f3ce099468d5eb54a7f2cfeb795/merged 2024-05-03T22:41:05.819 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/ff4826b91a72da3ddde9eb0cdcd9d6066167f6c7e397354f8ab54d5675adeba8/merged 2024-05-03T22:41:05.820 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2024-05-03T22:41:05.820 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T22:41:05.820 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T22:41:05.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:41:05.821 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-05-03T22:41:05.912 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:2024-05-03T22:41:05.910+0000 7fd555598480 -1 init, newargv = 0x5610ef51b920 newargc=15 2024-05-03T22:41:05.912 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:ceph-fuse[75584]: starting ceph client 2024-05-03T22:41:05.927 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:ceph-fuse[75584]: starting fuse 2024-05-03T22:41:06.569 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:06 smithi044 ceph-mon[28604]: pgmap v403: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:06.569 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:06 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:06.569 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:06 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:06.569 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:06 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:06.569 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:06 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:06.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:06 smithi060 ceph-mon[31721]: pgmap v403: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:06.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:06 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:06.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:06 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:06.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:06 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:06.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:06 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:06.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:06 smithi160 ceph-mon[32531]: pgmap v403: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:06.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:06 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:06.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:06 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:06.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:06 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:06.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:06 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:07.004 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-05-03T22:41:07.075 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2024-05-03T22:41:07.116 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2024-05-03T22:41:07.117 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2024-05-03T22:41:07.117 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2024-05-03T22:41:07.117 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2024-05-03T22:41:07.117 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2024-05-03T22:41:07.117 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2024-05-03T22:41:07.117 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2024-05-03T22:41:07.117 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2024-05-03T22:41:07.117 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2024-05-03T22:41:07.117 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2024-05-03T22:41:07.117 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2024-05-03T22:41:07.117 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2024-05-03T22:41:07.118 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:41:07.118 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2024-05-03T22:41:07.118 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2024-05-03T22:41:07.118 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2024-05-03T22:41:07.118 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2024-05-03T22:41:07.118 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2024-05-03T22:41:07.118 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2024-05-03T22:41:07.118 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2024-05-03T22:41:07.118 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-03T22:41:07.118 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-03T22:41:07.118 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2024-05-03T22:41:07.118 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2024-05-03T22:41:07.118 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2024-05-03T22:41:07.118 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay 2024-05-03T22:41:07.119 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/0ea2a48e895445700f7c6d984c2a58ef4b24195cb5fb110ad65763e73cccfa8a/merged 2024-05-03T22:41:07.119 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/53330e09ce6a9454c5ed19cc9efe6665c8e7fef8a55876e8b5162e69f91bd934/merged 2024-05-03T22:41:07.119 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/0 2024-05-03T22:41:07.119 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:41:07.119 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/7174c4ec555050ccf6e3c43ec69c172e8bd96ad992ae43930c16c360cd478d99/merged 2024-05-03T22:41:07.119 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/05dc6aa61bcc7f06dbdb172a313c96a505fc8c85f32019792c932a72e1ffd829/merged 2024-05-03T22:41:07.119 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/255d587fca2dad33c52e23349192ee7a8f7e15e2580a44b4f7eb256b4f602e9c/merged 2024-05-03T22:41:07.119 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/fb1e24b165b5a1da4a958d4dfa8ae8d1d1c7b0df3cedb4d82909f142d5d840cc/merged 2024-05-03T22:41:07.119 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/c506b8d78ced46b166c1aad49d768cb18f6c9cca3bcb313364bebe4492093adb/merged 2024-05-03T22:41:07.119 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/d90015af22e21f2b49a08aa5a1ef53350d10a148dac17ccbc51d639e2a8157ee/merged 2024-05-03T22:41:07.119 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/493f4f9a51c8134b8576580f654d85963d8e6f3ce099468d5eb54a7f2cfeb795/merged 2024-05-03T22:41:07.119 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/ff4826b91a72da3ddde9eb0cdcd9d6066167f6c7e397354f8ab54d5675adeba8/merged 2024-05-03T22:41:07.119 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2024-05-03T22:41:07.119 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T22:41:07.120 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T22:41:07.120 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/mnt.admin 2024-05-03T22:41:07.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:41:07.121 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-05-03T22:41:07.207 INFO:teuthology.orchestra.run.smithi044.stdout:114 2024-05-03T22:41:07.207 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [114] 2024-05-03T22:41:07.207 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer -- python3 -c ' 2024-05-03T22:41:07.207 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2024-05-03T22:41:07.208 DEBUG:teuthology.orchestra.run.smithi044:> import re 2024-05-03T22:41:07.208 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-05-03T22:41:07.208 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2024-05-03T22:41:07.208 DEBUG:teuthology.orchestra.run.smithi044:> 2024-05-03T22:41:07.208 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2024-05-03T22:41:07.208 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-03T22:41:07.208 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2024-05-03T22:41:07.208 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-03T22:41:07.208 DEBUG:teuthology.orchestra.run.smithi044:> 2024-05-03T22:41:07.208 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2024-05-03T22:41:07.208 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2024-05-03T22:41:07.208 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2024-05-03T22:41:07.208 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2024-05-03T22:41:07.208 DEBUG:teuthology.orchestra.run.smithi044:> 2024-05-03T22:41:07.208 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2024-05-03T22:41:07.209 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-03T22:41:07.209 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-03T22:41:07.209 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-03T22:41:07.209 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2024-05-03T22:41:07.209 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2024-05-03T22:41:07.209 DEBUG:teuthology.orchestra.run.smithi044:> return f 2024-05-03T22:41:07.209 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-03T22:41:07.209 DEBUG:teuthology.orchestra.run.smithi044:> 2024-05-03T22:41:07.209 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.admin")) 2024-05-03T22:41:07.209 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-05-03T22:41:07.390 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.admin.75584.asok 2024-05-03T22:41:07.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:41:07.406 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.75584.asok 2024-05-03T22:41:07.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:41:07.406 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.75584.asok status 2024-05-03T22:41:07.622 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-03T22:41:07.622 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2024-05-03T22:41:07.622 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "9a047fe7599a549042d06a3fb5b6813a203eabea", 2024-05-03T22:41:07.622 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev)", 2024-05-03T22:41:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "admin", 2024-05-03T22:41:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-05-03T22:41:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-03T22:41:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "75584", 2024-05-03T22:41:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/" 2024-05-03T22:41:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-03T22:41:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2024-05-03T22:41:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2024-05-03T22:41:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 14733, 2024-05-03T22:41:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2024-05-03T22:41:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-05-03T22:41:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-05-03T22:41:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 14733 2024-05-03T22:41:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-03T22:41:07.623 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-05-03T22:41:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-05-03T22:41:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:0", 2024-05-03T22:41:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2428477779 2024-05-03T22:41:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-03T22:41:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-03T22:41:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-05-03T22:41:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-05-03T22:41:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "172.21.15.44:0", 2024-05-03T22:41:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2428477779 2024-05-03T22:41:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-03T22:41:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.14733 172.21.15.44:0/2428477779", 2024-05-03T22:41:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "172.21.15.44:0/2428477779", 2024-05-03T22:41:07.624 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 1, 2024-05-03T22:41:07.625 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 17, 2024-05-03T22:41:07.625 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 85, 2024-05-03T22:41:07.625 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2024-05-03T22:41:07.625 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2024-05-03T22:41:07.625 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2024-05-03T22:41:07.625 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-03T22:41:07.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:41:07.639 DEBUG:teuthology.orchestra.run.smithi044:> stat --file-system '--printf=%T 2024-05-03T22:41:07.639 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-03T22:41:07.681 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2024-05-03T22:41:07.682 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-03T22:41:07.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:41:07.682 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-03T22:41:07.796 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-03T22:41:07.889 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:07 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-03T22:41:07.930 INFO:teuthology.orchestra.run.smithi044.stdout:# file: . 2024-05-03T22:41:07.930 INFO:teuthology.orchestra.run.smithi044.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-03T22:41:07.930 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:41:07.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:41:07.939 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T22:41:07.939 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-03T22:41:07.982 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-03T22:41:08.444 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:41:08.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:08 smithi044 ceph-mon[28604]: pgmap v404: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:08.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:08 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:08.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:08 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:08.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:08 smithi060 ceph-mon[31721]: pgmap v404: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:08.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:08 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:08.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:08 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:08.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:08 smithi160 ceph-mon[32531]: pgmap v404: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:08.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:08 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:08.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:08 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:09.875 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:09 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:09.876 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:09 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:09.876 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:09 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-05-03T22:41:09.876 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:09 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]: dispatch 2024-05-03T22:41:09.876 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:09 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-05-03T22:41:09.876 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:09 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-05-03T22:41:09.877 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:09 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-05-03T22:41:09.877 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:09 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2024-05-03T22:41:09.877 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:09 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]: dispatch 2024-05-03T22:41:09.877 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:09 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-05-03T22:41:09.877 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:09 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 10]}]: dispatch 2024-05-03T22:41:09.877 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:09 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-05-03T22:41:09.878 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:09 smithi044 ceph-mon[28604]: pgmap v405: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-03T22:41:09.878 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:09 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:09.878 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:09 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:10.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:09 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:10.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:09 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:10.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:09 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-05-03T22:41:10.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:09 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]: dispatch 2024-05-03T22:41:10.007 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:09 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-05-03T22:41:10.007 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:09 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-05-03T22:41:10.007 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:09 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-05-03T22:41:10.007 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:09 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2024-05-03T22:41:10.007 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:09 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]: dispatch 2024-05-03T22:41:10.007 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:09 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-05-03T22:41:10.007 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:09 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 10]}]: dispatch 2024-05-03T22:41:10.007 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:09 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-05-03T22:41:10.007 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:09 smithi060 ceph-mon[31721]: pgmap v405: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-03T22:41:10.007 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:09 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:10.007 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:09 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:10.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:09 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:10.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:09 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:10.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:09 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]: dispatch 2024-05-03T22:41:10.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:09 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]: dispatch 2024-05-03T22:41:10.017 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:09 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-05-03T22:41:10.017 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:09 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]: dispatch 2024-05-03T22:41:10.017 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:09 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]: dispatch 2024-05-03T22:41:10.017 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:09 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2024-05-03T22:41:10.017 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:09 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]: dispatch 2024-05-03T22:41:10.017 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:09 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]: dispatch 2024-05-03T22:41:10.017 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:09 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 10]}]: dispatch 2024-05-03T22:41:10.017 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:09 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]: dispatch 2024-05-03T22:41:10.018 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:09 smithi160 ceph-mon[32531]: pgmap v405: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-03T22:41:10.018 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:09 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:10.018 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:09 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:10.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.936+0000 7feff2400700 1 -- 172.21.15.44:0/4036817012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefec10a490 msgr2=0x7fefec1169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:10.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.936+0000 7feff2400700 1 --2- 172.21.15.44:0/4036817012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefec10a490 0x7fefec1169a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fefe400b0a0 tx=0x7fefe400b3b0 comp rx=0 tx=0).stop 2024-05-03T22:41:10.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.936+0000 7feff2400700 1 -- 172.21.15.44:0/4036817012 shutdown_connections 2024-05-03T22:41:10.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.936+0000 7feff2400700 1 --2- 172.21.15.44:0/4036817012 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefec10a490 0x7fefec1169a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:10.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.936+0000 7feff2400700 1 --2- 172.21.15.44:0/4036817012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefec10fb60 0x7fefec10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:10.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.936+0000 7feff2400700 1 --2- 172.21.15.44:0/4036817012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefec109ad0 0x7fefec109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:10.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.936+0000 7feff2400700 1 -- 172.21.15.44:0/4036817012 >> 172.21.15.44:0/4036817012 conn(0x7fefec076c70 msgr2=0x7fefec1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:10.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.936+0000 7feff2400700 1 -- 172.21.15.44:0/4036817012 shutdown_connections 2024-05-03T22:41:10.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.936+0000 7feff2400700 1 -- 172.21.15.44:0/4036817012 wait complete. 2024-05-03T22:41:10.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.937+0000 7feff2400700 1 Processor -- start 2024-05-03T22:41:10.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.938+0000 7feff2400700 1 -- start start 2024-05-03T22:41:10.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.938+0000 7feff2400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefec109ad0 0x7fefec1a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:10.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.938+0000 7feff2400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefec10a490 0x7fefec1a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:10.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.938+0000 7feff2400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefec10fb60 0x7fefec1a4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:10.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.938+0000 7feff2400700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fefec119e40 con 0x7fefec10a490 2024-05-03T22:41:10.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.938+0000 7feff2400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fefec119cc0 con 0x7fefec109ad0 2024-05-03T22:41:10.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.938+0000 7feff2400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fefec119fc0 con 0x7fefec10fb60 2024-05-03T22:41:10.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.939+0000 7fefeaa00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefec10a490 0x7fefec1a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:10.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.939+0000 7fefeaa00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefec10a490 0x7fefec1a07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40140/0 (socket says 172.21.15.44:40140) 2024-05-03T22:41:10.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.939+0000 7fefeaa00700 1 -- 172.21.15.44:0/1466715818 learned_addr learned my addr 172.21.15.44:0/1466715818 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:41:10.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.939+0000 7fefebe00700 1 --2- 172.21.15.44:0/1466715818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefec10fb60 0x7fefec1a4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:10.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.939+0000 7fefeb400700 1 --2- 172.21.15.44:0/1466715818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefec109ad0 0x7fefec1a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:10.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.939+0000 7fefeaa00700 1 -- 172.21.15.44:0/1466715818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefec10fb60 msgr2=0x7fefec1a4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:10.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.939+0000 7fefeaa00700 1 --2- 172.21.15.44:0/1466715818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefec10fb60 0x7fefec1a4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:10.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.939+0000 7fefeaa00700 1 -- 172.21.15.44:0/1466715818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefec109ad0 msgr2=0x7fefec1a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:10.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.939+0000 7fefeaa00700 1 --2- 172.21.15.44:0/1466715818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefec109ad0 0x7fefec1a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:10.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.939+0000 7fefeaa00700 1 -- 172.21.15.44:0/1466715818 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefec1a5230 con 0x7fefec10a490 2024-05-03T22:41:10.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.939+0000 7fefeb400700 1 --2- 172.21.15.44:0/1466715818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefec109ad0 0x7fefec1a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:41:10.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.940+0000 7fefeaa00700 1 --2- 172.21.15.44:0/1466715818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefec10a490 0x7fefec1a07b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fefd800e9c0 tx=0x7fefd800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:10.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.940+0000 7fefe3e00700 1 -- 172.21.15.44:0/1466715818 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd800cbd0 con 0x7fefec10a490 2024-05-03T22:41:10.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.940+0000 7fefe3e00700 1 -- 172.21.15.44:0/1466715818 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fefd800cd70 con 0x7fefec10a490 2024-05-03T22:41:10.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.940+0000 7feff2400700 1 -- 172.21.15.44:0/1466715818 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefec1a5520 con 0x7fefec10a490 2024-05-03T22:41:10.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.940+0000 7fefe3e00700 1 -- 172.21.15.44:0/1466715818 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd8010430 con 0x7fefec10a490 2024-05-03T22:41:10.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.940+0000 7feff2400700 1 -- 172.21.15.44:0/1466715818 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefec1acda0 con 0x7fefec10a490 2024-05-03T22:41:10.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.941+0000 7feff2400700 1 -- 172.21.15.44:0/1466715818 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefec06a190 con 0x7fefec10a490 2024-05-03T22:41:10.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.945+0000 7fefe3e00700 1 -- 172.21.15.44:0/1466715818 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fefd8004750 con 0x7fefec10a490 2024-05-03T22:41:10.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.948+0000 7fefe3e00700 1 --2- 172.21.15.44:0/1466715818 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fefd00b2900 0x7fefd00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:10.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.948+0000 7fefe3e00700 1 -- 172.21.15.44:0/1466715818 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7fefd80e2a50 con 0x7fefec10a490 2024-05-03T22:41:10.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.948+0000 7fefeb400700 1 --2- 172.21.15.44:0/1466715818 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fefd00b2900 0x7fefd00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:10.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.949+0000 7fefeb400700 1 --2- 172.21.15.44:0/1466715818 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fefd00b2900 0x7fefd00b4dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fefdc005e10 tx=0x7fefdc005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:10.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:10.950+0000 7fefe3e00700 1 -- 172.21.15.44:0/1466715818 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fefd80aa3b0 con 0x7fefec10a490 2024-05-03T22:41:11.213 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:11.212+0000 7feff2400700 1 -- 172.21.15.44:0/1466715818 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fefec02e510 con 0x7fefec10a490 2024-05-03T22:41:11.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-05-03T22:41:11.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]': finished 2024-05-03T22:41:11.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-05-03T22:41:11.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-05-03T22:41:11.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-05-03T22:41:11.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-05-03T22:41:11.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-05-03T22:41:11.214 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-05-03T22:41:11.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 10]}]': finished 2024-05-03T22:41:11.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-05-03T22:41:11.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:10 smithi044 ceph-mon[28604]: osdmap e86: 12 total, 12 up, 12 in 2024-05-03T22:41:11.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:41:11.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:41:11.215 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:11.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:11.213+0000 7fefe3e00700 1 -- 172.21.15.44:0/1466715818 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) ==== 81+0+590 (secure 0 0 0) 0x7fefd80a9cb0 con 0x7fefec10a490 2024-05-03T22:41:11.216 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6800/1309719283 2024-05-04T22:30:08.766919+0000 2024-05-03T22:41:11.216 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/2661810503 2024-05-04T22:30:08.766919+0000 2024-05-03T22:41:11.216 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/3426728285 2024-05-04T22:29:32.846592+0000 2024-05-03T22:41:11.216 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/4246410673 2024-05-04T22:29:32.846592+0000 2024-05-03T22:41:11.216 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6801/1309719283 2024-05-04T22:30:08.766919+0000 2024-05-03T22:41:11.216 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/2328074241 2024-05-04T22:29:32.846592+0000 2024-05-03T22:41:11.216 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/1738155460 2024-05-04T22:30:08.766919+0000 2024-05-03T22:41:11.216 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/3461866265 2024-05-04T22:30:08.766919+0000 2024-05-03T22:41:11.216 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6800/950841500 2024-05-04T22:29:32.846592+0000 2024-05-03T22:41:11.216 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6801/950841500 2024-05-04T22:29:32.846592+0000 2024-05-03T22:41:11.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:11.216+0000 7feff2400700 1 -- 172.21.15.44:0/1466715818 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fefd00b2900 msgr2=0x7fefd00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:11.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:11.216+0000 7feff2400700 1 --2- 172.21.15.44:0/1466715818 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fefd00b2900 0x7fefd00b4dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fefdc005e10 tx=0x7fefdc005d60 comp rx=0 tx=0).stop 2024-05-03T22:41:11.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:11.216+0000 7feff2400700 1 -- 172.21.15.44:0/1466715818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefec10a490 msgr2=0x7fefec1a07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:11.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:11.216+0000 7feff2400700 1 --2- 172.21.15.44:0/1466715818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefec10a490 0x7fefec1a07b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fefd800e9c0 tx=0x7fefd800ecd0 comp rx=0 tx=0).stop 2024-05-03T22:41:11.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:11.217+0000 7feff2400700 1 -- 172.21.15.44:0/1466715818 shutdown_connections 2024-05-03T22:41:11.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:11.217+0000 7feff2400700 1 --2- 172.21.15.44:0/1466715818 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fefd00b2900 0x7fefd00b4dc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:11.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:11.217+0000 7feff2400700 1 --2- 172.21.15.44:0/1466715818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefec10fb60 0x7fefec1a4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:11.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:11.217+0000 7feff2400700 1 --2- 172.21.15.44:0/1466715818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefec109ad0 0x7fefec1a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:11.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:11.217+0000 7feff2400700 1 --2- 172.21.15.44:0/1466715818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fefec10a490 0x7fefec1a07b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:11.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:11.217+0000 7feff2400700 1 -- 172.21.15.44:0/1466715818 >> 172.21.15.44:0/1466715818 conn(0x7fefec076c70 msgr2=0x7fefec077190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:11.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:11.217+0000 7feff2400700 1 -- 172.21.15.44:0/1466715818 shutdown_connections 2024-05-03T22:41:11.219 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:11.217+0000 7feff2400700 1 -- 172.21.15.44:0/1466715818 wait complete. 2024-05-03T22:41:11.220 INFO:teuthology.orchestra.run.smithi044.stderr:listed 10 entries 2024-05-03T22:41:11.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-05-03T22:41:11.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]': finished 2024-05-03T22:41:11.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-05-03T22:41:11.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-05-03T22:41:11.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-05-03T22:41:11.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-05-03T22:41:11.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-05-03T22:41:11.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-05-03T22:41:11.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 10]}]': finished 2024-05-03T22:41:11.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-05-03T22:41:11.256 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:10 smithi060 ceph-mon[31721]: osdmap e86: 12 total, 12 up, 12 in 2024-05-03T22:41:11.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:41:11.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:41:11.257 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:11.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [8, 4]}]': finished 2024-05-03T22:41:11.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.2", "id": [7, 11]}]': finished 2024-05-03T22:41:11.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-05-03T22:41:11.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-05-03T22:41:11.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 1]}]': finished 2024-05-03T22:41:11.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2024-05-03T22:41:11.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-05-03T22:41:11.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [9, 8]}]': finished 2024-05-03T22:41:11.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 10]}]': finished 2024-05-03T22:41:11.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-05-03T22:41:11.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:10 smithi160 ceph-mon[32531]: osdmap e86: 12 total, 12 up, 12 in 2024-05-03T22:41:11.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:41:11.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:41:11.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:41:12.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:11 smithi044 ceph-mon[28604]: osdmap e87: 12 total, 12 up, 12 in 2024-05-03T22:41:12.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:11 smithi044 ceph-mon[28604]: pgmap v408: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-05-03T22:41:12.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:11 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1466715818' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T22:41:12.133 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T22:41:12.133 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-03T22:41:12.157 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:11 smithi060 ceph-mon[31721]: osdmap e87: 12 total, 12 up, 12 in 2024-05-03T22:41:12.157 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:11 smithi060 ceph-mon[31721]: pgmap v408: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-05-03T22:41:12.157 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:11 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1466715818' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T22:41:12.196 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-03T22:41:12.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:11 smithi160 ceph-mon[32531]: osdmap e87: 12 total, 12 up, 12 in 2024-05-03T22:41:12.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:11 smithi160 ceph-mon[32531]: pgmap v408: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-05-03T22:41:12.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:11 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1466715818' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T22:41:12.676 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:41:14.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:14 smithi060 ceph-mon[31721]: pgmap v409: 129 pgs: 1 activating, 128 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:14.384 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:14 smithi044 ceph-mon[28604]: pgmap v409: 129 pgs: 1 activating, 128 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:14.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:14 smithi160 ceph-mon[32531]: pgmap v409: 129 pgs: 1 activating, 128 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:14.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.955+0000 7f1c46800700 1 -- 172.21.15.44:0/909658145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c40075ff0 msgr2=0x7f1c4010f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:14.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.955+0000 7f1c46800700 1 --2- 172.21.15.44:0/909658145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c40075ff0 0x7f1c4010f960 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1c28009990 tx=0x7f1c28009ca0 comp rx=0 tx=0).stop 2024-05-03T22:41:14.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.955+0000 7f1c46800700 1 -- 172.21.15.44:0/909658145 shutdown_connections 2024-05-03T22:41:14.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.955+0000 7f1c46800700 1 --2- 172.21.15.44:0/909658145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c4010fea0 0x7f1c40112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:14.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.955+0000 7f1c46800700 1 --2- 172.21.15.44:0/909658145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c400756d0 0x7f1c40075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:14.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.955+0000 7f1c46800700 1 --2- 172.21.15.44:0/909658145 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c40075ff0 0x7f1c4010f960 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:14.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.955+0000 7f1c46800700 1 -- 172.21.15.44:0/909658145 >> 172.21.15.44:0/909658145 conn(0x7f1c4007a600 msgr2=0x7f1c4007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:14.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.955+0000 7f1c46800700 1 -- 172.21.15.44:0/909658145 shutdown_connections 2024-05-03T22:41:14.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.956+0000 7f1c46800700 1 -- 172.21.15.44:0/909658145 wait complete. 2024-05-03T22:41:14.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.957+0000 7f1c46800700 1 Processor -- start 2024-05-03T22:41:14.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.957+0000 7f1c46800700 1 -- start start 2024-05-03T22:41:14.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.958+0000 7f1c46800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c400756d0 0x7f1c4019be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:14.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.958+0000 7f1c46800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c40075ff0 0x7f1c4019c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:14.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.958+0000 7f1c46800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c4010fea0 0x7f1c401a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:14.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.958+0000 7f1c46800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1c401159d0 con 0x7f1c4010fea0 2024-05-03T22:41:14.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.958+0000 7f1c46800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1c40115850 con 0x7f1c400756d0 2024-05-03T22:41:14.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.958+0000 7f1c46800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1c40115b50 con 0x7f1c40075ff0 2024-05-03T22:41:14.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.958+0000 7f1c3fe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c4010fea0 0x7f1c401a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:14.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.958+0000 7f1c3fe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c4010fea0 0x7f1c401a06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40156/0 (socket says 172.21.15.44:40156) 2024-05-03T22:41:14.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.958+0000 7f1c3fe00700 1 -- 172.21.15.44:0/2494488538 learned_addr learned my addr 172.21.15.44:0/2494488538 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:41:14.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.958+0000 7f1c3f400700 1 --2- 172.21.15.44:0/2494488538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c400756d0 0x7f1c4019be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.958+0000 7f1c37e00700 1 --2- 172.21.15.44:0/2494488538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c40075ff0 0x7f1c4019c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.959+0000 7f1c3fe00700 1 -- 172.21.15.44:0/2494488538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c40075ff0 msgr2=0x7f1c4019c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.959+0000 7f1c3fe00700 1 --2- 172.21.15.44:0/2494488538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c40075ff0 0x7f1c4019c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.959+0000 7f1c3fe00700 1 -- 172.21.15.44:0/2494488538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c400756d0 msgr2=0x7f1c4019be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.959+0000 7f1c3fe00700 1 --2- 172.21.15.44:0/2494488538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c400756d0 0x7f1c4019be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:14.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.959+0000 7f1c3fe00700 1 -- 172.21.15.44:0/2494488538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c401a0de0 con 0x7f1c4010fea0 2024-05-03T22:41:14.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.959+0000 7f1c3fe00700 1 --2- 172.21.15.44:0/2494488538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c4010fea0 0x7f1c401a06a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1c380094f0 tx=0x7f1c3800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:14.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.959+0000 7f1c3cc00700 1 -- 172.21.15.44:0/2494488538 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3800ddd0 con 0x7f1c4010fea0 2024-05-03T22:41:14.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.959+0000 7f1c3cc00700 1 -- 172.21.15.44:0/2494488538 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f1c38009e20 con 0x7f1c4010fea0 2024-05-03T22:41:14.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.959+0000 7f1c3cc00700 1 -- 172.21.15.44:0/2494488538 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c38015400 con 0x7f1c4010fea0 2024-05-03T22:41:14.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.959+0000 7f1c46800700 1 -- 172.21.15.44:0/2494488538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c401a10d0 con 0x7f1c4010fea0 2024-05-03T22:41:14.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.960+0000 7f1c46800700 1 -- 172.21.15.44:0/2494488538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c401a8950 con 0x7f1c4010fea0 2024-05-03T22:41:14.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.961+0000 7f1c46800700 1 -- 172.21.15.44:0/2494488538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c4006a190 con 0x7f1c4010fea0 2024-05-03T22:41:14.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.963+0000 7f1c3cc00700 1 -- 172.21.15.44:0/2494488538 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f1c38004ad0 con 0x7f1c4010fea0 2024-05-03T22:41:14.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.965+0000 7f1c3cc00700 1 --2- 172.21.15.44:0/2494488538 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1c240b2880 0x7f1c240b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:14.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.965+0000 7f1c3cc00700 1 -- 172.21.15.44:0/2494488538 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f1c380e2850 con 0x7f1c4010fea0 2024-05-03T22:41:14.966 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.965+0000 7f1c3f400700 1 --2- 172.21.15.44:0/2494488538 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1c240b2880 0x7f1c240b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:14.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.966+0000 7f1c3f400700 1 --2- 172.21.15.44:0/2494488538 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1c240b2880 0x7f1c240b4d40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000ac50 tx=0x7f1c3000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:14.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:14.967+0000 7f1c3cc00700 1 -- 172.21.15.44:0/2494488538 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f1c38010070 con 0x7f1c4010fea0 2024-05-03T22:41:15.226 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:15.224+0000 7f1c46800700 1 -- 172.21.15.44:0/2494488538 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1c401a8b20 con 0x7f1c4010fea0 2024-05-03T22:41:15.227 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:15.225+0000 7f1c3cc00700 1 -- 172.21.15.44:0/2494488538 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) ==== 81+0+590 (secure 0 0 0) 0x7f1c380aa1b0 con 0x7f1c4010fea0 2024-05-03T22:41:15.227 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6800/1309719283 2024-05-04T22:30:08.766919+0000 2024-05-03T22:41:15.227 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/2661810503 2024-05-04T22:30:08.766919+0000 2024-05-03T22:41:15.227 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/3426728285 2024-05-04T22:29:32.846592+0000 2024-05-03T22:41:15.227 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/4246410673 2024-05-04T22:29:32.846592+0000 2024-05-03T22:41:15.227 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6801/1309719283 2024-05-04T22:30:08.766919+0000 2024-05-03T22:41:15.227 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/2328074241 2024-05-04T22:29:32.846592+0000 2024-05-03T22:41:15.227 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/1738155460 2024-05-04T22:30:08.766919+0000 2024-05-03T22:41:15.228 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/3461866265 2024-05-04T22:30:08.766919+0000 2024-05-03T22:41:15.228 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6800/950841500 2024-05-04T22:29:32.846592+0000 2024-05-03T22:41:15.228 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6801/950841500 2024-05-04T22:29:32.846592+0000 2024-05-03T22:41:15.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:15.229+0000 7f1c46800700 1 -- 172.21.15.44:0/2494488538 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1c240b2880 msgr2=0x7f1c240b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:15.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:15.229+0000 7f1c46800700 1 --2- 172.21.15.44:0/2494488538 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1c240b2880 0x7f1c240b4d40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000ac50 tx=0x7f1c3000a380 comp rx=0 tx=0).stop 2024-05-03T22:41:15.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:15.229+0000 7f1c46800700 1 -- 172.21.15.44:0/2494488538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c4010fea0 msgr2=0x7f1c401a06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:15.230 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:15.229+0000 7f1c46800700 1 --2- 172.21.15.44:0/2494488538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c4010fea0 0x7f1c401a06a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1c380094f0 tx=0x7f1c3800d3b0 comp rx=0 tx=0).stop 2024-05-03T22:41:15.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:15.229+0000 7f1c46800700 1 -- 172.21.15.44:0/2494488538 shutdown_connections 2024-05-03T22:41:15.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:15.229+0000 7f1c46800700 1 --2- 172.21.15.44:0/2494488538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1c4010fea0 0x7f1c401a06a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:15.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:15.229+0000 7f1c46800700 1 --2- 172.21.15.44:0/2494488538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c400756d0 0x7f1c4019be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:15.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:15.229+0000 7f1c46800700 1 --2- 172.21.15.44:0/2494488538 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1c240b2880 0x7f1c240b4d40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:15.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:15.229+0000 7f1c46800700 1 --2- 172.21.15.44:0/2494488538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1c40075ff0 0x7f1c4019c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:15.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:15.229+0000 7f1c46800700 1 -- 172.21.15.44:0/2494488538 >> 172.21.15.44:0/2494488538 conn(0x7f1c4007a600 msgr2=0x7f1c40100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:15.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:15.229+0000 7f1c46800700 1 -- 172.21.15.44:0/2494488538 shutdown_connections 2024-05-03T22:41:15.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:15.229+0000 7f1c46800700 1 -- 172.21.15.44:0/2494488538 wait complete. 2024-05-03T22:41:15.232 INFO:teuthology.orchestra.run.smithi044.stderr:listed 10 entries 2024-05-03T22:41:16.092 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2024-05-03T22:41:16.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:41:16.092 DEBUG:teuthology.orchestra.run.smithi044:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-03T22:41:16.178 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi044.stderr:ceph-fuse[75584]: fuse finished with error 0 and tester_r 0 2024-05-03T22:41:16.184 INFO:teuthology.orchestra.run:waiting for 300 2024-05-03T22:41:16.300 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:16 smithi044 ceph-mon[28604]: pgmap v410: 129 pgs: 1 activating, 128 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:16.300 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:16 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2494488538' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T22:41:16.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:16 smithi060 ceph-mon[31721]: pgmap v410: 129 pgs: 1 activating, 128 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:16.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:16 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2494488538' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T22:41:16.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:16 smithi160 ceph-mon[32531]: pgmap v410: 129 pgs: 1 activating, 128 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:16.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:16 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2494488538' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T22:41:18.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:18 smithi044 ceph-mon[28604]: pgmap v411: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:18.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:18 smithi060 ceph-mon[31721]: pgmap v411: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:18.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:18 smithi160 ceph-mon[32531]: pgmap v411: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:20.318 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:20 smithi160 ceph-mon[32531]: pgmap v412: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 111 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:20.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:20 smithi044 ceph-mon[28604]: pgmap v412: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 111 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:20.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:20 smithi060 ceph-mon[31721]: pgmap v412: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 111 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:22.285 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-05-03T22:41:22.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:41:22.286 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-03T22:41:22.354 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:41:22.427 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:22 smithi044 ceph-mon[28604]: pgmap v413: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 100 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:22.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:22 smithi060 ceph-mon[31721]: pgmap v413: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 100 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:22.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:22 smithi160 ceph-mon[32531]: pgmap v413: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 100 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:22.816 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:41:24.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:24 smithi044 ceph-mon[28604]: pgmap v414: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:24.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:24 smithi060 ceph-mon[31721]: pgmap v414: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:24.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:24 smithi160 ceph-mon[32531]: pgmap v414: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:25.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.185+0000 7f44a0600700 1 -- 172.21.15.44:0/144602064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f449806a8f0 msgr2=0x7f4498107be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:25.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.185+0000 7f44a0600700 1 --2- 172.21.15.44:0/144602064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f449806a8f0 0x7f4498107be0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f448c009990 tx=0x7f448c009ca0 comp rx=0 tx=0).stop 2024-05-03T22:41:25.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.185+0000 7f44a0600700 1 -- 172.21.15.44:0/144602064 shutdown_connections 2024-05-03T22:41:25.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.185+0000 7f44a0600700 1 --2- 172.21.15.44:0/144602064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4498101b80 0x7f4498102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:25.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.185+0000 7f44a0600700 1 --2- 172.21.15.44:0/144602064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f449806a8f0 0x7f4498107be0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:25.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.185+0000 7f44a0600700 1 --2- 172.21.15.44:0/144602064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f449806ad60 0x7f4498108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:25.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.185+0000 7f44a0600700 1 -- 172.21.15.44:0/144602064 >> 172.21.15.44:0/144602064 conn(0x7f4498078a10 msgr2=0x7f44980ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:25.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.185+0000 7f44a0600700 1 -- 172.21.15.44:0/144602064 shutdown_connections 2024-05-03T22:41:25.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.185+0000 7f44a0600700 1 -- 172.21.15.44:0/144602064 wait complete. 2024-05-03T22:41:25.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.187+0000 7f44a0600700 1 Processor -- start 2024-05-03T22:41:25.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.187+0000 7f44a0600700 1 -- start start 2024-05-03T22:41:25.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.188+0000 7f44a0600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f449806a8f0 0x7f449819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:25.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.188+0000 7f44a0600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f449806ad60 0x7f449819c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:25.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.188+0000 7f44a0600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4498101b80 0x7f44981a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:25.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.188+0000 7f44a0600700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f44981126d0 con 0x7f449806a8f0 2024-05-03T22:41:25.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.188+0000 7f44a0600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4498112550 con 0x7f449806ad60 2024-05-03T22:41:25.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.188+0000 7f44a0600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4498112850 con 0x7f4498101b80 2024-05-03T22:41:25.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.188+0000 7f449dc00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f449806a8f0 0x7f449819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:25.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.188+0000 7f449dc00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f449806a8f0 0x7f449819bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40276/0 (socket says 172.21.15.44:40276) 2024-05-03T22:41:25.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.188+0000 7f449dc00700 1 -- 172.21.15.44:0/2658773987 learned_addr learned my addr 172.21.15.44:0/2658773987 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:41:25.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.188+0000 7f449d200700 1 --2- 172.21.15.44:0/2658773987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f449806ad60 0x7f449819c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:25.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.188+0000 7f449e600700 1 --2- 172.21.15.44:0/2658773987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4498101b80 0x7f44981a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:25.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.189+0000 7f449dc00700 1 -- 172.21.15.44:0/2658773987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4498101b80 msgr2=0x7f44981a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:25.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.189+0000 7f449dc00700 1 --2- 172.21.15.44:0/2658773987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4498101b80 0x7f44981a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:25.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.189+0000 7f449dc00700 1 -- 172.21.15.44:0/2658773987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f449806ad60 msgr2=0x7f449819c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:25.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.189+0000 7f449dc00700 1 --2- 172.21.15.44:0/2658773987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f449806ad60 0x7f449819c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:25.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.189+0000 7f449dc00700 1 -- 172.21.15.44:0/2658773987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44981a0d20 con 0x7f449806a8f0 2024-05-03T22:41:25.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.189+0000 7f449e600700 1 --2- 172.21.15.44:0/2658773987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4498101b80 0x7f44981a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:41:25.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.189+0000 7f449d200700 1 --2- 172.21.15.44:0/2658773987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f449806ad60 0x7f449819c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:41:25.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.189+0000 7f449dc00700 1 --2- 172.21.15.44:0/2658773987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f449806a8f0 0x7f449819bd10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f448c000c00 tx=0x7f448c0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:25.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.190+0000 7f4496000700 1 -- 172.21.15.44:0/2658773987 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c027070 con 0x7f449806a8f0 2024-05-03T22:41:25.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.190+0000 7f4496000700 1 -- 172.21.15.44:0/2658773987 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f448c003ff0 con 0x7f449806a8f0 2024-05-03T22:41:25.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.190+0000 7f44a0600700 1 -- 172.21.15.44:0/2658773987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44981a0fb0 con 0x7f449806a8f0 2024-05-03T22:41:25.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.190+0000 7f4496000700 1 -- 172.21.15.44:0/2658773987 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c00f460 con 0x7f449806a8f0 2024-05-03T22:41:25.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.190+0000 7f44a0600700 1 -- 172.21.15.44:0/2658773987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44981a8890 con 0x7f449806a8f0 2024-05-03T22:41:25.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.191+0000 7f44a0600700 1 -- 172.21.15.44:0/2658773987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f449806a190 con 0x7f449806a8f0 2024-05-03T22:41:25.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.194+0000 7f4496000700 1 -- 172.21.15.44:0/2658773987 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f448c02a070 con 0x7f449806a8f0 2024-05-03T22:41:25.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.196+0000 7f4496000700 1 --2- 172.21.15.44:0/2658773987 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f44800b2880 0x7f44800b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:25.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.196+0000 7f4496000700 1 -- 172.21.15.44:0/2658773987 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f448c0e3d20 con 0x7f449806a8f0 2024-05-03T22:41:25.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.197+0000 7f449d200700 1 --2- 172.21.15.44:0/2658773987 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f44800b2880 0x7f44800b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:25.198 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.197+0000 7f449d200700 1 --2- 172.21.15.44:0/2658773987 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f44800b2880 0x7f44800b4d40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4484005fd0 tx=0x7f4484005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:25.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.199+0000 7f4496000700 1 -- 172.21.15.44:0/2658773987 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f448c031020 con 0x7f449806a8f0 2024-05-03T22:41:25.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.442+0000 7f44a0600700 1 -- 172.21.15.44:0/2658773987 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f44981a8a60 con 0x7f449806a8f0 2024-05-03T22:41:25.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.444+0000 7f4496000700 1 -- 172.21.15.44:0/2658773987 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24538 (secure 0 0 0) 0x7f448c013070 con 0x7f449806a8f0 2024-05-03T22:41:25.446 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:41:25.446 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":87,"fsid":"5b0efdca-099c-11ef-bc97-c7b262605968","created":"2024-05-03T22:28:49.471963+0000","modified":"2024-05-03T22:41:10.758634+0000","last_up_change":"2024-05-03T22:38:41.446244+0000","last_in_change":"2024-05-03T22:38:16.952689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:33:24.956832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:40:05.501996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:40:09.732161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:40:23.052845+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05869397-bdc9-4c38-b1c6-deb466454dd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6803","nonce":4219032560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6805","nonce":4219032560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6809","nonce":4219032560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6807","nonce":4219032560}]},"public_addr":"172.21.15.44:6803/4219032560","cluster_addr":"172.21.15.44:6805/4219032560","heartbeat_back_addr":"172.21.15.44:6809/4219032560","heartbeat_front_addr":"172.21.15.44:6807/4219032560","state":["exists","up"]},{"osd":1,"uuid":"ff61ca27-e36b-41c9-898f-1cd7af1d9db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6801","nonce":563003638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6803","nonce":563003638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6807","nonce":563003638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6805","nonce":563003638}]},"public_addr":"172.21.15.60:6801/563003638","cluster_addr":"172.21.15.60:6803/563003638","heartbeat_back_addr":"172.21.15.60:6807/563003638","heartbeat_front_addr":"172.21.15.60:6805/563003638","state":["exists","up"]},{"osd":2,"uuid":"e58f96dc-3486-452e-85a1-847a0e2c523a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6801","nonce":2524540447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6803","nonce":2524540447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6807","nonce":2524540447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6805","nonce":2524540447}]},"public_addr":"172.21.15.160:6801/2524540447","cluster_addr":"172.21.15.160:6803/2524540447","heartbeat_back_addr":"172.21.15.160:6807/2524540447","heartbeat_front_addr":"172.21.15.160:6805/2524540447","state":["exists","up"]},{"osd":3,"uuid":"75c56c3b-5807-4646-885c-1ef16541ff72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6811","nonce":3298926279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6813","nonce":3298926279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6817","nonce":3298926279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6815","nonce":3298926279}]},"public_addr":"172.21.15.44:6811/3298926279","cluster_addr":"172.21.15.44:6813/3298926279","heartbeat_back_addr":"172.21.15.44:6817/3298926279","heartbeat_front_addr":"172.21.15.44:6815/3298926279","state":["exists","up"]},{"osd":4,"uuid":"a8a322e4-6ca1-4727-8b41-5ff523acc591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6809","nonce":3794821539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6811","nonce":3794821539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6815","nonce":3794821539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6813","nonce":3794821539}]},"public_addr":"172.21.15.60:6809/3794821539","cluster_addr":"172.21.15.60:6811/3794821539","heartbeat_back_addr":"172.21.15.60:6815/3794821539","heartbeat_front_addr":"172.21.15.60:6813/3794821539","state":["exists","up"]},{"osd":5,"uuid":"bc718527-bacd-4d1b-90c6-758cbd859e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6809","nonce":429142335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6811","nonce":429142335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6815","nonce":429142335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6813","nonce":429142335}]},"public_addr":"172.21.15.160:6809/429142335","cluster_addr":"172.21.15.160:6811/429142335","heartbeat_back_addr":"172.21.15.160:6815/429142335","heartbeat_front_addr":"172.21.15.160:6813/429142335","state":["exists","up"]},{"osd":6,"uuid":"f95a1d05-a958-4e5c-a90a-6b0c3d9fad43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6819","nonce":2805326764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6821","nonce":2805326764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6825","nonce":2805326764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6823","nonce":2805326764}]},"public_addr":"172.21.15.44:6819/2805326764","cluster_addr":"172.21.15.44:6821/2805326764","heartbeat_back_addr":"172.21.15.44:6825/2805326764","heartbeat_front_addr":"172.21.15.44:6823/2805326764","state":["exists","up"]},{"osd":7,"uuid":"a515e4be-c607-4f4a-96bb-c3d395d7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6817","nonce":693512829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6819","nonce":693512829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6823","nonce":693512829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6821","nonce":693512829}]},"public_addr":"172.21.15.60:6817/693512829","cluster_addr":"172.21.15.60:6819/693512829","heartbeat_back_addr":"172.21.15.60:6823/693512829","heartbeat_front_addr":"172.21.15.60:6821/693512829","state":["exists","up"]},{"osd":8,"uuid":"717aeffb-6c51-4e4e-8344-fba70ac2c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6817","nonce":2920554498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6819","nonce":2920554498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6823","nonce":2920554498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6821","nonce":2920554498}]},"public_addr":"172.21.15.160:6817/2920554498","cluster_addr":"172.21.15.160:6819/2920554498","heartbeat_back_addr":"172.21.15.160:6823/2920554498","heartbeat_front_addr":"172.21.15.160:6821/2920554498","state":["exists","up"]},{"osd":9,"uuid":"ade31284-1246-42c8-9cee-e60dacc58a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6827","nonce":414763386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6829","nonce":414763386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6833","nonce":414763386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6831","nonce":414763386}]},"public_addr":"172.21.15.44:6827/414763386","cluster_addr":"172.21.15.44:6829/414763386","heartbeat_back_addr":"172.21.15.44:6833/414763386","heartbeat_front_addr":"172.21.15.44:6831/414763386","state":["exists","up"]},{"osd":10,"uuid":"e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6825","nonce":2396062554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6827","nonce":2396062554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6831","nonce":2396062554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6829","nonce":2396062554}]},"public_addr":"172.21.15.60:6825/2396062554","cluster_addr":"172.21.15.60:6827/2396062554","heartbeat_back_addr":"172.21.15.60:6831/2396062554","heartbeat_front_addr":"172.21.15.60:6829/2396062554","state":["exists","up"]},{"osd":11,"uuid":"b6951585-9337-4b5a-a691-e765deb4b825","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6825","nonce":1397967755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6827","nonce":1397967755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6831","nonce":1397967755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6829","nonce":1397967755}]},"public_addr":"172.21.15.160:6825/1397967755","cluster_addr":"172.21.15.160:6827/1397967755","heartbeat_back_addr":"172.21.15.160:6831/1397967755","heartbeat_front_addr":"172.21.15.160:6829/1397967755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:15.012060+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:48.390669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:21.227227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:56.388453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:34:31.079377+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:04.912058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:40.941904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:16.757849+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:51.591794+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:37:29.022917+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:05.506391+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:39.793901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2661810503":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3426728285":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/4246410673":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2328074241":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/1738155460":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3461866265":"2024-05-04T22:30:08.766919+0000","172.21.15.44:6800/950841500":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/950841500":"2024-05-04T22:29:32.846592+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:41:25.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.447+0000 7f44a0600700 1 -- 172.21.15.44:0/2658773987 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f44800b2880 msgr2=0x7f44800b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.447+0000 7f44a0600700 1 --2- 172.21.15.44:0/2658773987 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f44800b2880 0x7f44800b4d40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4484005fd0 tx=0x7f4484005e30 comp rx=0 tx=0).stop 2024-05-03T22:41:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.447+0000 7f44a0600700 1 -- 172.21.15.44:0/2658773987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f449806a8f0 msgr2=0x7f449819bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.447+0000 7f44a0600700 1 --2- 172.21.15.44:0/2658773987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f449806a8f0 0x7f449819bd10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f448c000c00 tx=0x7f448c0057c0 comp rx=0 tx=0).stop 2024-05-03T22:41:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.447+0000 7f44a0600700 1 -- 172.21.15.44:0/2658773987 shutdown_connections 2024-05-03T22:41:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.447+0000 7f44a0600700 1 --2- 172.21.15.44:0/2658773987 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f44800b2880 0x7f44800b4d40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.447+0000 7f44a0600700 1 --2- 172.21.15.44:0/2658773987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4498101b80 0x7f44981a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.447+0000 7f44a0600700 1 --2- 172.21.15.44:0/2658773987 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f449806a8f0 0x7f449819bd10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.447+0000 7f44a0600700 1 --2- 172.21.15.44:0/2658773987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f449806ad60 0x7f449819c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.447+0000 7f44a0600700 1 -- 172.21.15.44:0/2658773987 >> 172.21.15.44:0/2658773987 conn(0x7f4498078a10 msgr2=0x7f44980ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.447+0000 7f44a0600700 1 -- 172.21.15.44:0/2658773987 shutdown_connections 2024-05-03T22:41:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:25.447+0000 7f44a0600700 1 -- 172.21.15.44:0/2658773987 wait complete. 2024-05-03T22:41:26.338 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:26 smithi044 ceph-mon[28604]: pgmap v415: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:26.338 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:26 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2658773987' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:41:26.342 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:41:26.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:26 smithi060 ceph-mon[31721]: pgmap v415: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:26.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:26 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2658773987' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:41:26.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:26 smithi160 ceph-mon[32531]: pgmap v415: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-05-03T22:41:26.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:26 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2658773987' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:41:26.817 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:41:28.247 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:28 smithi044 ceph-mon[28604]: pgmap v416: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-03T22:41:28.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:28 smithi060 ceph-mon[31721]: pgmap v416: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-03T22:41:28.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:28 smithi160 ceph-mon[32531]: pgmap v416: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-03T22:41:29.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.152+0000 7ff0d9400700 1 -- 172.21.15.44:0/283255838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d4108850 msgr2=0x7ff0d41103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:29.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.152+0000 7ff0d9400700 1 --2- 172.21.15.44:0/283255838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d4108850 0x7ff0d41103d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00b0d0 tx=0x7ff0cc00b3e0 comp rx=0 tx=0).stop 2024-05-03T22:41:29.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.153+0000 7ff0d9400700 1 -- 172.21.15.44:0/283255838 shutdown_connections 2024-05-03T22:41:29.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.153+0000 7ff0d9400700 1 --2- 172.21.15.44:0/283255838 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d4108850 0x7ff0d41103d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:29.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.153+0000 7ff0d9400700 1 --2- 172.21.15.44:0/283255838 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d4103750 0x7ff0d4103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:29.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.153+0000 7ff0d9400700 1 --2- 172.21.15.44:0/283255838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0d4104100 0x7ff0d4108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:29.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.153+0000 7ff0d9400700 1 -- 172.21.15.44:0/283255838 >> 172.21.15.44:0/283255838 conn(0x7ff0d407a600 msgr2=0x7ff0d407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:29.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.153+0000 7ff0d9400700 1 -- 172.21.15.44:0/283255838 shutdown_connections 2024-05-03T22:41:29.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.153+0000 7ff0d9400700 1 -- 172.21.15.44:0/283255838 wait complete. 2024-05-03T22:41:29.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.154+0000 7ff0d9400700 1 Processor -- start 2024-05-03T22:41:29.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.154+0000 7ff0d9400700 1 -- start start 2024-05-03T22:41:29.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.155+0000 7ff0d9400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0d4103750 0x7ff0d40757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:29.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.155+0000 7ff0d9400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d4104100 0x7ff0d4075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:29.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.155+0000 7ff0d9400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d4108850 0x7ff0d4076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:29.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.155+0000 7ff0d9400700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d41137d0 con 0x7ff0d4104100 2024-05-03T22:41:29.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.155+0000 7ff0d9400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d4113650 con 0x7ff0d4103750 2024-05-03T22:41:29.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.155+0000 7ff0d9400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d4113950 con 0x7ff0d4108850 2024-05-03T22:41:29.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.155+0000 7ff0d1e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d4104100 0x7ff0d4075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:29.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.155+0000 7ff0d1e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d4104100 0x7ff0d4075ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:40296/0 (socket says 172.21.15.44:40296) 2024-05-03T22:41:29.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.155+0000 7ff0d1e00700 1 -- 172.21.15.44:0/2104552905 learned_addr learned my addr 172.21.15.44:0/2104552905 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:41:29.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.155+0000 7ff0d2800700 1 --2- 172.21.15.44:0/2104552905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0d4103750 0x7ff0d40757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:29.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.155+0000 7ff0d3200700 1 --2- 172.21.15.44:0/2104552905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d4108850 0x7ff0d4076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:29.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.156+0000 7ff0d1e00700 1 -- 172.21.15.44:0/2104552905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d4108850 msgr2=0x7ff0d4076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:29.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.156+0000 7ff0d1e00700 1 --2- 172.21.15.44:0/2104552905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d4108850 0x7ff0d4076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:29.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.156+0000 7ff0d1e00700 1 -- 172.21.15.44:0/2104552905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0d4103750 msgr2=0x7ff0d40757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:29.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.156+0000 7ff0d1e00700 1 --2- 172.21.15.44:0/2104552905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0d4103750 0x7ff0d40757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:29.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.156+0000 7ff0d1e00700 1 -- 172.21.15.44:0/2104552905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d41a80b0 con 0x7ff0d4104100 2024-05-03T22:41:29.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.156+0000 7ff0d1e00700 1 --2- 172.21.15.44:0/2104552905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d4104100 0x7ff0d4075ce0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000d950 tx=0x7ff0c000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:29.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.156+0000 7ff0cb400700 1 -- 172.21.15.44:0/2104552905 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0016070 con 0x7ff0d4104100 2024-05-03T22:41:29.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.156+0000 7ff0cb400700 1 -- 172.21.15.44:0/2104552905 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7ff0c0009b40 con 0x7ff0d4104100 2024-05-03T22:41:29.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.156+0000 7ff0d9400700 1 -- 172.21.15.44:0/2104552905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d41a83a0 con 0x7ff0d4104100 2024-05-03T22:41:29.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.156+0000 7ff0cb400700 1 -- 172.21.15.44:0/2104552905 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c000f620 con 0x7ff0d4104100 2024-05-03T22:41:29.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.157+0000 7ff0d9400700 1 -- 172.21.15.44:0/2104552905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d41a88e0 con 0x7ff0d4104100 2024-05-03T22:41:29.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.158+0000 7ff0d9400700 1 -- 172.21.15.44:0/2104552905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d410ba20 con 0x7ff0d4104100 2024-05-03T22:41:29.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.161+0000 7ff0cb400700 1 -- 172.21.15.44:0/2104552905 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff0c0019070 con 0x7ff0d4104100 2024-05-03T22:41:29.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.162+0000 7ff0cb400700 1 --2- 172.21.15.44:0/2104552905 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff0b80b2880 0x7ff0b80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:29.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.163+0000 7ff0cb400700 1 -- 172.21.15.44:0/2104552905 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7ff0c00e2550 con 0x7ff0d4104100 2024-05-03T22:41:29.164 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.163+0000 7ff0d2800700 1 --2- 172.21.15.44:0/2104552905 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff0b80b2880 0x7ff0b80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:29.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.164+0000 7ff0d2800700 1 --2- 172.21.15.44:0/2104552905 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff0b80b2880 0x7ff0b80b4d40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4005950 tx=0x7ff0c40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:29.165 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.164+0000 7ff0cb400700 1 -- 172.21.15.44:0/2104552905 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff0c00a9eb0 con 0x7ff0d4104100 2024-05-03T22:41:29.404 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.403+0000 7ff0d9400700 1 -- 172.21.15.44:0/2104552905 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0d410b400 con 0x7ff0d4104100 2024-05-03T22:41:29.407 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.406+0000 7ff0cb400700 1 -- 172.21.15.44:0/2104552905 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24538 (secure 0 0 0) 0x7ff0c00a97b0 con 0x7ff0d4104100 2024-05-03T22:41:29.408 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:41:29.408 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":87,"fsid":"5b0efdca-099c-11ef-bc97-c7b262605968","created":"2024-05-03T22:28:49.471963+0000","modified":"2024-05-03T22:41:10.758634+0000","last_up_change":"2024-05-03T22:38:41.446244+0000","last_in_change":"2024-05-03T22:38:16.952689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:33:24.956832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:40:05.501996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:40:09.732161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:40:23.052845+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05869397-bdc9-4c38-b1c6-deb466454dd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6803","nonce":4219032560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6805","nonce":4219032560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6809","nonce":4219032560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6807","nonce":4219032560}]},"public_addr":"172.21.15.44:6803/4219032560","cluster_addr":"172.21.15.44:6805/4219032560","heartbeat_back_addr":"172.21.15.44:6809/4219032560","heartbeat_front_addr":"172.21.15.44:6807/4219032560","state":["exists","up"]},{"osd":1,"uuid":"ff61ca27-e36b-41c9-898f-1cd7af1d9db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6801","nonce":563003638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6803","nonce":563003638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6807","nonce":563003638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6805","nonce":563003638}]},"public_addr":"172.21.15.60:6801/563003638","cluster_addr":"172.21.15.60:6803/563003638","heartbeat_back_addr":"172.21.15.60:6807/563003638","heartbeat_front_addr":"172.21.15.60:6805/563003638","state":["exists","up"]},{"osd":2,"uuid":"e58f96dc-3486-452e-85a1-847a0e2c523a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6801","nonce":2524540447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6803","nonce":2524540447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6807","nonce":2524540447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6805","nonce":2524540447}]},"public_addr":"172.21.15.160:6801/2524540447","cluster_addr":"172.21.15.160:6803/2524540447","heartbeat_back_addr":"172.21.15.160:6807/2524540447","heartbeat_front_addr":"172.21.15.160:6805/2524540447","state":["exists","up"]},{"osd":3,"uuid":"75c56c3b-5807-4646-885c-1ef16541ff72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6811","nonce":3298926279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6813","nonce":3298926279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6817","nonce":3298926279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6815","nonce":3298926279}]},"public_addr":"172.21.15.44:6811/3298926279","cluster_addr":"172.21.15.44:6813/3298926279","heartbeat_back_addr":"172.21.15.44:6817/3298926279","heartbeat_front_addr":"172.21.15.44:6815/3298926279","state":["exists","up"]},{"osd":4,"uuid":"a8a322e4-6ca1-4727-8b41-5ff523acc591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6809","nonce":3794821539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6811","nonce":3794821539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6815","nonce":3794821539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6813","nonce":3794821539}]},"public_addr":"172.21.15.60:6809/3794821539","cluster_addr":"172.21.15.60:6811/3794821539","heartbeat_back_addr":"172.21.15.60:6815/3794821539","heartbeat_front_addr":"172.21.15.60:6813/3794821539","state":["exists","up"]},{"osd":5,"uuid":"bc718527-bacd-4d1b-90c6-758cbd859e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6809","nonce":429142335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6811","nonce":429142335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6815","nonce":429142335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6813","nonce":429142335}]},"public_addr":"172.21.15.160:6809/429142335","cluster_addr":"172.21.15.160:6811/429142335","heartbeat_back_addr":"172.21.15.160:6815/429142335","heartbeat_front_addr":"172.21.15.160:6813/429142335","state":["exists","up"]},{"osd":6,"uuid":"f95a1d05-a958-4e5c-a90a-6b0c3d9fad43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6819","nonce":2805326764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6821","nonce":2805326764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6825","nonce":2805326764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6823","nonce":2805326764}]},"public_addr":"172.21.15.44:6819/2805326764","cluster_addr":"172.21.15.44:6821/2805326764","heartbeat_back_addr":"172.21.15.44:6825/2805326764","heartbeat_front_addr":"172.21.15.44:6823/2805326764","state":["exists","up"]},{"osd":7,"uuid":"a515e4be-c607-4f4a-96bb-c3d395d7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6817","nonce":693512829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6819","nonce":693512829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6823","nonce":693512829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6821","nonce":693512829}]},"public_addr":"172.21.15.60:6817/693512829","cluster_addr":"172.21.15.60:6819/693512829","heartbeat_back_addr":"172.21.15.60:6823/693512829","heartbeat_front_addr":"172.21.15.60:6821/693512829","state":["exists","up"]},{"osd":8,"uuid":"717aeffb-6c51-4e4e-8344-fba70ac2c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6817","nonce":2920554498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6819","nonce":2920554498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6823","nonce":2920554498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6821","nonce":2920554498}]},"public_addr":"172.21.15.160:6817/2920554498","cluster_addr":"172.21.15.160:6819/2920554498","heartbeat_back_addr":"172.21.15.160:6823/2920554498","heartbeat_front_addr":"172.21.15.160:6821/2920554498","state":["exists","up"]},{"osd":9,"uuid":"ade31284-1246-42c8-9cee-e60dacc58a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6827","nonce":414763386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6829","nonce":414763386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6833","nonce":414763386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6831","nonce":414763386}]},"public_addr":"172.21.15.44:6827/414763386","cluster_addr":"172.21.15.44:6829/414763386","heartbeat_back_addr":"172.21.15.44:6833/414763386","heartbeat_front_addr":"172.21.15.44:6831/414763386","state":["exists","up"]},{"osd":10,"uuid":"e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6825","nonce":2396062554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6827","nonce":2396062554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6831","nonce":2396062554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6829","nonce":2396062554}]},"public_addr":"172.21.15.60:6825/2396062554","cluster_addr":"172.21.15.60:6827/2396062554","heartbeat_back_addr":"172.21.15.60:6831/2396062554","heartbeat_front_addr":"172.21.15.60:6829/2396062554","state":["exists","up"]},{"osd":11,"uuid":"b6951585-9337-4b5a-a691-e765deb4b825","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6825","nonce":1397967755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6827","nonce":1397967755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6831","nonce":1397967755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6829","nonce":1397967755}]},"public_addr":"172.21.15.160:6825/1397967755","cluster_addr":"172.21.15.160:6827/1397967755","heartbeat_back_addr":"172.21.15.160:6831/1397967755","heartbeat_front_addr":"172.21.15.160:6829/1397967755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:15.012060+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:48.390669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:21.227227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:56.388453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:34:31.079377+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:04.912058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:40.941904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:16.757849+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:51.591794+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:37:29.022917+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:05.506391+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:39.793901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2661810503":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3426728285":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/4246410673":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2328074241":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/1738155460":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3461866265":"2024-05-04T22:30:08.766919+0000","172.21.15.44:6800/950841500":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/950841500":"2024-05-04T22:29:32.846592+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:41:29.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.409+0000 7ff0d9400700 1 -- 172.21.15.44:0/2104552905 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff0b80b2880 msgr2=0x7ff0b80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:29.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.409+0000 7ff0d9400700 1 --2- 172.21.15.44:0/2104552905 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff0b80b2880 0x7ff0b80b4d40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4005950 tx=0x7ff0c40058e0 comp rx=0 tx=0).stop 2024-05-03T22:41:29.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.409+0000 7ff0d9400700 1 -- 172.21.15.44:0/2104552905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d4104100 msgr2=0x7ff0d4075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:29.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.409+0000 7ff0d9400700 1 --2- 172.21.15.44:0/2104552905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d4104100 0x7ff0d4075ce0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000d950 tx=0x7ff0c000dd10 comp rx=0 tx=0).stop 2024-05-03T22:41:29.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.410+0000 7ff0d9400700 1 -- 172.21.15.44:0/2104552905 shutdown_connections 2024-05-03T22:41:29.411 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.410+0000 7ff0d9400700 1 --2- 172.21.15.44:0/2104552905 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff0b80b2880 0x7ff0b80b4d40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:29.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.410+0000 7ff0d9400700 1 --2- 172.21.15.44:0/2104552905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d4108850 0x7ff0d4076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:29.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.410+0000 7ff0d9400700 1 --2- 172.21.15.44:0/2104552905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0d4103750 0x7ff0d40757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:29.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.410+0000 7ff0d9400700 1 --2- 172.21.15.44:0/2104552905 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff0d4104100 0x7ff0d4075ce0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:29.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.410+0000 7ff0d9400700 1 -- 172.21.15.44:0/2104552905 >> 172.21.15.44:0/2104552905 conn(0x7ff0d407a600 msgr2=0x7ff0d4101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:29.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.410+0000 7ff0d9400700 1 -- 172.21.15.44:0/2104552905 shutdown_connections 2024-05-03T22:41:29.412 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:29.410+0000 7ff0d9400700 1 -- 172.21.15.44:0/2104552905 wait complete. 2024-05-03T22:41:30.095 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:30 smithi044 ceph-mon[28604]: pgmap v417: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-03T22:41:30.095 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:30 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2104552905' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:41:30.288 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-05-03T22:41:30.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:30 smithi060 ceph-mon[31721]: pgmap v417: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-03T22:41:30.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:30 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2104552905' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:41:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:30 smithi160 ceph-mon[32531]: pgmap v417: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-03T22:41:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:30 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2104552905' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:41:30.743 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:41:32.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:32 smithi044 ceph-mon[28604]: pgmap v418: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:32.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:32 smithi060 ceph-mon[31721]: pgmap v418: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:32.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:32 smithi160 ceph-mon[32531]: pgmap v418: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:33.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.047+0000 7ff959400700 1 -- 172.21.15.44:0/175214944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff954106080 msgr2=0x7ff954112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:33.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.047+0000 7ff959400700 1 --2- 172.21.15.44:0/175214944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff954106080 0x7ff954112590 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff94c00b0a0 tx=0x7ff94c00b3b0 comp rx=0 tx=0).stop 2024-05-03T22:41:33.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.047+0000 7ff959400700 1 -- 172.21.15.44:0/175214944 shutdown_connections 2024-05-03T22:41:33.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.047+0000 7ff959400700 1 --2- 172.21.15.44:0/175214944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff954106080 0x7ff954112590 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:33.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.047+0000 7ff959400700 1 --2- 172.21.15.44:0/175214944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff95410b6c0 0x7ff95410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:33.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.047+0000 7ff959400700 1 --2- 172.21.15.44:0/175214944 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9541056c0 0x7ff954105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:33.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.047+0000 7ff959400700 1 -- 172.21.15.44:0/175214944 >> 172.21.15.44:0/175214944 conn(0x7ff9541011b0 msgr2=0x7ff9541035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:33.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.047+0000 7ff959400700 1 -- 172.21.15.44:0/175214944 shutdown_connections 2024-05-03T22:41:33.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.047+0000 7ff959400700 1 -- 172.21.15.44:0/175214944 wait complete. 2024-05-03T22:41:33.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.048+0000 7ff959400700 1 Processor -- start 2024-05-03T22:41:33.051 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.049+0000 7ff959400700 1 -- start start 2024-05-03T22:41:33.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.049+0000 7ff959400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9541056c0 0x7ff95419be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:33.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.049+0000 7ff959400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff954106080 0x7ff95419c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:33.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.049+0000 7ff959400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff95410b6c0 0x7ff9541a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:33.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.049+0000 7ff959400700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff954115a30 con 0x7ff95410b6c0 2024-05-03T22:41:33.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.049+0000 7ff959400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff9541158b0 con 0x7ff954106080 2024-05-03T22:41:33.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.049+0000 7ff959400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff954115bb0 con 0x7ff9541056c0 2024-05-03T22:41:33.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.049+0000 7ff953200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff95410b6c0 0x7ff9541a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:33.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.049+0000 7ff953200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff95410b6c0 0x7ff9541a0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53834/0 (socket says 172.21.15.44:53834) 2024-05-03T22:41:33.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.049+0000 7ff953200700 1 -- 172.21.15.44:0/3657796151 learned_addr learned my addr 172.21.15.44:0/3657796151 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:41:33.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.050+0000 7ff952800700 1 --2- 172.21.15.44:0/3657796151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9541056c0 0x7ff95419be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:33.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.050+0000 7ff951e00700 1 --2- 172.21.15.44:0/3657796151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff954106080 0x7ff95419c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:33.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.050+0000 7ff953200700 1 -- 172.21.15.44:0/3657796151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9541056c0 msgr2=0x7ff95419be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:33.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.050+0000 7ff953200700 1 --2- 172.21.15.44:0/3657796151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9541056c0 0x7ff95419be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:33.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.050+0000 7ff953200700 1 -- 172.21.15.44:0/3657796151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff954106080 msgr2=0x7ff95419c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:33.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.050+0000 7ff953200700 1 --2- 172.21.15.44:0/3657796151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff954106080 0x7ff95419c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:33.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.050+0000 7ff953200700 1 -- 172.21.15.44:0/3657796151 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9541a0e70 con 0x7ff95410b6c0 2024-05-03T22:41:33.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.050+0000 7ff951e00700 1 --2- 172.21.15.44:0/3657796151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff954106080 0x7ff95419c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:41:33.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.050+0000 7ff952800700 1 --2- 172.21.15.44:0/3657796151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9541056c0 0x7ff95419be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:41:33.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.050+0000 7ff953200700 1 --2- 172.21.15.44:0/3657796151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff95410b6c0 0x7ff9541a0730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff94c0079a0 tx=0x7ff94c007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:33.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.051+0000 7ff94b400700 1 -- 172.21.15.44:0/3657796151 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94c021070 con 0x7ff95410b6c0 2024-05-03T22:41:33.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.051+0000 7ff94b400700 1 -- 172.21.15.44:0/3657796151 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7ff94c01db20 con 0x7ff95410b6c0 2024-05-03T22:41:33.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.051+0000 7ff959400700 1 -- 172.21.15.44:0/3657796151 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9541a1100 con 0x7ff95410b6c0 2024-05-03T22:41:33.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.051+0000 7ff94b400700 1 -- 172.21.15.44:0/3657796151 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff94c01bd90 con 0x7ff95410b6c0 2024-05-03T22:41:33.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.051+0000 7ff959400700 1 -- 172.21.15.44:0/3657796151 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9541a89e0 con 0x7ff95410b6c0 2024-05-03T22:41:33.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.052+0000 7ff959400700 1 -- 172.21.15.44:0/3657796151 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff95406a190 con 0x7ff95410b6c0 2024-05-03T22:41:33.056 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.054+0000 7ff94b400700 1 -- 172.21.15.44:0/3657796151 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff94c024070 con 0x7ff95410b6c0 2024-05-03T22:41:33.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.056+0000 7ff94b400700 1 --2- 172.21.15.44:0/3657796151 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff9380b2880 0x7ff9380b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:33.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.056+0000 7ff94b400700 1 -- 172.21.15.44:0/3657796151 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7ff94c00f020 con 0x7ff95410b6c0 2024-05-03T22:41:33.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.056+0000 7ff952800700 1 --2- 172.21.15.44:0/3657796151 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff9380b2880 0x7ff9380b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:33.058 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.057+0000 7ff952800700 1 --2- 172.21.15.44:0/3657796151 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff9380b2880 0x7ff9380b4d40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff944005e10 tx=0x7ff944005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:33.062 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.061+0000 7ff94b400700 1 -- 172.21.15.44:0/3657796151 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff94c02b020 con 0x7ff95410b6c0 2024-05-03T22:41:33.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:33.359+0000 7ff959400700 1 -- 172.21.15.44:0/3657796151 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff95402e510 con 0x7ff95410b6c0 2024-05-03T22:41:34.107 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:34.105+0000 7ff94b400700 1 -- 172.21.15.44:0/3657796151 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7ff94c0ab5c0 con 0x7ff95410b6c0 2024-05-03T22:41:34.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:34.110+0000 7ff959400700 1 -- 172.21.15.44:0/3657796151 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff9380b2880 msgr2=0x7ff9380b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:34.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:34.110+0000 7ff959400700 1 --2- 172.21.15.44:0/3657796151 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff9380b2880 0x7ff9380b4d40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff944005e10 tx=0x7ff944005d60 comp rx=0 tx=0).stop 2024-05-03T22:41:34.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:34.110+0000 7ff959400700 1 -- 172.21.15.44:0/3657796151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff95410b6c0 msgr2=0x7ff9541a0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:34.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:34.110+0000 7ff959400700 1 --2- 172.21.15.44:0/3657796151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff95410b6c0 0x7ff9541a0730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff94c0079a0 tx=0x7ff94c007a80 comp rx=0 tx=0).stop 2024-05-03T22:41:34.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:34.110+0000 7ff959400700 1 -- 172.21.15.44:0/3657796151 shutdown_connections 2024-05-03T22:41:34.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:34.110+0000 7ff959400700 1 --2- 172.21.15.44:0/3657796151 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff95410b6c0 0x7ff9541a0730 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:34.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:34.110+0000 7ff959400700 1 --2- 172.21.15.44:0/3657796151 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff9380b2880 0x7ff9380b4d40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:34.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:34.110+0000 7ff959400700 1 --2- 172.21.15.44:0/3657796151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9541056c0 0x7ff95419be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:34.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:34.110+0000 7ff959400700 1 --2- 172.21.15.44:0/3657796151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff954106080 0x7ff95419c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:34.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:34.111+0000 7ff959400700 1 -- 172.21.15.44:0/3657796151 >> 172.21.15.44:0/3657796151 conn(0x7ff9541011b0 msgr2=0x7ff9541016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:34.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:34.111+0000 7ff959400700 1 -- 172.21.15.44:0/3657796151 shutdown_connections 2024-05-03T22:41:34.113 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:34.111+0000 7ff959400700 1 -- 172.21.15.44:0/3657796151 wait complete. 2024-05-03T22:41:34.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:34 smithi044 ceph-mon[28604]: pgmap v419: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:34.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:34 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3657796151' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-03T22:41:34.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:34 smithi060 ceph-mon[31721]: pgmap v419: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:34.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:34 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3657796151' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-03T22:41:34.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:34 smithi160 ceph-mon[32531]: pgmap v419: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:34.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:34 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3657796151' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-03T22:41:34.984 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-05-03T22:41:34.984 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-05-03T22:41:35.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:35 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3657796151' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-03T22:41:35.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:35 smithi044 ceph-mon[28604]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:41:35.447 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:41:35.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:35 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3657796151' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-03T22:41:35.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:35 smithi060 ceph-mon[31721]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:41:35.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:35 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3657796151' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-03T22:41:35.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:35 smithi160 ceph-mon[32531]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:41:36.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:36 smithi044 ceph-mon[28604]: pgmap v420: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:36.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:36 smithi060 ceph-mon[31721]: pgmap v420: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:36.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:36 smithi160 ceph-mon[32531]: pgmap v420: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:37.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.749+0000 7f7532200700 1 -- 172.21.15.44:0/2537658339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752c104380 msgr2=0x7f752c06ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:37.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.749+0000 7f7532200700 1 --2- 172.21.15.44:0/2537658339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752c104380 0x7f752c06ba10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7520009990 tx=0x7f7520009ca0 comp rx=0 tx=0).stop 2024-05-03T22:41:37.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.749+0000 7f7532200700 1 -- 172.21.15.44:0/2537658339 shutdown_connections 2024-05-03T22:41:37.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.749+0000 7f7532200700 1 --2- 172.21.15.44:0/2537658339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f752c10fc60 0x7f752c112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:37.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.749+0000 7f7532200700 1 --2- 172.21.15.44:0/2537658339 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752c104380 0x7f752c06ba10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:37.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.749+0000 7f7532200700 1 --2- 172.21.15.44:0/2537658339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f752c06bf50 0x7f752c06c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:37.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.749+0000 7f7532200700 1 -- 172.21.15.44:0/2537658339 >> 172.21.15.44:0/2537658339 conn(0x7f752c0791e0 msgr2=0x7f752c0795f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:37.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.749+0000 7f7532200700 1 -- 172.21.15.44:0/2537658339 shutdown_connections 2024-05-03T22:41:37.752 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.749+0000 7f7532200700 1 -- 172.21.15.44:0/2537658339 wait complete. 2024-05-03T22:41:37.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.751+0000 7f7532200700 1 Processor -- start 2024-05-03T22:41:37.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.751+0000 7f7532200700 1 -- start start 2024-05-03T22:41:37.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.751+0000 7f7532200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f752c06bf50 0x7f752c1a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:37.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.751+0000 7f7532200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f752c10fc60 0x7f752c1a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:37.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.751+0000 7f7532200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752c19ba90 0x7f752c19bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:37.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.751+0000 7f7532200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f752c1158d0 con 0x7f752c19ba90 2024-05-03T22:41:37.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.751+0000 7f7532200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f752c115750 con 0x7f752c06bf50 2024-05-03T22:41:37.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.751+0000 7f7532200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f752c115a50 con 0x7f752c10fc60 2024-05-03T22:41:37.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.752+0000 7f7531800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752c19ba90 0x7f752c19bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:37.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.752+0000 7f7531800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752c19ba90 0x7f752c19bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:53852/0 (socket says 172.21.15.44:53852) 2024-05-03T22:41:37.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.752+0000 7f7531800700 1 -- 172.21.15.44:0/3227337439 learned_addr learned my addr 172.21.15.44:0/3227337439 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:41:37.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.752+0000 7f7530e00700 1 --2- 172.21.15.44:0/3227337439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f752c06bf50 0x7f752c1a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:37.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.752+0000 7f752be00700 1 --2- 172.21.15.44:0/3227337439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f752c10fc60 0x7f752c1a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:37.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.752+0000 7f7531800700 1 -- 172.21.15.44:0/3227337439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f752c10fc60 msgr2=0x7f752c1a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:37.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.752+0000 7f7531800700 1 --2- 172.21.15.44:0/3227337439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f752c10fc60 0x7f752c1a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:37.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.752+0000 7f7531800700 1 -- 172.21.15.44:0/3227337439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f752c06bf50 msgr2=0x7f752c1a18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:37.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.752+0000 7f7531800700 1 --2- 172.21.15.44:0/3227337439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f752c06bf50 0x7f752c1a18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:37.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.752+0000 7f7531800700 1 -- 172.21.15.44:0/3227337439 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f752c19c610 con 0x7f752c19ba90 2024-05-03T22:41:37.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.752+0000 7f7530e00700 1 --2- 172.21.15.44:0/3227337439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f752c06bf50 0x7f752c1a18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:41:37.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.753+0000 7f7531800700 1 --2- 172.21.15.44:0/3227337439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752c19ba90 0x7f752c19bf10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7524007ee0 tx=0x7f752400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:37.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.753+0000 7f7529600700 1 -- 172.21.15.44:0/3227337439 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752400ddd0 con 0x7f752c19ba90 2024-05-03T22:41:37.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.753+0000 7f7532200700 1 -- 172.21.15.44:0/3227337439 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f752c1a87a0 con 0x7f752c19ba90 2024-05-03T22:41:37.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.753+0000 7f7529600700 1 -- 172.21.15.44:0/3227337439 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f7524009e20 con 0x7f752c19ba90 2024-05-03T22:41:37.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.753+0000 7f7529600700 1 -- 172.21.15.44:0/3227337439 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524015400 con 0x7f752c19ba90 2024-05-03T22:41:37.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.753+0000 7f7532200700 1 -- 172.21.15.44:0/3227337439 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f752c1a8b40 con 0x7f752c19ba90 2024-05-03T22:41:37.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.755+0000 7f7532200700 1 -- 172.21.15.44:0/3227337439 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f752c06a190 con 0x7f752c19ba90 2024-05-03T22:41:37.758 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.757+0000 7f7529600700 1 -- 172.21.15.44:0/3227337439 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7524004ad0 con 0x7f752c19ba90 2024-05-03T22:41:37.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.759+0000 7f7529600700 1 --2- 172.21.15.44:0/3227337439 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f75140b2900 0x7f75140b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:37.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.759+0000 7f7529600700 1 -- 172.21.15.44:0/3227337439 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f75240e1fb0 con 0x7f752c19ba90 2024-05-03T22:41:37.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.759+0000 7f7530e00700 1 --2- 172.21.15.44:0/3227337439 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f75140b2900 0x7f75140b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:37.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.760+0000 7f7530e00700 1 --2- 172.21.15.44:0/3227337439 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f75140b2900 0x7f75140b4dc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7520006010 tx=0x7f752000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:37.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:37.763+0000 7f7529600700 1 -- 172.21.15.44:0/3227337439 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f7524010070 con 0x7f752c19ba90 2024-05-03T22:41:38.055 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:38.054+0000 7f7532200700 1 -- 172.21.15.44:0/3227337439 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f752c104380 con 0x7f752c19ba90 2024-05-03T22:41:38.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:38.137+0000 7f7529600700 1 -- 172.21.15.44:0/3227337439 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f75240a9910 con 0x7f752c19ba90 2024-05-03T22:41:38.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:38.141+0000 7f7532200700 1 -- 172.21.15.44:0/3227337439 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f75140b2900 msgr2=0x7f75140b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:38.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:38.141+0000 7f7532200700 1 --2- 172.21.15.44:0/3227337439 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f75140b2900 0x7f75140b4dc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7520006010 tx=0x7f752000b540 comp rx=0 tx=0).stop 2024-05-03T22:41:38.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:38.141+0000 7f7532200700 1 -- 172.21.15.44:0/3227337439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752c19ba90 msgr2=0x7f752c19bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:38.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:38.141+0000 7f7532200700 1 --2- 172.21.15.44:0/3227337439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752c19ba90 0x7f752c19bf10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7524007ee0 tx=0x7f752400d3b0 comp rx=0 tx=0).stop 2024-05-03T22:41:38.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:38.141+0000 7f7532200700 1 -- 172.21.15.44:0/3227337439 shutdown_connections 2024-05-03T22:41:38.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:38.141+0000 7f7532200700 1 --2- 172.21.15.44:0/3227337439 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f752c19ba90 0x7f752c19bf10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:38.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:38.141+0000 7f7532200700 1 --2- 172.21.15.44:0/3227337439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f752c06bf50 0x7f752c1a18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:38.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:38.141+0000 7f7532200700 1 --2- 172.21.15.44:0/3227337439 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f75140b2900 0x7f75140b4dc0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:38.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:38.141+0000 7f7532200700 1 --2- 172.21.15.44:0/3227337439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f752c10fc60 0x7f752c1a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:38.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:38.141+0000 7f7532200700 1 -- 172.21.15.44:0/3227337439 >> 172.21.15.44:0/3227337439 conn(0x7f752c0791e0 msgr2=0x7f752c101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:38.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:38.142+0000 7f7532200700 1 -- 172.21.15.44:0/3227337439 shutdown_connections 2024-05-03T22:41:38.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:38.142+0000 7f7532200700 1 -- 172.21.15.44:0/3227337439 wait complete. 2024-05-03T22:41:38.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:38 smithi044 ceph-mon[28604]: pgmap v421: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:38.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:38 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3227337439' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-03T22:41:38.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:38 smithi060 ceph-mon[31721]: pgmap v421: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:38.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:38 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3227337439' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-03T22:41:38.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:38 smithi160 ceph-mon[32531]: pgmap v421: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T22:41:38.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:38 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3227337439' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-03T22:41:39.035 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-05-03T22:41:39.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:39 smithi044 ceph-mon[28604]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-03T22:41:39.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:39 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3227337439' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-03T22:41:39.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:39 smithi044 ceph-mon[28604]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-03T22:41:39.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:39 smithi044 ceph-mon[28604]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:41:39.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:39 smithi044 ceph-mon[28604]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-03T22:41:39.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:39 smithi044 ceph-mon[28604]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-03T22:41:39.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:39 smithi060 ceph-mon[31721]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-03T22:41:39.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:39 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3227337439' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-03T22:41:39.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:39 smithi060 ceph-mon[31721]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-03T22:41:39.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:39 smithi060 ceph-mon[31721]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:41:39.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:39 smithi060 ceph-mon[31721]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-03T22:41:39.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:39 smithi060 ceph-mon[31721]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-03T22:41:39.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:39 smithi160 ceph-mon[32531]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-03T22:41:39.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:39 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3227337439' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-03T22:41:39.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:39 smithi160 ceph-mon[32531]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-03T22:41:39.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:39 smithi160 ceph-mon[32531]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-03T22:41:39.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:39 smithi160 ceph-mon[32531]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-03T22:41:39.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:39 smithi160 ceph-mon[32531]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-03T22:41:39.517 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:41:40.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:40 smithi044 ceph-mon[28604]: pgmap v422: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-05-03T22:41:40.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:40 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] up:active 2024-05-03T22:41:40.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:40 smithi044 ceph-mon[28604]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-03T22:41:40.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:40 smithi044 ceph-mon[28604]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-03T22:41:40.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:40 smithi044 ceph-mon[28604]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-05-03T22:41:40.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:40 smithi044 ceph-mon[28604]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-05-03T22:41:40.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:40 smithi060 ceph-mon[31721]: pgmap v422: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-05-03T22:41:40.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:40 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] up:active 2024-05-03T22:41:40.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:40 smithi060 ceph-mon[31721]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-03T22:41:40.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:40 smithi060 ceph-mon[31721]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-03T22:41:40.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:40 smithi060 ceph-mon[31721]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-05-03T22:41:40.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:40 smithi060 ceph-mon[31721]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-05-03T22:41:40.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:40 smithi160 ceph-mon[32531]: pgmap v422: 129 pgs: 129 active+clean; 581 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-05-03T22:41:40.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:40 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] up:active 2024-05-03T22:41:40.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:40 smithi160 ceph-mon[32531]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-03T22:41:40.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:40 smithi160 ceph-mon[32531]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-03T22:41:40.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:40 smithi160 ceph-mon[32531]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-05-03T22:41:40.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:40 smithi160 ceph-mon[32531]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-05-03T22:41:41.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:41 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] up:active 2024-05-03T22:41:41.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:41 smithi044 ceph-mon[28604]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-03T22:41:41.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:41 smithi044 ceph-mon[28604]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-05-03T22:41:41.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:41 smithi044 ceph-mon[28604]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:creating} 8 up:standby 2024-05-03T22:41:41.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:41 smithi044 ceph-mon[28604]: daemon mds.k is now active in filesystem cephfs as rank 3 2024-05-03T22:41:41.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:41 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] up:active 2024-05-03T22:41:41.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:41 smithi060 ceph-mon[31721]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-03T22:41:41.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:41 smithi060 ceph-mon[31721]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-05-03T22:41:41.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:41 smithi060 ceph-mon[31721]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:creating} 8 up:standby 2024-05-03T22:41:41.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:41 smithi060 ceph-mon[31721]: daemon mds.k is now active in filesystem cephfs as rank 3 2024-05-03T22:41:41.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:41 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] up:active 2024-05-03T22:41:41.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:41 smithi160 ceph-mon[32531]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-03T22:41:41.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:41 smithi160 ceph-mon[32531]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-05-03T22:41:41.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:41 smithi160 ceph-mon[32531]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:creating} 8 up:standby 2024-05-03T22:41:41.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:41 smithi160 ceph-mon[32531]: daemon mds.k is now active in filesystem cephfs as rank 3 2024-05-03T22:41:41.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.952+0000 7fec21a00700 1 -- 172.21.15.44:0/3335239233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec1c10a3a0 msgr2=0x7fec1c116840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:41.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.952+0000 7fec21a00700 1 --2- 172.21.15.44:0/3335239233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec1c10a3a0 0x7fec1c116840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fec14009990 tx=0x7fec14009ca0 comp rx=0 tx=0).stop 2024-05-03T22:41:41.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.952+0000 7fec21a00700 1 -- 172.21.15.44:0/3335239233 shutdown_connections 2024-05-03T22:41:41.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.952+0000 7fec21a00700 1 --2- 172.21.15.44:0/3335239233 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec1c10a3a0 0x7fec1c116840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:41.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.952+0000 7fec21a00700 1 --2- 172.21.15.44:0/3335239233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec1c10e8b0 0x7fec1c10ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:41.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.952+0000 7fec21a00700 1 --2- 172.21.15.44:0/3335239233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec1c1099e0 0x7fec1c109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:41.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.952+0000 7fec21a00700 1 -- 172.21.15.44:0/3335239233 >> 172.21.15.44:0/3335239233 conn(0x7fec1c079230 msgr2=0x7fec1c1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:41.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.952+0000 7fec21a00700 1 -- 172.21.15.44:0/3335239233 shutdown_connections 2024-05-03T22:41:41.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.952+0000 7fec21a00700 1 -- 172.21.15.44:0/3335239233 wait complete. 2024-05-03T22:41:41.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.953+0000 7fec21a00700 1 Processor -- start 2024-05-03T22:41:41.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.954+0000 7fec21a00700 1 -- start start 2024-05-03T22:41:41.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.954+0000 7fec21a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec1c1099e0 0x7fec1c1a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:41.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.954+0000 7fec21a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec1c10a3a0 0x7fec1c1a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:41.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.954+0000 7fec21a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec1c10e8b0 0x7fec1c1a4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:41.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.954+0000 7fec21a00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c119cb0 con 0x7fec1c10a3a0 2024-05-03T22:41:41.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.954+0000 7fec21a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c119b30 con 0x7fec1c10e8b0 2024-05-03T22:41:41.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.954+0000 7fec21a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fec1c119e30 con 0x7fec1c1099e0 2024-05-03T22:41:41.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.954+0000 7fec13400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec1c10a3a0 0x7fec1c1a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:41.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.954+0000 7fec13400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec1c10a3a0 0x7fec1c1a05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37522/0 (socket says 172.21.15.44:37522) 2024-05-03T22:41:41.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.954+0000 7fec13400700 1 -- 172.21.15.44:0/485458462 learned_addr learned my addr 172.21.15.44:0/485458462 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:41:41.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.955+0000 7fec1be00700 1 --2- 172.21.15.44:0/485458462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec1c1099e0 0x7fec1c1a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:41.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.955+0000 7fec21000700 1 --2- 172.21.15.44:0/485458462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec1c10e8b0 0x7fec1c1a4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:41.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.955+0000 7fec13400700 1 -- 172.21.15.44:0/485458462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec1c1099e0 msgr2=0x7fec1c1a00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:41.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.955+0000 7fec13400700 1 --2- 172.21.15.44:0/485458462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec1c1099e0 0x7fec1c1a00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:41.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.955+0000 7fec13400700 1 -- 172.21.15.44:0/485458462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec1c10e8b0 msgr2=0x7fec1c1a4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:41.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.955+0000 7fec13400700 1 --2- 172.21.15.44:0/485458462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec1c10e8b0 0x7fec1c1a4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:41.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.955+0000 7fec13400700 1 -- 172.21.15.44:0/485458462 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec1c1a50b0 con 0x7fec1c10a3a0 2024-05-03T22:41:41.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.955+0000 7fec13400700 1 --2- 172.21.15.44:0/485458462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec1c10a3a0 0x7fec1c1a05e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fec0400c920 tx=0x7fec0400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:41.958 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.956+0000 7fec19600700 1 -- 172.21.15.44:0/485458462 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec04007b00 con 0x7fec1c10a3a0 2024-05-03T22:41:41.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.956+0000 7fec19600700 1 -- 172.21.15.44:0/485458462 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fec04004d00 con 0x7fec1c10a3a0 2024-05-03T22:41:41.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.956+0000 7fec21a00700 1 -- 172.21.15.44:0/485458462 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec1c1a53a0 con 0x7fec1c10a3a0 2024-05-03T22:41:41.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.956+0000 7fec19600700 1 -- 172.21.15.44:0/485458462 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0400f450 con 0x7fec1c10a3a0 2024-05-03T22:41:41.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.956+0000 7fec21a00700 1 -- 172.21.15.44:0/485458462 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec1c1acc20 con 0x7fec1c10a3a0 2024-05-03T22:41:41.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.957+0000 7fec21a00700 1 -- 172.21.15.44:0/485458462 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec1c06a190 con 0x7fec1c10a3a0 2024-05-03T22:41:41.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.960+0000 7fec19600700 1 -- 172.21.15.44:0/485458462 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fec04004750 con 0x7fec1c10a3a0 2024-05-03T22:41:41.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.961+0000 7fec19600700 1 --2- 172.21.15.44:0/485458462 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fec000b2900 0x7fec000b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:41.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.961+0000 7fec19600700 1 -- 172.21.15.44:0/485458462 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7fec040e21a0 con 0x7fec1c10a3a0 2024-05-03T22:41:41.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.961+0000 7fec1be00700 1 --2- 172.21.15.44:0/485458462 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fec000b2900 0x7fec000b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:41.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.962+0000 7fec1be00700 1 --2- 172.21.15.44:0/485458462 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fec000b2900 0x7fec000b4dc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009c90 tx=0x7fec0c009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:41.967 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:41.966+0000 7fec19600700 1 -- 172.21.15.44:0/485458462 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fec04014030 con 0x7fec1c10a3a0 2024-05-03T22:41:42.259 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:42.257+0000 7fec21a00700 1 -- 172.21.15.44:0/485458462 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fec1c02e510 con 0x7fec1c10a3a0 2024-05-03T22:41:42.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:42 smithi044 ceph-mon[28604]: pgmap v423: 129 pgs: 129 active+clean; 583 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 4 op/s 2024-05-03T22:41:42.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:42 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] up:active 2024-05-03T22:41:42.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:42 smithi044 ceph-mon[28604]: daemon mds.i assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-03T22:41:42.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:42 smithi044 ceph-mon[28604]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-03T22:41:42.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:42 smithi044 ceph-mon[28604]: Cluster is now healthy 2024-05-03T22:41:42.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:42 smithi044 ceph-mon[28604]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:active} 8 up:standby 2024-05-03T22:41:42.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:42 smithi044 ceph-mon[28604]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-03T22:41:42.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:42 smithi044 ceph-mon[28604]: daemon mds.i is now active in filesystem cephfs as rank 4 2024-05-03T22:41:42.504 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 22:41:42 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-b[62484]: 2024-05-03T22:41:42.378+0000 7f3849e00700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-05-03T22:41:42.505 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 22:41:42 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-b[62484]: 2024-05-03T22:41:42.378+0000 7f3849e00700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-05-03T22:41:42.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:42 smithi060 ceph-mon[31721]: pgmap v423: 129 pgs: 129 active+clean; 583 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 4 op/s 2024-05-03T22:41:42.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:42 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] up:active 2024-05-03T22:41:42.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:42 smithi060 ceph-mon[31721]: daemon mds.i assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-03T22:41:42.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:42 smithi060 ceph-mon[31721]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-03T22:41:42.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:42 smithi060 ceph-mon[31721]: Cluster is now healthy 2024-05-03T22:41:42.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:42 smithi060 ceph-mon[31721]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:active} 8 up:standby 2024-05-03T22:41:42.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:42 smithi060 ceph-mon[31721]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-03T22:41:42.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:42 smithi060 ceph-mon[31721]: daemon mds.i is now active in filesystem cephfs as rank 4 2024-05-03T22:41:42.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:42 smithi160 ceph-mon[32531]: pgmap v423: 129 pgs: 129 active+clean; 583 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 4 op/s 2024-05-03T22:41:42.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:42 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] up:active 2024-05-03T22:41:42.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:42 smithi160 ceph-mon[32531]: daemon mds.i assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-03T22:41:42.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:42 smithi160 ceph-mon[32531]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-03T22:41:42.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:42 smithi160 ceph-mon[32531]: Cluster is now healthy 2024-05-03T22:41:42.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:42 smithi160 ceph-mon[32531]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:active} 8 up:standby 2024-05-03T22:41:42.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:42 smithi160 ceph-mon[32531]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-03T22:41:42.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:42 smithi160 ceph-mon[32531]: daemon mds.i is now active in filesystem cephfs as rank 4 2024-05-03T22:41:43.212 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:43.210+0000 7fec19600700 1 -- 172.21.15.44:0/485458462 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7fec040a9b00 con 0x7fec1c10a3a0 2024-05-03T22:41:43.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:43.214+0000 7fec21a00700 1 -- 172.21.15.44:0/485458462 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fec000b2900 msgr2=0x7fec000b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:43.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:43.214+0000 7fec21a00700 1 --2- 172.21.15.44:0/485458462 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fec000b2900 0x7fec000b4dc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009c90 tx=0x7fec0c009040 comp rx=0 tx=0).stop 2024-05-03T22:41:43.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:43.214+0000 7fec21a00700 1 -- 172.21.15.44:0/485458462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec1c10a3a0 msgr2=0x7fec1c1a05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:43.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:43.214+0000 7fec21a00700 1 --2- 172.21.15.44:0/485458462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec1c10a3a0 0x7fec1c1a05e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fec0400c920 tx=0x7fec0400cce0 comp rx=0 tx=0).stop 2024-05-03T22:41:43.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:43.215+0000 7fec21a00700 1 -- 172.21.15.44:0/485458462 shutdown_connections 2024-05-03T22:41:43.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:43.215+0000 7fec21a00700 1 --2- 172.21.15.44:0/485458462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec1c10e8b0 0x7fec1c1a4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:43.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:43.215+0000 7fec21a00700 1 --2- 172.21.15.44:0/485458462 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fec000b2900 0x7fec000b4dc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:43.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:43.215+0000 7fec21a00700 1 --2- 172.21.15.44:0/485458462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec1c1099e0 0x7fec1c1a00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:43.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:43.215+0000 7fec21a00700 1 --2- 172.21.15.44:0/485458462 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fec1c10a3a0 0x7fec1c1a05e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:43.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:43.215+0000 7fec21a00700 1 -- 172.21.15.44:0/485458462 >> 172.21.15.44:0/485458462 conn(0x7fec1c079230 msgr2=0x7fec1c079750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:43.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:43.215+0000 7fec21a00700 1 -- 172.21.15.44:0/485458462 shutdown_connections 2024-05-03T22:41:43.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:43.215+0000 7fec21a00700 1 -- 172.21.15.44:0/485458462 wait complete. 2024-05-03T22:41:43.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:43 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] up:active 2024-05-03T22:41:43.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:43 smithi044 ceph-mon[28604]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-03T22:41:43.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:43 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/485458462' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-03T22:41:43.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:43 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] up:active 2024-05-03T22:41:43.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:43 smithi060 ceph-mon[31721]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-03T22:41:43.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:43 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/485458462' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-03T22:41:43.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:43 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] up:active 2024-05-03T22:41:43.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:43 smithi160 ceph-mon[32531]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-03T22:41:43.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:43 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/485458462' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-03T22:41:44.214 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-05-03T22:41:44.295 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:44 smithi044 ceph-mon[28604]: pgmap v424: 129 pgs: 129 active+clean; 585 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2024-05-03T22:41:44.295 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:44 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/485458462' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-03T22:41:44.295 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:44 smithi044 ceph-mon[28604]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-03T22:41:44.296 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:44 smithi044 ceph-mon[28604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T22:41:44.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:44 smithi060 ceph-mon[31721]: pgmap v424: 129 pgs: 129 active+clean; 585 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2024-05-03T22:41:44.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:44 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/485458462' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-03T22:41:44.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:44 smithi060 ceph-mon[31721]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-03T22:41:44.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:44 smithi060 ceph-mon[31721]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T22:41:44.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:44 smithi160 ceph-mon[32531]: pgmap v424: 129 pgs: 129 active+clean; 585 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s 2024-05-03T22:41:44.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:44 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/485458462' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-03T22:41:44.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:44 smithi160 ceph-mon[32531]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-03T22:41:44.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:44 smithi160 ceph-mon[32531]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T22:41:44.687 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:41:46.424 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:46 smithi044 ceph-mon[28604]: pgmap v425: 129 pgs: 129 active+clean; 586 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3.9 KiB/s wr, 15 op/s 2024-05-03T22:41:46.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:46 smithi060 ceph-mon[31721]: pgmap v425: 129 pgs: 129 active+clean; 586 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3.9 KiB/s wr, 15 op/s 2024-05-03T22:41:46.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:46 smithi160 ceph-mon[32531]: pgmap v425: 129 pgs: 129 active+clean; 586 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 3.9 KiB/s wr, 15 op/s 2024-05-03T22:41:47.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.119+0000 7f3537c00700 1 -- 172.21.15.44:0/588238922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3530106080 msgr2=0x7f3530112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:47.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.119+0000 7f3537c00700 1 --2- 172.21.15.44:0/588238922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3530106080 0x7f3530112590 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f352800b0a0 tx=0x7f352800b3b0 comp rx=0 tx=0).stop 2024-05-03T22:41:47.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.119+0000 7f3537c00700 1 -- 172.21.15.44:0/588238922 shutdown_connections 2024-05-03T22:41:47.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.119+0000 7f3537c00700 1 --2- 172.21.15.44:0/588238922 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3530106080 0x7f3530112590 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:47.121 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.119+0000 7f3537c00700 1 --2- 172.21.15.44:0/588238922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f353010b6c0 0x7f353010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:47.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.119+0000 7f3537c00700 1 --2- 172.21.15.44:0/588238922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f35301056c0 0x7f3530105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:47.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.119+0000 7f3537c00700 1 -- 172.21.15.44:0/588238922 >> 172.21.15.44:0/588238922 conn(0x7f35301011b0 msgr2=0x7f35301035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:47.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.120+0000 7f3537c00700 1 -- 172.21.15.44:0/588238922 shutdown_connections 2024-05-03T22:41:47.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.120+0000 7f3537c00700 1 -- 172.21.15.44:0/588238922 wait complete. 2024-05-03T22:41:47.122 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.121+0000 7f3537c00700 1 Processor -- start 2024-05-03T22:41:47.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.121+0000 7f3537c00700 1 -- start start 2024-05-03T22:41:47.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.121+0000 7f3537c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35301056c0 0x7f353019be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:47.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.121+0000 7f3537c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3530106080 0x7f353019c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:47.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.121+0000 7f3537c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f353010b6c0 0x7f35301a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:47.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.121+0000 7f3537c00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f35301159e0 con 0x7f35301056c0 2024-05-03T22:41:47.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.121+0000 7f3537c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3530115860 con 0x7f3530106080 2024-05-03T22:41:47.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.121+0000 7f3537c00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3530115b60 con 0x7f353010b6c0 2024-05-03T22:41:47.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.122+0000 7f3535200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35301056c0 0x7f353019be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:47.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.122+0000 7f3535200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35301056c0 0x7f353019be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:37538/0 (socket says 172.21.15.44:37538) 2024-05-03T22:41:47.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.122+0000 7f3535200700 1 -- 172.21.15.44:0/1399809496 learned_addr learned my addr 172.21.15.44:0/1399809496 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:41:47.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.122+0000 7f352fe00700 1 --2- 172.21.15.44:0/1399809496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3530106080 0x7f353019c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:47.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.122+0000 7f3535c00700 1 --2- 172.21.15.44:0/1399809496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f353010b6c0 0x7f35301a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:47.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.122+0000 7f3535200700 1 -- 172.21.15.44:0/1399809496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f353010b6c0 msgr2=0x7f35301a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:47.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.122+0000 7f3535200700 1 --2- 172.21.15.44:0/1399809496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f353010b6c0 0x7f35301a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:47.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.122+0000 7f3535200700 1 -- 172.21.15.44:0/1399809496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3530106080 msgr2=0x7f353019c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:47.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.122+0000 7f3535200700 1 --2- 172.21.15.44:0/1399809496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3530106080 0x7f353019c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:47.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.122+0000 7f3535200700 1 -- 172.21.15.44:0/1399809496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35301a0e50 con 0x7f35301056c0 2024-05-03T22:41:47.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.123+0000 7f3535200700 1 --2- 172.21.15.44:0/1399809496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35301056c0 0x7f353019be90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f352400d950 tx=0x7f352400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:47.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.123+0000 7f352d600700 1 -- 172.21.15.44:0/1399809496 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3524016070 con 0x7f35301056c0 2024-05-03T22:41:47.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.123+0000 7f352d600700 1 -- 172.21.15.44:0/1399809496 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f3524009b40 con 0x7f35301056c0 2024-05-03T22:41:47.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.123+0000 7f3537c00700 1 -- 172.21.15.44:0/1399809496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35301a1140 con 0x7f35301056c0 2024-05-03T22:41:47.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.123+0000 7f352d600700 1 -- 172.21.15.44:0/1399809496 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352400f620 con 0x7f35301056c0 2024-05-03T22:41:47.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.123+0000 7f3537c00700 1 -- 172.21.15.44:0/1399809496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35301a89c0 con 0x7f35301056c0 2024-05-03T22:41:47.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.124+0000 7f3537c00700 1 -- 172.21.15.44:0/1399809496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f353006a190 con 0x7f35301056c0 2024-05-03T22:41:47.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.127+0000 7f352d600700 1 -- 172.21.15.44:0/1399809496 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f3524019070 con 0x7f35301056c0 2024-05-03T22:41:47.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.128+0000 7f352d600700 1 --2- 172.21.15.44:0/1399809496 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f35180b2880 0x7f35180b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:47.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.129+0000 7f352d600700 1 -- 172.21.15.44:0/1399809496 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f35240e2550 con 0x7f35301056c0 2024-05-03T22:41:47.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.129+0000 7f352fe00700 1 --2- 172.21.15.44:0/1399809496 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f35180b2880 0x7f35180b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:47.131 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.130+0000 7f352fe00700 1 --2- 172.21.15.44:0/1399809496 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f35180b2880 0x7f35180b4d40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f351c005950 tx=0x7f351c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:47.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.132+0000 7f352d600700 1 -- 172.21.15.44:0/1399809496 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f35240a9eb0 con 0x7f35301056c0 2024-05-03T22:41:47.427 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:47.425+0000 7f3537c00700 1 -- 172.21.15.44:0/1399809496 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f353002e510 con 0x7f35301056c0 2024-05-03T22:41:48.238 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:48.237+0000 7f352d600700 1 -- 172.21.15.44:0/1399809496 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v30) ==== 115+0+0 (secure 0 0 0) 0x7f35240a97b0 con 0x7f35301056c0 2024-05-03T22:41:48.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:48.241+0000 7f3537c00700 1 -- 172.21.15.44:0/1399809496 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f35180b2880 msgr2=0x7f35180b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:48.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:48.241+0000 7f3537c00700 1 --2- 172.21.15.44:0/1399809496 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f35180b2880 0x7f35180b4d40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f351c005950 tx=0x7f351c0058e0 comp rx=0 tx=0).stop 2024-05-03T22:41:48.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:48.241+0000 7f3537c00700 1 -- 172.21.15.44:0/1399809496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35301056c0 msgr2=0x7f353019be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:48.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:48.241+0000 7f3537c00700 1 --2- 172.21.15.44:0/1399809496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35301056c0 0x7f353019be90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f352400d950 tx=0x7f352400dd10 comp rx=0 tx=0).stop 2024-05-03T22:41:48.243 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:48.241+0000 7f3537c00700 1 -- 172.21.15.44:0/1399809496 shutdown_connections 2024-05-03T22:41:48.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:48.241+0000 7f3537c00700 1 --2- 172.21.15.44:0/1399809496 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f35180b2880 0x7f35180b4d40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:48.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:48.241+0000 7f3537c00700 1 --2- 172.21.15.44:0/1399809496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f353010b6c0 0x7f35301a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:48.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:48.241+0000 7f3537c00700 1 --2- 172.21.15.44:0/1399809496 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f35301056c0 0x7f353019be90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:48.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:48.241+0000 7f3537c00700 1 --2- 172.21.15.44:0/1399809496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3530106080 0x7f353019c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:48.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:48.241+0000 7f3537c00700 1 -- 172.21.15.44:0/1399809496 >> 172.21.15.44:0/1399809496 conn(0x7f35301011b0 msgr2=0x7f3530101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:48.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:48.242+0000 7f3537c00700 1 -- 172.21.15.44:0/1399809496 shutdown_connections 2024-05-03T22:41:48.244 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:48.242+0000 7f3537c00700 1 -- 172.21.15.44:0/1399809496 wait complete. 2024-05-03T22:41:48.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:48 smithi044 ceph-mon[28604]: pgmap v426: 129 pgs: 129 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-05-03T22:41:48.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:48 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1399809496' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-03T22:41:48.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:48 smithi060 ceph-mon[31721]: pgmap v426: 129 pgs: 129 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-05-03T22:41:48.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:48 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1399809496' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-03T22:41:48.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:48 smithi160 ceph-mon[32531]: pgmap v426: 129 pgs: 129 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-05-03T22:41:48.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:48 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1399809496' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-03T22:41:49.077 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-05-03T22:41:49.078 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-05-03T22:41:49.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:49 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1399809496' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-03T22:41:49.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:49 smithi044 ceph-mon[28604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T22:41:49.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:49 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1399809496' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-03T22:41:49.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:49 smithi060 ceph-mon[31721]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T22:41:49.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:49 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1399809496' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-03T22:41:49.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:49 smithi160 ceph-mon[32531]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T22:41:49.539 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:41:50.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:50 smithi044 ceph-mon[28604]: pgmap v427: 129 pgs: 129 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-03T22:41:50.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:50 smithi060 ceph-mon[31721]: pgmap v427: 129 pgs: 129 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-03T22:41:50.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:50 smithi160 ceph-mon[32531]: pgmap v427: 129 pgs: 129 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-03T22:41:51.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.818+0000 7f1a09600700 1 -- 172.21.15.44:0/2459722051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a0410fb60 msgr2=0x7f1a0410ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:51.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.818+0000 7f1a09600700 1 --2- 172.21.15.44:0/2459722051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a0410fb60 0x7f1a0410ff40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009990 tx=0x7f19f4009ca0 comp rx=0 tx=0).stop 2024-05-03T22:41:51.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.818+0000 7f1a09600700 1 -- 172.21.15.44:0/2459722051 shutdown_connections 2024-05-03T22:41:51.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.818+0000 7f1a09600700 1 --2- 172.21.15.44:0/2459722051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a0410a490 0x7f1a041169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:51.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.818+0000 7f1a09600700 1 --2- 172.21.15.44:0/2459722051 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a0410fb60 0x7f1a0410ff40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:51.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.818+0000 7f1a09600700 1 --2- 172.21.15.44:0/2459722051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a04109ad0 0x7f1a04109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:51.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.818+0000 7f1a09600700 1 -- 172.21.15.44:0/2459722051 >> 172.21.15.44:0/2459722051 conn(0x7f1a04076c70 msgr2=0x7f1a041082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:51.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.818+0000 7f1a09600700 1 -- 172.21.15.44:0/2459722051 shutdown_connections 2024-05-03T22:41:51.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.818+0000 7f1a09600700 1 -- 172.21.15.44:0/2459722051 wait complete. 2024-05-03T22:41:51.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.820+0000 7f1a09600700 1 Processor -- start 2024-05-03T22:41:51.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.820+0000 7f1a09600700 1 -- start start 2024-05-03T22:41:51.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.821+0000 7f1a09600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a04109ad0 0x7f1a041a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:51.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.821+0000 7f1a09600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a0410a490 0x7f1a041a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:51.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.821+0000 7f1a09600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a0410fb60 0x7f1a041a4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:51.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.821+0000 7f1a09600700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1a04119df0 con 0x7f1a0410fb60 2024-05-03T22:41:51.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.821+0000 7f1a09600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1a04119c70 con 0x7f1a0410a490 2024-05-03T22:41:51.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.821+0000 7f1a09600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1a04119f70 con 0x7f1a04109ad0 2024-05-03T22:41:51.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.821+0000 7f1a03400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a0410fb60 0x7f1a041a4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:51.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.821+0000 7f1a03400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a0410fb60 0x7f1a041a4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41942/0 (socket says 172.21.15.44:41942) 2024-05-03T22:41:51.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.821+0000 7f1a03400700 1 -- 172.21.15.44:0/2791792591 learned_addr learned my addr 172.21.15.44:0/2791792591 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:41:51.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.822+0000 7f1a02a00700 1 --2- 172.21.15.44:0/2791792591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a04109ad0 0x7f1a041a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:51.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.822+0000 7f1a02000700 1 --2- 172.21.15.44:0/2791792591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a0410a490 0x7f1a041a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:51.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.822+0000 7f1a03400700 1 -- 172.21.15.44:0/2791792591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a04109ad0 msgr2=0x7f1a041a02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:51.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.822+0000 7f1a03400700 1 --2- 172.21.15.44:0/2791792591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a04109ad0 0x7f1a041a02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:51.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.822+0000 7f1a03400700 1 -- 172.21.15.44:0/2791792591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a0410a490 msgr2=0x7f1a041a0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:51.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.822+0000 7f1a03400700 1 --2- 172.21.15.44:0/2791792591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a0410a490 0x7f1a041a0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:51.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.822+0000 7f1a03400700 1 -- 172.21.15.44:0/2791792591 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a041a5280 con 0x7f1a0410fb60 2024-05-03T22:41:51.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.822+0000 7f1a03400700 1 --2- 172.21.15.44:0/2791792591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a0410fb60 0x7f1a041a4b40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f19fc007ee0 tx=0x7f19fc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:51.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.823+0000 7f19fb400700 1 -- 172.21.15.44:0/2791792591 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc00dd20 con 0x7f1a0410fb60 2024-05-03T22:41:51.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.823+0000 7f19fb400700 1 -- 172.21.15.44:0/2791792591 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f19fc004020 con 0x7f1a0410fb60 2024-05-03T22:41:51.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.823+0000 7f1a09600700 1 -- 172.21.15.44:0/2791792591 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a041a5570 con 0x7f1a0410fb60 2024-05-03T22:41:51.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.823+0000 7f19fb400700 1 -- 172.21.15.44:0/2791792591 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19fc015660 con 0x7f1a0410fb60 2024-05-03T22:41:51.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.823+0000 7f1a09600700 1 -- 172.21.15.44:0/2791792591 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a041acdf0 con 0x7f1a0410fb60 2024-05-03T22:41:51.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.824+0000 7f1a09600700 1 -- 172.21.15.44:0/2791792591 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a04112060 con 0x7f1a0410fb60 2024-05-03T22:41:51.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.827+0000 7f19fb400700 1 -- 172.21.15.44:0/2791792591 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f19fc0041d0 con 0x7f1a0410fb60 2024-05-03T22:41:51.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.828+0000 7f19fb400700 1 --2- 172.21.15.44:0/2791792591 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f19e80b2900 0x7f19e80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:51.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.829+0000 7f19fb400700 1 -- 172.21.15.44:0/2791792591 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f19fc0e2640 con 0x7f1a0410fb60 2024-05-03T22:41:51.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.829+0000 7f1a02a00700 1 --2- 172.21.15.44:0/2791792591 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f19e80b2900 0x7f19e80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:51.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.829+0000 7f1a02a00700 1 --2- 172.21.15.44:0/2791792591 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f19e80b2900 0x7f19e80b4dc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f19f400b2e0 tx=0x7f19f4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:51.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:51.832+0000 7f19fb400700 1 -- 172.21.15.44:0/2791792591 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f19fc010070 con 0x7f1a0410fb60 2024-05-03T22:41:52.112 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:52.110+0000 7f1a09600700 1 -- 172.21.15.44:0/2791792591 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f1a040638e0 con 0x7f19e80b2900 2024-05-03T22:41:52.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:52.188+0000 7f19fb400700 1 -- 172.21.15.44:0/2791792591 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1a040638e0 con 0x7f19e80b2900 2024-05-03T22:41:52.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:52.191+0000 7f1a09600700 1 -- 172.21.15.44:0/2791792591 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f19e80b2900 msgr2=0x7f19e80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:52.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:52.191+0000 7f1a09600700 1 --2- 172.21.15.44:0/2791792591 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f19e80b2900 0x7f19e80b4dc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f19f400b2e0 tx=0x7f19f4005960 comp rx=0 tx=0).stop 2024-05-03T22:41:52.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:52.191+0000 7f1a09600700 1 -- 172.21.15.44:0/2791792591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a0410fb60 msgr2=0x7f1a041a4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:52.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:52.191+0000 7f1a09600700 1 --2- 172.21.15.44:0/2791792591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a0410fb60 0x7f1a041a4b40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f19fc007ee0 tx=0x7f19fc00d3b0 comp rx=0 tx=0).stop 2024-05-03T22:41:52.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:52.192+0000 7f1a09600700 1 -- 172.21.15.44:0/2791792591 shutdown_connections 2024-05-03T22:41:52.194 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:52.192+0000 7f1a09600700 1 --2- 172.21.15.44:0/2791792591 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1a0410fb60 0x7f1a041a4b40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:52.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:52.192+0000 7f1a09600700 1 --2- 172.21.15.44:0/2791792591 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f19e80b2900 0x7f19e80b4dc0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:52.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:52.192+0000 7f1a09600700 1 --2- 172.21.15.44:0/2791792591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a04109ad0 0x7f1a041a02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:52.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:52.192+0000 7f1a09600700 1 --2- 172.21.15.44:0/2791792591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a0410a490 0x7f1a041a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:52.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:52.192+0000 7f1a09600700 1 -- 172.21.15.44:0/2791792591 >> 172.21.15.44:0/2791792591 conn(0x7f1a04076c70 msgr2=0x7f1a04077270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:52.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:52.192+0000 7f1a09600700 1 -- 172.21.15.44:0/2791792591 shutdown_connections 2024-05-03T22:41:52.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:52.192+0000 7f1a09600700 1 -- 172.21.15.44:0/2791792591 wait complete. 2024-05-03T22:41:52.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:52 smithi044 ceph-mon[28604]: pgmap v428: 129 pgs: 129 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.8 KiB/s wr, 19 op/s 2024-05-03T22:41:52.502 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:41:52 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:41:52.121+0000 7f0297000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-03T22:41:52.502 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:41:52 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:41:52.121+0000 7f0297000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-03T22:41:52.502 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:41:52 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:41:52.121+0000 7f0297000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-03T22:41:52.502 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:41:52 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:41:52.121+0000 7f0297000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-03T22:41:52.502 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 22:41:52 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T22:41:52.121+0000 7f0297000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-03T22:41:52.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:52 smithi060 ceph-mon[31721]: pgmap v428: 129 pgs: 129 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.8 KiB/s wr, 19 op/s 2024-05-03T22:41:52.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:52 smithi160 ceph-mon[32531]: pgmap v428: 129 pgs: 129 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.8 KiB/s wr, 19 op/s 2024-05-03T22:41:53.079 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-03T22:41:53.564 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:41:53.720 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:53 smithi044 ceph-mon[28604]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:41:53.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:53 smithi060 ceph-mon[31721]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:41:53.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:53 smithi160 ceph-mon[32531]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:41:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:54 smithi044 ceph-mon[28604]: pgmap v429: 129 pgs: 129 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.3 KiB/s wr, 17 op/s 2024-05-03T22:41:54.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:54 smithi044 ceph-mon[28604]: mgrmap e17: x(active, since 11m), standbys: y, z 2024-05-03T22:41:54.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:54 smithi060 ceph-mon[31721]: pgmap v429: 129 pgs: 129 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.3 KiB/s wr, 17 op/s 2024-05-03T22:41:54.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:54 smithi060 ceph-mon[31721]: mgrmap e17: x(active, since 11m), standbys: y, z 2024-05-03T22:41:54.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:54 smithi160 ceph-mon[32531]: pgmap v429: 129 pgs: 129 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.3 KiB/s wr, 17 op/s 2024-05-03T22:41:54.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:54 smithi160 ceph-mon[32531]: mgrmap e17: x(active, since 11m), standbys: y, z 2024-05-03T22:41:56.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.079+0000 7f0193e00700 1 -- 172.21.15.44:0/1411542423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0194102450 msgr2=0x7f01941062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:56.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.079+0000 7f0193e00700 1 --2- 172.21.15.44:0/1411542423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0194102450 0x7f01941062a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0180007510 tx=0x7f018000af90 comp rx=0 tx=0).stop 2024-05-03T22:41:56.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.079+0000 7f0193e00700 1 -- 172.21.15.44:0/1411542423 shutdown_connections 2024-05-03T22:41:56.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.079+0000 7f0193e00700 1 --2- 172.21.15.44:0/1411542423 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01941069d0 0x7f019410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:56.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.079+0000 7f0193e00700 1 --2- 172.21.15.44:0/1411542423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0194101aa0 0x7f0194101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:56.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.080+0000 7f0193e00700 1 --2- 172.21.15.44:0/1411542423 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0194102450 0x7f01941062a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:56.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.080+0000 7f0193e00700 1 -- 172.21.15.44:0/1411542423 >> 172.21.15.44:0/1411542423 conn(0x7f0194077140 msgr2=0x7f0194077550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:56.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.080+0000 7f0193e00700 1 -- 172.21.15.44:0/1411542423 shutdown_connections 2024-05-03T22:41:56.083 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.080+0000 7f0193e00700 1 -- 172.21.15.44:0/1411542423 wait complete. 2024-05-03T22:41:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.081+0000 7f0193e00700 1 Processor -- start 2024-05-03T22:41:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.081+0000 7f0193e00700 1 -- start start 2024-05-03T22:41:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.081+0000 7f0193e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0194101aa0 0x7f019419bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.081+0000 7f0193e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0194102450 0x7f019419c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.082+0000 7f0193e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01941069d0 0x7f01941a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.082+0000 7f0193e00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f01941114c0 con 0x7f0194101aa0 2024-05-03T22:41:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.082+0000 7f0193e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0194111340 con 0x7f01941069d0 2024-05-03T22:41:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.082+0000 7f0193e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0194111640 con 0x7f0194102450 2024-05-03T22:41:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.082+0000 7f0192a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0194101aa0 0x7f019419bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.082+0000 7f0192a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0194101aa0 0x7f019419bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41970/0 (socket says 172.21.15.44:41970) 2024-05-03T22:41:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.082+0000 7f0192a00700 1 -- 172.21.15.44:0/1598583335 learned_addr learned my addr 172.21.15.44:0/1598583335 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:41:56.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.082+0000 7f0192000700 1 --2- 172.21.15.44:0/1598583335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0194102450 0x7f019419c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:56.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.082+0000 7f0192a00700 1 -- 172.21.15.44:0/1598583335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0194102450 msgr2=0x7f019419c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:56.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.082+0000 7f0192a00700 1 --2- 172.21.15.44:0/1598583335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0194102450 0x7f019419c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:56.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.082+0000 7f0192a00700 1 -- 172.21.15.44:0/1598583335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01941069d0 msgr2=0x7f01941a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:56.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.082+0000 7f0192a00700 1 --2- 172.21.15.44:0/1598583335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01941069d0 0x7f01941a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:56.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.082+0000 7f0192a00700 1 -- 172.21.15.44:0/1598583335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01941a0d80 con 0x7f0194101aa0 2024-05-03T22:41:56.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.082+0000 7f0192000700 1 --2- 172.21.15.44:0/1598583335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0194102450 0x7f019419c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:41:56.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.083+0000 7f0192a00700 1 --2- 172.21.15.44:0/1598583335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0194101aa0 0x7f019419bd70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f018400d950 tx=0x7f018400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:56.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.083+0000 7f0198a00700 1 -- 172.21.15.44:0/1598583335 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0184016070 con 0x7f0194101aa0 2024-05-03T22:41:56.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.083+0000 7f0198a00700 1 -- 172.21.15.44:0/1598583335 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f0184009b40 con 0x7f0194101aa0 2024-05-03T22:41:56.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.083+0000 7f0193e00700 1 -- 172.21.15.44:0/1598583335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01941a1070 con 0x7f0194101aa0 2024-05-03T22:41:56.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.083+0000 7f0198a00700 1 -- 172.21.15.44:0/1598583335 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018400f620 con 0x7f0194101aa0 2024-05-03T22:41:56.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.083+0000 7f0193e00700 1 -- 172.21.15.44:0/1598583335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01941a88f0 con 0x7f0194101aa0 2024-05-03T22:41:56.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.084+0000 7f0193e00700 1 -- 172.21.15.44:0/1598583335 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f019406a190 con 0x7f0194101aa0 2024-05-03T22:41:56.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.087+0000 7f0198a00700 1 -- 172.21.15.44:0/1598583335 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f0184019070 con 0x7f0194101aa0 2024-05-03T22:41:56.090 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.088+0000 7f0198a00700 1 --2- 172.21.15.44:0/1598583335 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f01780b2910 0x7f01780b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:41:56.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.088+0000 7f0198a00700 1 -- 172.21.15.44:0/1598583335 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f01840e2710 con 0x7f0194101aa0 2024-05-03T22:41:56.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.089+0000 7f0192000700 1 --2- 172.21.15.44:0/1598583335 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f01780b2910 0x7f01780b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:41:56.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.089+0000 7f0192000700 1 --2- 172.21.15.44:0/1598583335 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f01780b2910 0x7f01780b4dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0180016040 tx=0x7f0180005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:41:56.094 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.091+0000 7f0198a00700 1 -- 172.21.15.44:0/1598583335 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f01840a9f70 con 0x7f0194101aa0 2024-05-03T22:41:56.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.365+0000 7f0193e00700 1 -- 172.21.15.44:0/1598583335 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0194100450 con 0x7f01780b2910 2024-05-03T22:41:56.369 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:56 smithi044 ceph-mon[28604]: pgmap v430: 129 pgs: 129 active+clean; 594 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.2 KiB/s wr, 18 op/s 2024-05-03T22:41:56.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.440+0000 7f0198a00700 1 -- 172.21.15.44:0/1598583335 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0194100450 con 0x7f01780b2910 2024-05-03T22:41:56.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.444+0000 7f0193e00700 1 -- 172.21.15.44:0/1598583335 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f01780b2910 msgr2=0x7f01780b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:56.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.444+0000 7f0193e00700 1 --2- 172.21.15.44:0/1598583335 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f01780b2910 0x7f01780b4dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0180016040 tx=0x7f0180005fb0 comp rx=0 tx=0).stop 2024-05-03T22:41:56.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.444+0000 7f0193e00700 1 -- 172.21.15.44:0/1598583335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0194101aa0 msgr2=0x7f019419bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:41:56.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.444+0000 7f0193e00700 1 --2- 172.21.15.44:0/1598583335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0194101aa0 0x7f019419bd70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f018400d950 tx=0x7f018400dd10 comp rx=0 tx=0).stop 2024-05-03T22:41:56.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.444+0000 7f0193e00700 1 -- 172.21.15.44:0/1598583335 shutdown_connections 2024-05-03T22:41:56.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.444+0000 7f0193e00700 1 --2- 172.21.15.44:0/1598583335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01941069d0 0x7f01941a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:56.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.444+0000 7f0193e00700 1 --2- 172.21.15.44:0/1598583335 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0194101aa0 0x7f019419bd70 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:56.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.444+0000 7f0193e00700 1 --2- 172.21.15.44:0/1598583335 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f01780b2910 0x7f01780b4dd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:56.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.444+0000 7f0193e00700 1 --2- 172.21.15.44:0/1598583335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0194102450 0x7f019419c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:41:56.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.444+0000 7f0193e00700 1 -- 172.21.15.44:0/1598583335 >> 172.21.15.44:0/1598583335 conn(0x7f0194077140 msgr2=0x7f01940ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:41:56.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.445+0000 7f0193e00700 1 -- 172.21.15.44:0/1598583335 shutdown_connections 2024-05-03T22:41:56.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:41:56.445+0000 7f0193e00700 1 -- 172.21.15.44:0/1598583335 wait complete. 2024-05-03T22:41:56.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:56 smithi060 ceph-mon[31721]: pgmap v430: 129 pgs: 129 active+clean; 594 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.2 KiB/s wr, 18 op/s 2024-05-03T22:41:56.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:56 smithi160 ceph-mon[32531]: pgmap v430: 129 pgs: 129 active+clean; 594 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.2 KiB/s wr, 18 op/s 2024-05-03T22:41:57.379 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-03T22:41:57.859 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:41:58.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:58 smithi044 ceph-mon[28604]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:41:58.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:41:58 smithi044 ceph-mon[28604]: pgmap v431: 129 pgs: 129 active+clean; 594 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-05-03T22:41:58.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:58 smithi060 ceph-mon[31721]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:41:58.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:41:58 smithi060 ceph-mon[31721]: pgmap v431: 129 pgs: 129 active+clean; 594 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-05-03T22:41:58.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:58 smithi160 ceph-mon[32531]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:41:58.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:41:58 smithi160 ceph-mon[32531]: pgmap v431: 129 pgs: 129 active+clean; 594 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-05-03T22:42:00.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.365+0000 7fbe0d200700 1 -- 172.21.15.44:0/2545393980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe080782f0 msgr2=0x7fbe08113e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:00.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.365+0000 7fbe0d200700 1 --2- 172.21.15.44:0/2545393980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe080782f0 0x7fbe08113e10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4009990 tx=0x7fbdf4009ca0 comp rx=0 tx=0).stop 2024-05-03T22:42:00.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.365+0000 7fbe0d200700 1 -- 172.21.15.44:0/2545393980 shutdown_connections 2024-05-03T22:42:00.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.365+0000 7fbe0d200700 1 --2- 172.21.15.44:0/2545393980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe08114350 0x7fbe08116740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:00.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.365+0000 7fbe0d200700 1 --2- 172.21.15.44:0/2545393980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe080779d0 0x7fbe08077db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:00.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.365+0000 7fbe0d200700 1 --2- 172.21.15.44:0/2545393980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe080782f0 0x7fbe08113e10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:00.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.365+0000 7fbe0d200700 1 -- 172.21.15.44:0/2545393980 >> 172.21.15.44:0/2545393980 conn(0x7fbe081011a0 msgr2=0x7fbe081035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:00.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.366+0000 7fbe0d200700 1 -- 172.21.15.44:0/2545393980 shutdown_connections 2024-05-03T22:42:00.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.366+0000 7fbe0d200700 1 -- 172.21.15.44:0/2545393980 wait complete. 2024-05-03T22:42:00.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.367+0000 7fbe0d200700 1 Processor -- start 2024-05-03T22:42:00.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.367+0000 7fbe0d200700 1 -- start start 2024-05-03T22:42:00.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.367+0000 7fbe0d200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe080779d0 0x7fbe081a0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:00.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.367+0000 7fbe0d200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe080782f0 0x7fbe081a0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:00.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.367+0000 7fbe0d200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe08114350 0x7fbe081a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:00.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.367+0000 7fbe0d200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fbe08119e70 con 0x7fbe08114350 2024-05-03T22:42:00.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.367+0000 7fbe0d200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbe08119cf0 con 0x7fbe080779d0 2024-05-03T22:42:00.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.367+0000 7fbe0d200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbe08119ff0 con 0x7fbe080782f0 2024-05-03T22:42:00.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.368+0000 7fbe06800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe08114350 0x7fbe081a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:00.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.368+0000 7fbe06800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe08114350 0x7fbe081a4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50162/0 (socket says 172.21.15.44:50162) 2024-05-03T22:42:00.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.368+0000 7fbe06800700 1 -- 172.21.15.44:0/224158631 learned_addr learned my addr 172.21.15.44:0/224158631 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:42:00.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.368+0000 7fbe05e00700 1 --2- 172.21.15.44:0/224158631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe080779d0 0x7fbe081a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:00.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.368+0000 7fbe05400700 1 --2- 172.21.15.44:0/224158631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe080782f0 0x7fbe081a0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:00.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.368+0000 7fbe06800700 1 -- 172.21.15.44:0/224158631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe080782f0 msgr2=0x7fbe081a0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:00.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.368+0000 7fbe06800700 1 --2- 172.21.15.44:0/224158631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe080782f0 0x7fbe081a0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:00.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.368+0000 7fbe06800700 1 -- 172.21.15.44:0/224158631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe080779d0 msgr2=0x7fbe081a0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:00.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.368+0000 7fbe06800700 1 --2- 172.21.15.44:0/224158631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe080779d0 0x7fbe081a0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:00.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.368+0000 7fbe06800700 1 -- 172.21.15.44:0/224158631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe081a5300 con 0x7fbe08114350 2024-05-03T22:42:00.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.368+0000 7fbe05e00700 1 --2- 172.21.15.44:0/224158631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe080779d0 0x7fbe081a0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:42:00.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.369+0000 7fbe06800700 1 --2- 172.21.15.44:0/224158631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe08114350 0x7fbe081a4bc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbe00007ce0 tx=0x7fbe0000d0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:00.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.369+0000 7fbdfea00700 1 -- 172.21.15.44:0/224158631 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe00004db0 con 0x7fbe08114350 2024-05-03T22:42:00.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.369+0000 7fbdfea00700 1 -- 172.21.15.44:0/224158631 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fbe00005020 con 0x7fbe08114350 2024-05-03T22:42:00.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.369+0000 7fbe0d200700 1 -- 172.21.15.44:0/224158631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe081a55f0 con 0x7fbe08114350 2024-05-03T22:42:00.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.369+0000 7fbdfea00700 1 -- 172.21.15.44:0/224158631 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe00015640 con 0x7fbe08114350 2024-05-03T22:42:00.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.369+0000 7fbe0d200700 1 -- 172.21.15.44:0/224158631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe081ace70 con 0x7fbe08114350 2024-05-03T22:42:00.374 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.370+0000 7fbe0d200700 1 -- 172.21.15.44:0/224158631 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe0806a190 con 0x7fbe08114350 2024-05-03T22:42:00.375 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.373+0000 7fbdfea00700 1 -- 172.21.15.44:0/224158631 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fbe000051d0 con 0x7fbe08114350 2024-05-03T22:42:00.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.374+0000 7fbdfea00700 1 --2- 172.21.15.44:0/224158631 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fbdec0b2990 0x7fbdec0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:00.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.375+0000 7fbdfea00700 1 -- 172.21.15.44:0/224158631 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7fbe000e1ff0 con 0x7fbe08114350 2024-05-03T22:42:00.377 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.375+0000 7fbe05e00700 1 --2- 172.21.15.44:0/224158631 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fbdec0b2990 0x7fbdec0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:00.378 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.376+0000 7fbe05e00700 1 --2- 172.21.15.44:0/224158631 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fbdec0b2990 0x7fbdec0b4e50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8005950 tx=0x7fbdf8005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:00.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.379+0000 7fbdfea00700 1 -- 172.21.15.44:0/224158631 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fbe00010070 con 0x7fbe08114350 2024-05-03T22:42:00.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:00 smithi044 ceph-mon[28604]: pgmap v432: 129 pgs: 129 active+clean; 612 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-05-03T22:42:00.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.661+0000 7fbe0d200700 1 -- 172.21.15.44:0/224158631 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fbe080638e0 con 0x7fbdec0b2990 2024-05-03T22:42:00.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.673+0000 7fbdfea00700 1 -- 172.21.15.44:0/224158631 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fbe080638e0 con 0x7fbdec0b2990 2024-05-03T22:42:00.676 INFO:teuthology.orchestra.run.smithi044.stdout:/volumes/qa/sv_0/850d9ff0-3c42-45c1-bfc3-bba2f51bc245 2024-05-03T22:42:00.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.676+0000 7fbe0d200700 1 -- 172.21.15.44:0/224158631 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fbdec0b2990 msgr2=0x7fbdec0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:00.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.676+0000 7fbe0d200700 1 --2- 172.21.15.44:0/224158631 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fbdec0b2990 0x7fbdec0b4e50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8005950 tx=0x7fbdf8005f50 comp rx=0 tx=0).stop 2024-05-03T22:42:00.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.676+0000 7fbe0d200700 1 -- 172.21.15.44:0/224158631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe08114350 msgr2=0x7fbe081a4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:00.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.676+0000 7fbe0d200700 1 --2- 172.21.15.44:0/224158631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe08114350 0x7fbe081a4bc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbe00007ce0 tx=0x7fbe0000d0d0 comp rx=0 tx=0).stop 2024-05-03T22:42:00.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.677+0000 7fbe0d200700 1 -- 172.21.15.44:0/224158631 shutdown_connections 2024-05-03T22:42:00.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.677+0000 7fbe0d200700 1 --2- 172.21.15.44:0/224158631 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fbe08114350 0x7fbe081a4bc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:00.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.677+0000 7fbe0d200700 1 --2- 172.21.15.44:0/224158631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe080779d0 0x7fbe081a0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:00.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.677+0000 7fbe0d200700 1 --2- 172.21.15.44:0/224158631 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fbdec0b2990 0x7fbdec0b4e50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:00.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.677+0000 7fbe0d200700 1 --2- 172.21.15.44:0/224158631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe080782f0 0x7fbe081a0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:00.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.677+0000 7fbe0d200700 1 -- 172.21.15.44:0/224158631 >> 172.21.15.44:0/224158631 conn(0x7fbe081011a0 msgr2=0x7fbe08103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:00.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.677+0000 7fbe0d200700 1 -- 172.21.15.44:0/224158631 shutdown_connections 2024-05-03T22:42:00.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:00.677+0000 7fbe0d200700 1 -- 172.21.15.44:0/224158631 wait complete. 2024-05-03T22:42:00.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:00 smithi060 ceph-mon[31721]: pgmap v432: 129 pgs: 129 active+clean; 612 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-05-03T22:42:00.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:00 smithi160 ceph-mon[32531]: pgmap v432: 129 pgs: 129 active+clean; 612 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-05-03T22:42:01.635 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-03T22:42:02.103 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:02.541 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:02 smithi044 ceph-mon[28604]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:42:02.541 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:02 smithi044 ceph-mon[28604]: pgmap v433: 129 pgs: 129 active+clean; 612 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-05-03T22:42:02.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:02 smithi060 ceph-mon[31721]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:42:02.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:02 smithi060 ceph-mon[31721]: pgmap v433: 129 pgs: 129 active+clean; 612 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-05-03T22:42:02.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:02 smithi160 ceph-mon[32531]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:42:02.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:02 smithi160 ceph-mon[32531]: pgmap v433: 129 pgs: 129 active+clean; 612 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.7 KiB/s wr, 10 op/s 2024-05-03T22:42:04.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.451+0000 7f91b4c00700 1 -- 172.21.15.44:0/2440823103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91b0102d60 msgr2=0x7f91b010f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:04.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.451+0000 7f91b4c00700 1 --2- 172.21.15.44:0/2440823103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91b0102d60 0x7f91b010f250 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f91a800b0a0 tx=0x7f91a800b3b0 comp rx=0 tx=0).stop 2024-05-03T22:42:04.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.452+0000 7f91b4c00700 1 -- 172.21.15.44:0/2440823103 shutdown_connections 2024-05-03T22:42:04.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.452+0000 7f91b4c00700 1 --2- 172.21.15.44:0/2440823103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91b0102d60 0x7f91b010f250 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:04.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.452+0000 7f91b4c00700 1 --2- 172.21.15.44:0/2440823103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91b0108410 0x7f91b01087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:04.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.452+0000 7f91b4c00700 1 --2- 172.21.15.44:0/2440823103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b01023a0 0x7f91b0102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:04.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.452+0000 7f91b4c00700 1 -- 172.21.15.44:0/2440823103 >> 172.21.15.44:0/2440823103 conn(0x7f91b0079350 msgr2=0x7f91b0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:04.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.452+0000 7f91b4c00700 1 -- 172.21.15.44:0/2440823103 shutdown_connections 2024-05-03T22:42:04.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.452+0000 7f91b4c00700 1 -- 172.21.15.44:0/2440823103 wait complete. 2024-05-03T22:42:04.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.453+0000 7f91b4c00700 1 Processor -- start 2024-05-03T22:42:04.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.453+0000 7f91b4c00700 1 -- start start 2024-05-03T22:42:04.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.453+0000 7f91b4c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91b01023a0 0x7f91b019bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:04.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.453+0000 7f91b4c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b0102d60 0x7f91b019c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:04.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.453+0000 7f91b4c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91b0108410 0x7f91b01a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:04.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.453+0000 7f91b4c00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f91b01126c0 con 0x7f91b01023a0 2024-05-03T22:42:04.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.453+0000 7f91b4c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f91b0112540 con 0x7f91b0102d60 2024-05-03T22:42:04.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.453+0000 7f91b4c00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f91b0112840 con 0x7f91b0108410 2024-05-03T22:42:04.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.454+0000 7f91ade00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91b01023a0 0x7f91b019bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:04.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.454+0000 7f91ade00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91b01023a0 0x7f91b019bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50186/0 (socket says 172.21.15.44:50186) 2024-05-03T22:42:04.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.454+0000 7f91ade00700 1 -- 172.21.15.44:0/1256108859 learned_addr learned my addr 172.21.15.44:0/1256108859 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:42:04.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.454+0000 7f91ae800700 1 --2- 172.21.15.44:0/1256108859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91b0108410 0x7f91b01a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:04.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.454+0000 7f91ad400700 1 --2- 172.21.15.44:0/1256108859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b0102d60 0x7f91b019c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:04.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.454+0000 7f91ade00700 1 -- 172.21.15.44:0/1256108859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91b0108410 msgr2=0x7f91b01a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:04.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.454+0000 7f91ade00700 1 --2- 172.21.15.44:0/1256108859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91b0108410 0x7f91b01a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:04.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.454+0000 7f91ade00700 1 -- 172.21.15.44:0/1256108859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b0102d60 msgr2=0x7f91b019c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:04.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.454+0000 7f91ade00700 1 --2- 172.21.15.44:0/1256108859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b0102d60 0x7f91b019c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:04.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.454+0000 7f91ade00700 1 -- 172.21.15.44:0/1256108859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b01a0d30 con 0x7f91b01023a0 2024-05-03T22:42:04.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.455+0000 7f91ade00700 1 --2- 172.21.15.44:0/1256108859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91b01023a0 0x7f91b019bd20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f91a000c9b0 tx=0x7f91a000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:04.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.455+0000 7f91a6a00700 1 -- 172.21.15.44:0/1256108859 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a0007b00 con 0x7f91b01023a0 2024-05-03T22:42:04.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.455+0000 7f91a6a00700 1 -- 172.21.15.44:0/1256108859 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f91a0007ca0 con 0x7f91b01023a0 2024-05-03T22:42:04.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.455+0000 7f91b4c00700 1 -- 172.21.15.44:0/1256108859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b01a1020 con 0x7f91b01023a0 2024-05-03T22:42:04.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.455+0000 7f91a6a00700 1 -- 172.21.15.44:0/1256108859 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a00187c0 con 0x7f91b01023a0 2024-05-03T22:42:04.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.455+0000 7f91b4c00700 1 -- 172.21.15.44:0/1256108859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b01a88a0 con 0x7f91b01023a0 2024-05-03T22:42:04.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.457+0000 7f91b4c00700 1 -- 172.21.15.44:0/1256108859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b006a190 con 0x7f91b01023a0 2024-05-03T22:42:04.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.459+0000 7f91a6a00700 1 -- 172.21.15.44:0/1256108859 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f91a000f450 con 0x7f91b01023a0 2024-05-03T22:42:04.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.460+0000 7f91a6a00700 1 --2- 172.21.15.44:0/1256108859 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f91940b2990 0x7f91940b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:04.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.461+0000 7f91a6a00700 1 -- 172.21.15.44:0/1256108859 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7f91a00e2750 con 0x7f91b01023a0 2024-05-03T22:42:04.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.461+0000 7f91ad400700 1 --2- 172.21.15.44:0/1256108859 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f91940b2990 0x7f91940b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:04.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.462+0000 7f91ad400700 1 --2- 172.21.15.44:0/1256108859 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f91940b2990 0x7f91940b4e50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f919c005950 tx=0x7f919c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:04.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.466+0000 7f91a6a00700 1 -- 172.21.15.44:0/1256108859 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f91a0014030 con 0x7f91b01023a0 2024-05-03T22:42:04.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.739+0000 7f91b4c00700 1 -- 172.21.15.44:0/1256108859 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f91b006b890 con 0x7f91940b2990 2024-05-03T22:42:04.742 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:04 smithi044 ceph-mon[28604]: pgmap v434: 129 pgs: 129 active+clean; 612 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-05-03T22:42:04.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:04 smithi060 ceph-mon[31721]: pgmap v434: 129 pgs: 129 active+clean; 612 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-05-03T22:42:04.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:04 smithi160 ceph-mon[32531]: pgmap v434: 129 pgs: 129 active+clean; 612 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-05-03T22:42:04.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.809+0000 7f91a6a00700 1 -- 172.21.15.44:0/1256108859 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f91b006b890 con 0x7f91940b2990 2024-05-03T22:42:04.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.813+0000 7f91b4c00700 1 -- 172.21.15.44:0/1256108859 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f91940b2990 msgr2=0x7f91940b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:04.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.813+0000 7f91b4c00700 1 --2- 172.21.15.44:0/1256108859 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f91940b2990 0x7f91940b4e50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f919c005950 tx=0x7f919c0058e0 comp rx=0 tx=0).stop 2024-05-03T22:42:04.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.813+0000 7f91b4c00700 1 -- 172.21.15.44:0/1256108859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91b01023a0 msgr2=0x7f91b019bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:04.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.813+0000 7f91b4c00700 1 --2- 172.21.15.44:0/1256108859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91b01023a0 0x7f91b019bd20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f91a000c9b0 tx=0x7f91a000cd70 comp rx=0 tx=0).stop 2024-05-03T22:42:04.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.813+0000 7f91b4c00700 1 -- 172.21.15.44:0/1256108859 shutdown_connections 2024-05-03T22:42:04.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.813+0000 7f91b4c00700 1 --2- 172.21.15.44:0/1256108859 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f91940b2990 0x7f91940b4e50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:04.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.813+0000 7f91b4c00700 1 --2- 172.21.15.44:0/1256108859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91b0108410 0x7f91b01a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:04.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.813+0000 7f91b4c00700 1 --2- 172.21.15.44:0/1256108859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f91b01023a0 0x7f91b019bd20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:04.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.813+0000 7f91b4c00700 1 --2- 172.21.15.44:0/1256108859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b0102d60 0x7f91b019c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:04.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.813+0000 7f91b4c00700 1 -- 172.21.15.44:0/1256108859 >> 172.21.15.44:0/1256108859 conn(0x7f91b0079350 msgr2=0x7f91b006b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:04.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.814+0000 7f91b4c00700 1 -- 172.21.15.44:0/1256108859 shutdown_connections 2024-05-03T22:42:04.817 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:04.814+0000 7f91b4c00700 1 -- 172.21.15.44:0/1256108859 wait complete. 2024-05-03T22:42:05.686 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-03T22:42:06.162 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:06.574 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:06 smithi044 ceph-mon[28604]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:42:06.575 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:06 smithi044 ceph-mon[28604]: pgmap v435: 129 pgs: 129 active+clean; 617 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.4 KiB/s wr, 13 op/s 2024-05-03T22:42:06.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:06 smithi060 ceph-mon[31721]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:42:06.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:06 smithi060 ceph-mon[31721]: pgmap v435: 129 pgs: 129 active+clean; 617 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.4 KiB/s wr, 13 op/s 2024-05-03T22:42:06.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:06 smithi160 ceph-mon[32531]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:42:06.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:06 smithi160 ceph-mon[32531]: pgmap v435: 129 pgs: 129 active+clean; 617 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.4 KiB/s wr, 13 op/s 2024-05-03T22:42:08.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.441+0000 7fe59ce00700 1 -- 172.21.15.44:0/836953778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5981055d0 msgr2=0x7fe598105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:08.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.441+0000 7fe59ce00700 1 --2- 172.21.15.44:0/836953778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5981055d0 0x7fe598105a50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe5840099c0 tx=0x7fe584009cd0 comp rx=0 tx=0).stop 2024-05-03T22:42:08.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.441+0000 7fe59ce00700 1 -- 172.21.15.44:0/836953778 shutdown_connections 2024-05-03T22:42:08.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.441+0000 7fe59ce00700 1 --2- 172.21.15.44:0/836953778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe598105f90 0x7fe598112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:08.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.441+0000 7fe59ce00700 1 --2- 172.21.15.44:0/836953778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe59810b680 0x7fe59810ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:08.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.441+0000 7fe59ce00700 1 --2- 172.21.15.44:0/836953778 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe5981055d0 0x7fe598105a50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:08.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.441+0000 7fe59ce00700 1 -- 172.21.15.44:0/836953778 >> 172.21.15.44:0/836953778 conn(0x7fe5981010e0 msgr2=0x7fe598103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:08.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.441+0000 7fe59ce00700 1 -- 172.21.15.44:0/836953778 shutdown_connections 2024-05-03T22:42:08.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.441+0000 7fe59ce00700 1 -- 172.21.15.44:0/836953778 wait complete. 2024-05-03T22:42:08.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.442+0000 7fe59ce00700 1 Processor -- start 2024-05-03T22:42:08.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.443+0000 7fe59ce00700 1 -- start start 2024-05-03T22:42:08.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.443+0000 7fe59ce00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5981055d0 0x7fe59819bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:08.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.443+0000 7fe59ce00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe598105f90 0x7fe59819c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:08.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.443+0000 7fe59ce00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe59810b680 0x7fe5981a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:08.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.443+0000 7fe59ce00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe598115950 con 0x7fe59810b680 2024-05-03T22:42:08.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.443+0000 7fe59ce00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe5981157d0 con 0x7fe598105f90 2024-05-03T22:42:08.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.443+0000 7fe59ce00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe598115ad0 con 0x7fe5981055d0 2024-05-03T22:42:08.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.444+0000 7fe597e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe59810b680 0x7fe5981a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:08.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.444+0000 7fe597e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe59810b680 0x7fe5981a05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:50192/0 (socket says 172.21.15.44:50192) 2024-05-03T22:42:08.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.444+0000 7fe597e00700 1 -- 172.21.15.44:0/3774811211 learned_addr learned my addr 172.21.15.44:0/3774811211 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:42:08.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.444+0000 7fe596a00700 1 --2- 172.21.15.44:0/3774811211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe598105f90 0x7fe59819c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:08.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.444+0000 7fe597400700 1 --2- 172.21.15.44:0/3774811211 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5981055d0 0x7fe59819bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:08.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.444+0000 7fe597e00700 1 -- 172.21.15.44:0/3774811211 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5981055d0 msgr2=0x7fe59819bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:08.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.444+0000 7fe597e00700 1 --2- 172.21.15.44:0/3774811211 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5981055d0 0x7fe59819bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:08.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.444+0000 7fe597e00700 1 -- 172.21.15.44:0/3774811211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe598105f90 msgr2=0x7fe59819c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:08.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.444+0000 7fe597e00700 1 --2- 172.21.15.44:0/3774811211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe598105f90 0x7fe59819c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:08.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.444+0000 7fe597e00700 1 -- 172.21.15.44:0/3774811211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5981a0d30 con 0x7fe59810b680 2024-05-03T22:42:08.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.444+0000 7fe597e00700 1 --2- 172.21.15.44:0/3774811211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe59810b680 0x7fe5981a05f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe590007ee0 tx=0x7fe59000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:08.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.445+0000 7fe58fe00700 1 -- 172.21.15.44:0/3774811211 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59000dbd0 con 0x7fe59810b680 2024-05-03T22:42:08.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.445+0000 7fe58fe00700 1 -- 172.21.15.44:0/3774811211 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fe59000dd70 con 0x7fe59810b680 2024-05-03T22:42:08.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.445+0000 7fe58fe00700 1 -- 172.21.15.44:0/3774811211 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5900133f0 con 0x7fe59810b680 2024-05-03T22:42:08.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.445+0000 7fe59ce00700 1 -- 172.21.15.44:0/3774811211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5981a1020 con 0x7fe59810b680 2024-05-03T22:42:08.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.445+0000 7fe59ce00700 1 -- 172.21.15.44:0/3774811211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5981a88a0 con 0x7fe59810b680 2024-05-03T22:42:08.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.446+0000 7fe59ce00700 1 -- 172.21.15.44:0/3774811211 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe59810db10 con 0x7fe59810b680 2024-05-03T22:42:08.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.449+0000 7fe58fe00700 1 -- 172.21.15.44:0/3774811211 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe59001a020 con 0x7fe59810b680 2024-05-03T22:42:08.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.450+0000 7fe58fe00700 1 --2- 172.21.15.44:0/3774811211 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fe57c0b2990 0x7fe57c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:08.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.451+0000 7fe58fe00700 1 -- 172.21.15.44:0/3774811211 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9092+0+0 (secure 0 0 0) 0x7fe5900e1ec0 con 0x7fe59810b680 2024-05-03T22:42:08.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.451+0000 7fe597400700 1 --2- 172.21.15.44:0/3774811211 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fe57c0b2990 0x7fe57c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:08.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.451+0000 7fe597400700 1 --2- 172.21.15.44:0/3774811211 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fe57c0b2990 0x7fe57c0b4e50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe588005950 tx=0x7fe5880058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:08.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.455+0000 7fe58fe00700 1 -- 172.21.15.44:0/3774811211 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe590010070 con 0x7fe59810b680 2024-05-03T22:42:08.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.715+0000 7fe59ce00700 1 -- 172.21.15.44:0/3774811211 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fe59819d080 con 0x7fe57c0b2990 2024-05-03T22:42:08.717 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:08 smithi044 ceph-mon[28604]: pgmap v436: 129 pgs: 129 active+clean; 617 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-05-03T22:42:08.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.727+0000 7fe58fe00700 1 -- 172.21.15.44:0/3774811211 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fe59819d080 con 0x7fe57c0b2990 2024-05-03T22:42:08.728 INFO:teuthology.orchestra.run.smithi044.stdout:/volumes/qa/sv_1/0f515748-2e16-4dfd-b334-b606abcb7004 2024-05-03T22:42:08.730 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.729+0000 7fe59ce00700 1 -- 172.21.15.44:0/3774811211 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fe57c0b2990 msgr2=0x7fe57c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:08.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.729+0000 7fe59ce00700 1 --2- 172.21.15.44:0/3774811211 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fe57c0b2990 0x7fe57c0b4e50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe588005950 tx=0x7fe5880058e0 comp rx=0 tx=0).stop 2024-05-03T22:42:08.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.729+0000 7fe59ce00700 1 -- 172.21.15.44:0/3774811211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe59810b680 msgr2=0x7fe5981a05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:08.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.729+0000 7fe59ce00700 1 --2- 172.21.15.44:0/3774811211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe59810b680 0x7fe5981a05f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe590007ee0 tx=0x7fe59000d3b0 comp rx=0 tx=0).stop 2024-05-03T22:42:08.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.730+0000 7fe59ce00700 1 -- 172.21.15.44:0/3774811211 shutdown_connections 2024-05-03T22:42:08.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.730+0000 7fe59ce00700 1 --2- 172.21.15.44:0/3774811211 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe59810b680 0x7fe5981a05f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:08.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.730+0000 7fe59ce00700 1 --2- 172.21.15.44:0/3774811211 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fe57c0b2990 0x7fe57c0b4e50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:08.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.730+0000 7fe59ce00700 1 --2- 172.21.15.44:0/3774811211 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5981055d0 0x7fe59819bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:08.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.730+0000 7fe59ce00700 1 --2- 172.21.15.44:0/3774811211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe598105f90 0x7fe59819c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:08.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.730+0000 7fe59ce00700 1 -- 172.21.15.44:0/3774811211 >> 172.21.15.44:0/3774811211 conn(0x7fe5981010e0 msgr2=0x7fe5981026c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:08.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.730+0000 7fe59ce00700 1 -- 172.21.15.44:0/3774811211 shutdown_connections 2024-05-03T22:42:08.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:08.730+0000 7fe59ce00700 1 -- 172.21.15.44:0/3774811211 wait complete. 2024-05-03T22:42:08.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:08 smithi060 ceph-mon[31721]: pgmap v436: 129 pgs: 129 active+clean; 617 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-05-03T22:42:08.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:08 smithi160 ceph-mon[32531]: pgmap v436: 129 pgs: 129 active+clean; 617 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-05-03T22:42:09.675 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:09 smithi044 ceph-mon[28604]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:42:09.675 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:09 smithi044 ceph-mon[28604]: pgmap v437: 129 pgs: 129 active+clean; 636 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-05-03T22:42:09.679 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:42:09.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:09 smithi060 ceph-mon[31721]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:42:09.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:09 smithi060 ceph-mon[31721]: pgmap v437: 129 pgs: 129 active+clean; 636 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-05-03T22:42:09.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:09 smithi160 ceph-mon[32531]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:42:09.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:09 smithi160 ceph-mon[32531]: pgmap v437: 129 pgs: 129 active+clean; 636 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-05-03T22:42:10.150 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:10.583 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-05-03T22:42:10.583 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]: dispatch 2024-05-03T22:42:10.584 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-05-03T22:42:10.584 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-05-03T22:42:10.584 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]: dispatch 2024-05-03T22:42:10.584 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:10 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]: dispatch 2024-05-03T22:42:10.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-05-03T22:42:10.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]: dispatch 2024-05-03T22:42:10.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-05-03T22:42:10.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-05-03T22:42:10.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]: dispatch 2024-05-03T22:42:10.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:10 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]: dispatch 2024-05-03T22:42:10.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]: dispatch 2024-05-03T22:42:10.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]: dispatch 2024-05-03T22:42:10.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2024-05-03T22:42:10.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-05-03T22:42:10.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]: dispatch 2024-05-03T22:42:10.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:10 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]: dispatch 2024-05-03T22:42:11.675 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:11 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-05-03T22:42:11.675 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:11 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2024-05-03T22:42:11.676 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:11 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-05-03T22:42:11.676 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:11 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-05-03T22:42:11.676 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:11 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]': finished 2024-05-03T22:42:11.676 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:11 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2024-05-03T22:42:11.676 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:11 smithi044 ceph-mon[28604]: osdmap e88: 12 total, 12 up, 12 in 2024-05-03T22:42:11.676 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:11 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:42:11.676 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:11 smithi044 ceph-mon[28604]: pgmap v439: 129 pgs: 1 peering, 128 active+clean; 636 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-05-03T22:42:11.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:11 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-05-03T22:42:11.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:11 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2024-05-03T22:42:11.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:11 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-05-03T22:42:11.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:11 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-05-03T22:42:11.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:11 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]': finished 2024-05-03T22:42:11.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:11 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2024-05-03T22:42:11.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:11 smithi060 ceph-mon[31721]: osdmap e88: 12 total, 12 up, 12 in 2024-05-03T22:42:11.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:11 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:42:11.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:11 smithi060 ceph-mon[31721]: pgmap v439: 129 pgs: 1 peering, 128 active+clean; 636 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-05-03T22:42:11.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:11 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1", "id": [4, 9]}]': finished 2024-05-03T22:42:11.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:11 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.18", "id": [3, 9]}]': finished 2024-05-03T22:42:11.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:11 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2024-05-03T22:42:11.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:11 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-05-03T22:42:11.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:11 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]': finished 2024-05-03T22:42:11.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:11 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 6]}]': finished 2024-05-03T22:42:11.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:11 smithi160 ceph-mon[32531]: osdmap e88: 12 total, 12 up, 12 in 2024-05-03T22:42:11.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:11 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:42:11.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:11 smithi160 ceph-mon[32531]: pgmap v439: 129 pgs: 1 peering, 128 active+clean; 636 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-05-03T22:42:12.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:12 smithi044 ceph-mon[28604]: osdmap e89: 12 total, 12 up, 12 in 2024-05-03T22:42:12.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.500+0000 7f7857200700 1 -- 172.21.15.44:0/2490430111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7858105f90 msgr2=0x7f78581124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:12.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.500+0000 7f7857200700 1 --2- 172.21.15.44:0/2490430111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7858105f90 0x7f78581124a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f785000b0a0 tx=0x7f785000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:42:12.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.501+0000 7f7857200700 1 -- 172.21.15.44:0/2490430111 shutdown_connections 2024-05-03T22:42:12.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.501+0000 7f7857200700 1 --2- 172.21.15.44:0/2490430111 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7858105f90 0x7f78581124a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:12.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.501+0000 7f7857200700 1 --2- 172.21.15.44:0/2490430111 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f785810b660 0x7f785810ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:12.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.501+0000 7f7857200700 1 --2- 172.21.15.44:0/2490430111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78581055d0 0x7f7858105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:12.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.501+0000 7f7857200700 1 -- 172.21.15.44:0/2490430111 >> 172.21.15.44:0/2490430111 conn(0x7f78581010c0 msgr2=0x7f78581034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:12.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.501+0000 7f7857200700 1 -- 172.21.15.44:0/2490430111 shutdown_connections 2024-05-03T22:42:12.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.501+0000 7f7857200700 1 -- 172.21.15.44:0/2490430111 wait complete. 2024-05-03T22:42:12.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.502+0000 7f7857200700 1 Processor -- start 2024-05-03T22:42:12.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.502+0000 7f7857200700 1 -- start start 2024-05-03T22:42:12.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.502+0000 7f7857200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78581055d0 0x7f78581a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:12.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.502+0000 7f7857200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7858105f90 0x7f78581a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:12.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.502+0000 7f7857200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f785810b660 0x7f785819baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:12.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.502+0000 7f7857200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7858115940 con 0x7f7858105f90 2024-05-03T22:42:12.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.502+0000 7f7857200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f78581157c0 con 0x7f78581055d0 2024-05-03T22:42:12.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.502+0000 7f7857200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7858115ac0 con 0x7f785810b660 2024-05-03T22:42:12.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.503+0000 7f7855400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7858105f90 0x7f78581a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:12.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.503+0000 7f7855400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7858105f90 0x7f78581a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57158/0 (socket says 172.21.15.44:57158) 2024-05-03T22:42:12.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.503+0000 7f7855e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78581055d0 0x7f78581a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:12.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.503+0000 7f7855400700 1 -- 172.21.15.44:0/741123105 learned_addr learned my addr 172.21.15.44:0/741123105 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:42:12.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.503+0000 7f7856800700 1 --2- 172.21.15.44:0/741123105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f785810b660 0x7f785819baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:12.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.503+0000 7f7855400700 1 -- 172.21.15.44:0/741123105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f785810b660 msgr2=0x7f785819baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:12.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.503+0000 7f7855400700 1 --2- 172.21.15.44:0/741123105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f785810b660 0x7f785819baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:12.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.503+0000 7f7855400700 1 -- 172.21.15.44:0/741123105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78581055d0 msgr2=0x7f78581a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:12.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.503+0000 7f7855400700 1 --2- 172.21.15.44:0/741123105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78581055d0 0x7f78581a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:12.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.503+0000 7f7855400700 1 -- 172.21.15.44:0/741123105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785819c200 con 0x7f7858105f90 2024-05-03T22:42:12.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.503+0000 7f7856800700 1 --2- 172.21.15.44:0/741123105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f785810b660 0x7f785819baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:42:12.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.504+0000 7f7855400700 1 --2- 172.21.15.44:0/741123105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7858105f90 0x7f78581a1e20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f784400d950 tx=0x7f784400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:12.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.504+0000 7f784ea00700 1 -- 172.21.15.44:0/741123105 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7844016070 con 0x7f7858105f90 2024-05-03T22:42:12.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.504+0000 7f784ea00700 1 -- 172.21.15.44:0/741123105 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f7844009e10 con 0x7f7858105f90 2024-05-03T22:42:12.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.504+0000 7f7857200700 1 -- 172.21.15.44:0/741123105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f785819c4f0 con 0x7f7858105f90 2024-05-03T22:42:12.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.504+0000 7f784ea00700 1 -- 172.21.15.44:0/741123105 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784400f620 con 0x7f7858105f90 2024-05-03T22:42:12.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.504+0000 7f7857200700 1 -- 172.21.15.44:0/741123105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78581a87b0 con 0x7f7858105f90 2024-05-03T22:42:12.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.505+0000 7f7857200700 1 -- 172.21.15.44:0/741123105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f785806a190 con 0x7f7858105f90 2024-05-03T22:42:12.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.508+0000 7f784ea00700 1 -- 172.21.15.44:0/741123105 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f7844019070 con 0x7f7858105f90 2024-05-03T22:42:12.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.510+0000 7f784ea00700 1 --2- 172.21.15.44:0/741123105 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f783c0b2910 0x7f783c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:12.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.510+0000 7f784ea00700 1 -- 172.21.15.44:0/741123105 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f78440e23e0 con 0x7f7858105f90 2024-05-03T22:42:12.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.510+0000 7f7855e00700 1 --2- 172.21.15.44:0/741123105 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f783c0b2910 0x7f783c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:12.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.511+0000 7f7855e00700 1 --2- 172.21.15.44:0/741123105 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f783c0b2910 0x7f783c0b4dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f785819cbe0 tx=0x7f7848009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:12.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.515+0000 7f784ea00700 1 -- 172.21.15.44:0/741123105 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f78440a9b30 con 0x7f7858105f90 2024-05-03T22:42:12.657 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:12 smithi060 ceph-mon[31721]: osdmap e89: 12 total, 12 up, 12 in 2024-05-03T22:42:12.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:12 smithi160 ceph-mon[32531]: osdmap e89: 12 total, 12 up, 12 in 2024-05-03T22:42:12.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.811+0000 7f7857200700 1 -- 172.21.15.44:0/741123105 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78581a89e0 con 0x7f7858105f90 2024-05-03T22:42:12.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.813+0000 7f784ea00700 1 -- 172.21.15.44:0/741123105 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11932 (secure 0 0 0) 0x7f78440a9430 con 0x7f7858105f90 2024-05-03T22:42:12.815 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:42:12.815 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2550955759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2550955759},{"type":"v1","addr":"172.21.15.44:6835","nonce":2550955759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3118490782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3118490782},{"type":"v1","addr":"172.21.15.44:6837","nonce":3118490782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T22:40:14.758857+0000","modified":"2024-05-03T22:41:47.427474+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34463,"mds_1":34427,"mds_2":34409,"mds_3":34391,"mds_4":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/1408147232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1408147232},{"type":"v1","addr":"172.21.15.44:6839","nonce":1408147232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14607":{"gid":14607,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/4262223160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":4262223160},{"type":"v1","addr":"172.21.15.44:6841","nonce":4262223160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/1332937382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1332937382},{"type":"v1","addr":"172.21.15.160:6835","nonce":1332937382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/3735287805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3735287805},{"type":"v1","addr":"172.21.15.160:6837","nonce":3735287805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.160:6839/861756806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":861756806},{"type":"v1","addr":"172.21.15.160:6839","nonce":861756806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34391":{"gid":34391,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":41,"addr":"172.21.15.60:6833/153110190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":153110190},{"type":"v1","addr":"172.21.15.60:6833","nonce":153110190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.60:6835/3390425489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3390425489},{"type":"v1","addr":"172.21.15.60:6835","nonce":3390425489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.60:6837/3568217572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3568217572},{"type":"v1","addr":"172.21.15.60:6837","nonce":3568217572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.60:6839/2420093605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2420093605},{"type":"v1","addr":"172.21.15.60:6839","nonce":2420093605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34463,"qdb_cluster":[34463,34427,34409,24493,34391]},"id":1}]} 2024-05-03T22:42:12.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.818+0000 7f7857200700 1 -- 172.21.15.44:0/741123105 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f783c0b2910 msgr2=0x7f783c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:12.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.818+0000 7f7857200700 1 --2- 172.21.15.44:0/741123105 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f783c0b2910 0x7f783c0b4dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f785819cbe0 tx=0x7f7848009260 comp rx=0 tx=0).stop 2024-05-03T22:42:12.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.818+0000 7f7857200700 1 -- 172.21.15.44:0/741123105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7858105f90 msgr2=0x7f78581a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:12.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.818+0000 7f7857200700 1 --2- 172.21.15.44:0/741123105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7858105f90 0x7f78581a1e20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f784400d950 tx=0x7f784400dc60 comp rx=0 tx=0).stop 2024-05-03T22:42:12.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.818+0000 7f7857200700 1 -- 172.21.15.44:0/741123105 shutdown_connections 2024-05-03T22:42:12.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.818+0000 7f7857200700 1 --2- 172.21.15.44:0/741123105 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f783c0b2910 0x7f783c0b4dd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:12.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.818+0000 7f7857200700 1 --2- 172.21.15.44:0/741123105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f785810b660 0x7f785819baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:12.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.818+0000 7f7857200700 1 --2- 172.21.15.44:0/741123105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78581055d0 0x7f78581a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:12.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.818+0000 7f7857200700 1 --2- 172.21.15.44:0/741123105 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7858105f90 0x7f78581a1e20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:12.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.818+0000 7f7857200700 1 -- 172.21.15.44:0/741123105 >> 172.21.15.44:0/741123105 conn(0x7f78581010c0 msgr2=0x7f78581025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:12.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.818+0000 7f7857200700 1 -- 172.21.15.44:0/741123105 shutdown_connections 2024-05-03T22:42:12.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:12.818+0000 7f7857200700 1 -- 172.21.15.44:0/741123105 wait complete. 2024-05-03T22:42:12.821 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 30 2024-05-03T22:42:13.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:13 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/741123105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:42:13.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:13 smithi044 ceph-mon[28604]: pgmap v441: 129 pgs: 2 peering, 127 active+clean; 636 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-05-03T22:42:13.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:13 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/741123105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:42:13.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:13 smithi060 ceph-mon[31721]: pgmap v441: 129 pgs: 2 peering, 127 active+clean; 636 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-05-03T22:42:13.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:13 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/741123105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:42:13.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:13 smithi160 ceph-mon[32531]: pgmap v441: 129 pgs: 2 peering, 127 active+clean; 636 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-05-03T22:42:14.133 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:42:14.575 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:14.726 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:14 smithi044 ceph-mon[28604]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-05-03T22:42:14.726 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:14 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:14.726 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:14 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:14.726 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:14 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:14.726 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:14 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:14.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:14 smithi060 ceph-mon[31721]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-05-03T22:42:14.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:14 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:14.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:14 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:14.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:14 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:14.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:14 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:14.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:14 smithi160 ceph-mon[32531]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-05-03T22:42:14.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:14 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:14.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:14 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:14.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:14 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:14.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:14 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:15.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:15 smithi044 ceph-mon[28604]: pgmap v442: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.7 KiB/s wr, 13 op/s 2024-05-03T22:42:15.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:15 smithi060 ceph-mon[31721]: pgmap v442: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.7 KiB/s wr, 13 op/s 2024-05-03T22:42:15.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:15 smithi160 ceph-mon[32531]: pgmap v442: 129 pgs: 2 peering, 127 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.7 KiB/s wr, 13 op/s 2024-05-03T22:42:16.725 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:16 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:16.725 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:16 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:16.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.892+0000 7f418f400700 1 -- 172.21.15.44:0/3597160980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41880756d0 msgr2=0x7f4188075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:16.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.892+0000 7f418f400700 1 --2- 172.21.15.44:0/3597160980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41880756d0 0x7f4188075ab0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f417c009990 tx=0x7f417c009ca0 comp rx=0 tx=0).stop 2024-05-03T22:42:16.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.892+0000 7f418f400700 1 -- 172.21.15.44:0/3597160980 shutdown_connections 2024-05-03T22:42:16.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.892+0000 7f418f400700 1 --2- 172.21.15.44:0/3597160980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f418810ff00 0x7f41881122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:16.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.892+0000 7f418f400700 1 --2- 172.21.15.44:0/3597160980 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f41880756d0 0x7f4188075ab0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:16.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.892+0000 7f418f400700 1 --2- 172.21.15.44:0/3597160980 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4188075ff0 0x7f418810f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:16.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.892+0000 7f418f400700 1 -- 172.21.15.44:0/3597160980 >> 172.21.15.44:0/3597160980 conn(0x7f418807a600 msgr2=0x7f418807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:16.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.893+0000 7f418f400700 1 -- 172.21.15.44:0/3597160980 shutdown_connections 2024-05-03T22:42:16.895 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.893+0000 7f418f400700 1 -- 172.21.15.44:0/3597160980 wait complete. 2024-05-03T22:42:16.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.894+0000 7f418f400700 1 Processor -- start 2024-05-03T22:42:16.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.894+0000 7f418f400700 1 -- start start 2024-05-03T22:42:16.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.894+0000 7f418f400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41880756d0 0x7f418819be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:16.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.894+0000 7f418f400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4188075ff0 0x7f418819c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:16.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.894+0000 7f418f400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f418810ff00 0x7f41881a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:16.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.894+0000 7f418f400700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4188115a20 con 0x7f418810ff00 2024-05-03T22:42:16.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.894+0000 7f418f400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f41881158a0 con 0x7f41880756d0 2024-05-03T22:42:16.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.894+0000 7f418f400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4188115ba0 con 0x7f4188075ff0 2024-05-03T22:42:16.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.895+0000 7f418d400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f418810ff00 0x7f41881a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:16.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.895+0000 7f418d400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f418810ff00 0x7f41881a06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57180/0 (socket says 172.21.15.44:57180) 2024-05-03T22:42:16.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.895+0000 7f418d400700 1 -- 172.21.15.44:0/2828612858 learned_addr learned my addr 172.21.15.44:0/2828612858 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:42:16.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.895+0000 7f418ca00700 1 --2- 172.21.15.44:0/2828612858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41880756d0 0x7f418819be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:16.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.895+0000 7f4187e00700 1 --2- 172.21.15.44:0/2828612858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4188075ff0 0x7f418819c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:16.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.895+0000 7f418d400700 1 -- 172.21.15.44:0/2828612858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4188075ff0 msgr2=0x7f418819c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:16.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.895+0000 7f418d400700 1 --2- 172.21.15.44:0/2828612858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4188075ff0 0x7f418819c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:16.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.895+0000 7f418d400700 1 -- 172.21.15.44:0/2828612858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41880756d0 msgr2=0x7f418819be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:16.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.895+0000 7f418d400700 1 --2- 172.21.15.44:0/2828612858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41880756d0 0x7f418819be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:16.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.895+0000 7f418d400700 1 -- 172.21.15.44:0/2828612858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41881a0e10 con 0x7f418810ff00 2024-05-03T22:42:16.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.896+0000 7f418d400700 1 --2- 172.21.15.44:0/2828612858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f418810ff00 0x7f41881a06d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f418000cc30 tx=0x7f418000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:16.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.896+0000 7f4185600700 1 -- 172.21.15.44:0/2828612858 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4180016020 con 0x7f418810ff00 2024-05-03T22:42:16.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.896+0000 7f4185600700 1 -- 172.21.15.44:0/2828612858 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f4180012420 con 0x7f418810ff00 2024-05-03T22:42:16.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.896+0000 7f418f400700 1 -- 172.21.15.44:0/2828612858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41881a1100 con 0x7f418810ff00 2024-05-03T22:42:16.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.896+0000 7f4185600700 1 -- 172.21.15.44:0/2828612858 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41800115e0 con 0x7f418810ff00 2024-05-03T22:42:16.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.896+0000 7f418f400700 1 -- 172.21.15.44:0/2828612858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41881a8980 con 0x7f418810ff00 2024-05-03T22:42:16.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.898+0000 7f418f400700 1 -- 172.21.15.44:0/2828612858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f418806a190 con 0x7f418810ff00 2024-05-03T22:42:16.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.900+0000 7f4185600700 1 -- 172.21.15.44:0/2828612858 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f4180019020 con 0x7f418810ff00 2024-05-03T22:42:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.901+0000 7f4185600700 1 --2- 172.21.15.44:0/2828612858 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f41700b2910 0x7f41700b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.902+0000 7f4185600700 1 -- 172.21.15.44:0/2828612858 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f41800e24b0 con 0x7f418810ff00 2024-05-03T22:42:16.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.902+0000 7f418ca00700 1 --2- 172.21.15.44:0/2828612858 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f41700b2910 0x7f41700b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:16.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.903+0000 7f418ca00700 1 --2- 172.21.15.44:0/2828612858 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f41700b2910 0x7f41700b4dd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f417c006010 tx=0x7f417c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:16.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:16.906+0000 7f4185600700 1 -- 172.21.15.44:0/2828612858 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4180020020 con 0x7f418810ff00 2024-05-03T22:42:17.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:16 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:17.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:16 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:17.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:16 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:17.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:16 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:17.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:17.187+0000 7f418f400700 1 -- 172.21.15.44:0/2828612858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f418802e510 con 0x7f418810ff00 2024-05-03T22:42:17.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:17.190+0000 7f4185600700 1 -- 172.21.15.44:0/2828612858 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24819 (secure 0 0 0) 0x7f41800a9d70 con 0x7f418810ff00 2024-05-03T22:42:17.192 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:42:17.193 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":89,"fsid":"5b0efdca-099c-11ef-bc97-c7b262605968","created":"2024-05-03T22:28:49.471963+0000","modified":"2024-05-03T22:42:11.407700+0000","last_up_change":"2024-05-03T22:38:41.446244+0000","last_in_change":"2024-05-03T22:38:16.952689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:33:24.956832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:40:05.501996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:40:09.732161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:40:23.052845+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05869397-bdc9-4c38-b1c6-deb466454dd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6803","nonce":4219032560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6805","nonce":4219032560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6809","nonce":4219032560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6807","nonce":4219032560}]},"public_addr":"172.21.15.44:6803/4219032560","cluster_addr":"172.21.15.44:6805/4219032560","heartbeat_back_addr":"172.21.15.44:6809/4219032560","heartbeat_front_addr":"172.21.15.44:6807/4219032560","state":["exists","up"]},{"osd":1,"uuid":"ff61ca27-e36b-41c9-898f-1cd7af1d9db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6801","nonce":563003638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6803","nonce":563003638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6807","nonce":563003638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6805","nonce":563003638}]},"public_addr":"172.21.15.60:6801/563003638","cluster_addr":"172.21.15.60:6803/563003638","heartbeat_back_addr":"172.21.15.60:6807/563003638","heartbeat_front_addr":"172.21.15.60:6805/563003638","state":["exists","up"]},{"osd":2,"uuid":"e58f96dc-3486-452e-85a1-847a0e2c523a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6801","nonce":2524540447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6803","nonce":2524540447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6807","nonce":2524540447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6805","nonce":2524540447}]},"public_addr":"172.21.15.160:6801/2524540447","cluster_addr":"172.21.15.160:6803/2524540447","heartbeat_back_addr":"172.21.15.160:6807/2524540447","heartbeat_front_addr":"172.21.15.160:6805/2524540447","state":["exists","up"]},{"osd":3,"uuid":"75c56c3b-5807-4646-885c-1ef16541ff72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6811","nonce":3298926279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6813","nonce":3298926279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6817","nonce":3298926279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6815","nonce":3298926279}]},"public_addr":"172.21.15.44:6811/3298926279","cluster_addr":"172.21.15.44:6813/3298926279","heartbeat_back_addr":"172.21.15.44:6817/3298926279","heartbeat_front_addr":"172.21.15.44:6815/3298926279","state":["exists","up"]},{"osd":4,"uuid":"a8a322e4-6ca1-4727-8b41-5ff523acc591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6809","nonce":3794821539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6811","nonce":3794821539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6815","nonce":3794821539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6813","nonce":3794821539}]},"public_addr":"172.21.15.60:6809/3794821539","cluster_addr":"172.21.15.60:6811/3794821539","heartbeat_back_addr":"172.21.15.60:6815/3794821539","heartbeat_front_addr":"172.21.15.60:6813/3794821539","state":["exists","up"]},{"osd":5,"uuid":"bc718527-bacd-4d1b-90c6-758cbd859e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6809","nonce":429142335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6811","nonce":429142335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6815","nonce":429142335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6813","nonce":429142335}]},"public_addr":"172.21.15.160:6809/429142335","cluster_addr":"172.21.15.160:6811/429142335","heartbeat_back_addr":"172.21.15.160:6815/429142335","heartbeat_front_addr":"172.21.15.160:6813/429142335","state":["exists","up"]},{"osd":6,"uuid":"f95a1d05-a958-4e5c-a90a-6b0c3d9fad43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6819","nonce":2805326764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6821","nonce":2805326764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6825","nonce":2805326764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6823","nonce":2805326764}]},"public_addr":"172.21.15.44:6819/2805326764","cluster_addr":"172.21.15.44:6821/2805326764","heartbeat_back_addr":"172.21.15.44:6825/2805326764","heartbeat_front_addr":"172.21.15.44:6823/2805326764","state":["exists","up"]},{"osd":7,"uuid":"a515e4be-c607-4f4a-96bb-c3d395d7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6817","nonce":693512829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6819","nonce":693512829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6823","nonce":693512829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6821","nonce":693512829}]},"public_addr":"172.21.15.60:6817/693512829","cluster_addr":"172.21.15.60:6819/693512829","heartbeat_back_addr":"172.21.15.60:6823/693512829","heartbeat_front_addr":"172.21.15.60:6821/693512829","state":["exists","up"]},{"osd":8,"uuid":"717aeffb-6c51-4e4e-8344-fba70ac2c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6817","nonce":2920554498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6819","nonce":2920554498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6823","nonce":2920554498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6821","nonce":2920554498}]},"public_addr":"172.21.15.160:6817/2920554498","cluster_addr":"172.21.15.160:6819/2920554498","heartbeat_back_addr":"172.21.15.160:6823/2920554498","heartbeat_front_addr":"172.21.15.160:6821/2920554498","state":["exists","up"]},{"osd":9,"uuid":"ade31284-1246-42c8-9cee-e60dacc58a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6827","nonce":414763386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6829","nonce":414763386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6833","nonce":414763386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6831","nonce":414763386}]},"public_addr":"172.21.15.44:6827/414763386","cluster_addr":"172.21.15.44:6829/414763386","heartbeat_back_addr":"172.21.15.44:6833/414763386","heartbeat_front_addr":"172.21.15.44:6831/414763386","state":["exists","up"]},{"osd":10,"uuid":"e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6825","nonce":2396062554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6827","nonce":2396062554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6831","nonce":2396062554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6829","nonce":2396062554}]},"public_addr":"172.21.15.60:6825/2396062554","cluster_addr":"172.21.15.60:6827/2396062554","heartbeat_back_addr":"172.21.15.60:6831/2396062554","heartbeat_front_addr":"172.21.15.60:6829/2396062554","state":["exists","up"]},{"osd":11,"uuid":"b6951585-9337-4b5a-a691-e765deb4b825","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6825","nonce":1397967755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6827","nonce":1397967755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6831","nonce":1397967755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6829","nonce":1397967755}]},"public_addr":"172.21.15.160:6825/1397967755","cluster_addr":"172.21.15.160:6827/1397967755","heartbeat_back_addr":"172.21.15.160:6831/1397967755","heartbeat_front_addr":"172.21.15.160:6829/1397967755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:15.012060+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:48.390669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:21.227227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:56.388453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:34:31.079377+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:04.912058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:40.941904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:16.757849+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:51.591794+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:37:29.022917+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:05.506391+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:39.793901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2661810503":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3426728285":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/4246410673":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2328074241":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/1738155460":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3461866265":"2024-05-04T22:30:08.766919+0000","172.21.15.44:6800/950841500":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/950841500":"2024-05-04T22:29:32.846592+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:42:17.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:17.194+0000 7f418f400700 1 -- 172.21.15.44:0/2828612858 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f41700b2910 msgr2=0x7f41700b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:17.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:17.194+0000 7f418f400700 1 --2- 172.21.15.44:0/2828612858 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f41700b2910 0x7f41700b4dd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f417c006010 tx=0x7f417c00b540 comp rx=0 tx=0).stop 2024-05-03T22:42:17.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:17.194+0000 7f418f400700 1 -- 172.21.15.44:0/2828612858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f418810ff00 msgr2=0x7f41881a06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:17.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:17.194+0000 7f418f400700 1 --2- 172.21.15.44:0/2828612858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f418810ff00 0x7f41881a06d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f418000cc30 tx=0x7f418000cf40 comp rx=0 tx=0).stop 2024-05-03T22:42:17.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:17.194+0000 7f418f400700 1 -- 172.21.15.44:0/2828612858 shutdown_connections 2024-05-03T22:42:17.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:17.194+0000 7f418f400700 1 --2- 172.21.15.44:0/2828612858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f418810ff00 0x7f41881a06d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:17.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:17.194+0000 7f418f400700 1 --2- 172.21.15.44:0/2828612858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41880756d0 0x7f418819be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:17.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:17.194+0000 7f418f400700 1 --2- 172.21.15.44:0/2828612858 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f41700b2910 0x7f41700b4dd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:17.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:17.194+0000 7f418f400700 1 --2- 172.21.15.44:0/2828612858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4188075ff0 0x7f418819c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:17.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:17.194+0000 7f418f400700 1 -- 172.21.15.44:0/2828612858 >> 172.21.15.44:0/2828612858 conn(0x7f418807a600 msgr2=0x7f41881017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:17.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:17.194+0000 7f418f400700 1 -- 172.21.15.44:0/2828612858 shutdown_connections 2024-05-03T22:42:17.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:17.194+0000 7f418f400700 1 -- 172.21.15.44:0/2828612858 wait complete. 2024-05-03T22:42:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:17 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:42:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:17 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:42:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:17 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:17 smithi044 ceph-mon[28604]: pgmap v443: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-05-03T22:42:18.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:17 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2828612858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:42:18.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:17 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:42:18.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:17 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:42:18.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:17 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:18.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:17 smithi060 ceph-mon[31721]: pgmap v443: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-05-03T22:42:18.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:17 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2828612858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:42:18.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:17 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:42:18.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:17 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:42:18.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:17 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:42:18.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:17 smithi160 ceph-mon[32531]: pgmap v443: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-05-03T22:42:18.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:17 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2828612858' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:42:18.164 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-03T22:42:18.164 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-03T22:42:18.638 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:18.845 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:18 smithi044 ceph-mon[28604]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-05-03T22:42:18.845 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:18 smithi044 ceph-mon[28604]: Cluster is now healthy 2024-05-03T22:42:19.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:18 smithi060 ceph-mon[31721]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-05-03T22:42:19.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:18 smithi060 ceph-mon[31721]: Cluster is now healthy 2024-05-03T22:42:19.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:18 smithi160 ceph-mon[32531]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-05-03T22:42:19.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:18 smithi160 ceph-mon[32531]: Cluster is now healthy 2024-05-03T22:42:19.860 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:19 smithi044 ceph-mon[28604]: pgmap v444: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.0 KiB/s wr, 11 op/s 2024-05-03T22:42:20.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:19 smithi060 ceph-mon[31721]: pgmap v444: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.0 KiB/s wr, 11 op/s 2024-05-03T22:42:20.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:19 smithi160 ceph-mon[32531]: pgmap v444: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.0 KiB/s wr, 11 op/s 2024-05-03T22:42:21.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.032+0000 7f70b3800700 1 -- 172.21.15.44:0/4009054584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70ac102d50 msgr2=0x7f70ac10f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:21.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.032+0000 7f70b3800700 1 --2- 172.21.15.44:0/4009054584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70ac102d50 0x7f70ac10f240 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f70a400b0a0 tx=0x7f70a400b3b0 comp rx=0 tx=0).stop 2024-05-03T22:42:21.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.032+0000 7f70b3800700 1 -- 172.21.15.44:0/4009054584 shutdown_connections 2024-05-03T22:42:21.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.032+0000 7f70b3800700 1 --2- 172.21.15.44:0/4009054584 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70ac102d50 0x7f70ac10f240 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:21.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.032+0000 7f70b3800700 1 --2- 172.21.15.44:0/4009054584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70ac108400 0x7f70ac1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:21.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.032+0000 7f70b3800700 1 --2- 172.21.15.44:0/4009054584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70ac102390 0x7f70ac102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:21.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.032+0000 7f70b3800700 1 -- 172.21.15.44:0/4009054584 >> 172.21.15.44:0/4009054584 conn(0x7f70ac079310 msgr2=0x7f70ac079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:21.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.032+0000 7f70b3800700 1 -- 172.21.15.44:0/4009054584 shutdown_connections 2024-05-03T22:42:21.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.032+0000 7f70b3800700 1 -- 172.21.15.44:0/4009054584 wait complete. 2024-05-03T22:42:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.034+0000 7f70b3800700 1 Processor -- start 2024-05-03T22:42:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.034+0000 7f70b3800700 1 -- start start 2024-05-03T22:42:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.034+0000 7f70b3800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70ac102390 0x7f70ac104070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.034+0000 7f70b3800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70ac102d50 0x7f70ac1045b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.034+0000 7f70b3800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70ac108400 0x7f70ac104af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.034+0000 7f70b3800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1126e0 con 0x7f70ac108400 2024-05-03T22:42:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.034+0000 7f70b3800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac112560 con 0x7f70ac102d50 2024-05-03T22:42:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.034+0000 7f70b3800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac112860 con 0x7f70ac102390 2024-05-03T22:42:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.035+0000 7f70b1800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70ac108400 0x7f70ac104af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:21.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.035+0000 7f70b1800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70ac108400 0x7f70ac104af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47614/0 (socket says 172.21.15.44:47614) 2024-05-03T22:42:21.037 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.035+0000 7f70b1800700 1 -- 172.21.15.44:0/3475430883 learned_addr learned my addr 172.21.15.44:0/3475430883 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:42:21.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.035+0000 7f70b0e00700 1 --2- 172.21.15.44:0/3475430883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70ac102390 0x7f70ac104070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:21.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.035+0000 7f70b1800700 1 -- 172.21.15.44:0/3475430883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70ac102390 msgr2=0x7f70ac104070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:21.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.035+0000 7f70b1800700 1 --2- 172.21.15.44:0/3475430883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70ac102390 0x7f70ac104070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:21.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.035+0000 7f70abe00700 1 --2- 172.21.15.44:0/3475430883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70ac102d50 0x7f70ac1045b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:21.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.035+0000 7f70b1800700 1 -- 172.21.15.44:0/3475430883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70ac102d50 msgr2=0x7f70ac1045b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:21.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.035+0000 7f70b1800700 1 --2- 172.21.15.44:0/3475430883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70ac102d50 0x7f70ac1045b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:21.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.035+0000 7f70b1800700 1 -- 172.21.15.44:0/3475430883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ac1a8130 con 0x7f70ac108400 2024-05-03T22:42:21.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.035+0000 7f70b1800700 1 --2- 172.21.15.44:0/3475430883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70ac108400 0x7f70ac104af0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f70a40079a0 tx=0x7f70a4007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:21.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.036+0000 7f70a9600700 1 -- 172.21.15.44:0/3475430883 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a4021070 con 0x7f70ac108400 2024-05-03T22:42:21.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.036+0000 7f70a9600700 1 -- 172.21.15.44:0/3475430883 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f70a401db20 con 0x7f70ac108400 2024-05-03T22:42:21.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.036+0000 7f70a9600700 1 -- 172.21.15.44:0/3475430883 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a401bd90 con 0x7f70ac108400 2024-05-03T22:42:21.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.036+0000 7f70b3800700 1 -- 172.21.15.44:0/3475430883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ac1a83c0 con 0x7f70ac108400 2024-05-03T22:42:21.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.036+0000 7f70b3800700 1 -- 172.21.15.44:0/3475430883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ac1a8820 con 0x7f70ac108400 2024-05-03T22:42:21.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.037+0000 7f70b3800700 1 -- 172.21.15.44:0/3475430883 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70ac06a190 con 0x7f70ac108400 2024-05-03T22:42:21.041 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.040+0000 7f70a9600700 1 -- 172.21.15.44:0/3475430883 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f70a4024070 con 0x7f70ac108400 2024-05-03T22:42:21.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.042+0000 7f70a9600700 1 --2- 172.21.15.44:0/3475430883 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f70940b2990 0x7f70940b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:21.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.042+0000 7f70a9600700 1 -- 172.21.15.44:0/3475430883 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f70a40e3c30 con 0x7f70ac108400 2024-05-03T22:42:21.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.042+0000 7f70b0e00700 1 --2- 172.21.15.44:0/3475430883 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f70940b2990 0x7f70940b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:21.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.043+0000 7f70b0e00700 1 --2- 172.21.15.44:0/3475430883 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f70940b2990 0x7f70940b4e50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f70a0005950 tx=0x7f70a00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:21.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.047+0000 7f70a9600700 1 -- 172.21.15.44:0/3475430883 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f70a40ab410 con 0x7f70ac108400 2024-05-03T22:42:21.282 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.281+0000 7f70b3800700 1 -- 172.21.15.44:0/3475430883 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f70ac1061b0 con 0x7f70940b2990 2024-05-03T22:42:21.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.317+0000 7f70a9600700 1 -- 172.21.15.44:0/3475430883 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340428 (secure 0 0 0) 0x7f70ac1061b0 con 0x7f70940b2990 2024-05-03T22:42:21.322 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:42:21.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.328+0000 7f70b3800700 1 -- 172.21.15.44:0/3475430883 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f70940b2990 msgr2=0x7f70940b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:21.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.329+0000 7f70b3800700 1 --2- 172.21.15.44:0/3475430883 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f70940b2990 0x7f70940b4e50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f70a0005950 tx=0x7f70a00058e0 comp rx=0 tx=0).stop 2024-05-03T22:42:21.330 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.329+0000 7f70b3800700 1 -- 172.21.15.44:0/3475430883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70ac108400 msgr2=0x7f70ac104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:21.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.329+0000 7f70b3800700 1 --2- 172.21.15.44:0/3475430883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70ac108400 0x7f70ac104af0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f70a40079a0 tx=0x7f70a4007a80 comp rx=0 tx=0).stop 2024-05-03T22:42:21.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.329+0000 7f70b3800700 1 -- 172.21.15.44:0/3475430883 shutdown_connections 2024-05-03T22:42:21.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.329+0000 7f70b3800700 1 --2- 172.21.15.44:0/3475430883 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70ac108400 0x7f70ac104af0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:21.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.329+0000 7f70b3800700 1 --2- 172.21.15.44:0/3475430883 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f70940b2990 0x7f70940b4e50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:21.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.329+0000 7f70b3800700 1 --2- 172.21.15.44:0/3475430883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70ac102390 0x7f70ac104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:21.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.329+0000 7f70b3800700 1 --2- 172.21.15.44:0/3475430883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70ac102d50 0x7f70ac1045b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:21.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.329+0000 7f70b3800700 1 -- 172.21.15.44:0/3475430883 >> 172.21.15.44:0/3475430883 conn(0x7f70ac079310 msgr2=0x7f70ac101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:21.331 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.329+0000 7f70b3800700 1 -- 172.21.15.44:0/3475430883 shutdown_connections 2024-05-03T22:42:21.332 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:21.329+0000 7f70b3800700 1 -- 172.21.15.44:0/3475430883 wait complete. 2024-05-03T22:42:21.333 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-05-03T22:42:22.213 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":445,"stamp":"2024-05-03T22:42:21.014607+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656368,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":465,"num_read_kb":332,"num_write":369,"num_write_kb":2289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384252,"kb_used_data":14228,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557572,"statfs":{"total":1151940427776,"available":1151546953728,"internally_reserved":0,"allocated":14569472,"data_stored":8129762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5303,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":53,"num_write":8,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003980"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.535408+0000","last_change":"2024-05-03T22:40:11.775947+0000","last_active":"2024-05-03T22:42:11.535408+0000","last_peered":"2024-05-03T22:42:11.535408+0000","last_clean":"2024-05-03T22:42:11.535408+0000","last_became_active":"2024-05-03T22:40:11.770836+0000","last_became_peered":"2024-05-03T22:40:11.770836+0000","last_unstale":"2024-05-03T22:42:11.535408+0000","last_undegraded":"2024-05-03T22:42:11.535408+0000","last_fullsized":"2024-05-03T22:42:11.535408+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:38:36.107368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740907+0000","last_change":"2024-05-03T22:40:11.781597+0000","last_active":"2024-05-03T22:42:11.740907+0000","last_peered":"2024-05-03T22:42:11.740907+0000","last_clean":"2024-05-03T22:42:11.740907+0000","last_became_active":"2024-05-03T22:40:11.781160+0000","last_became_peered":"2024-05-03T22:40:11.781160+0000","last_unstale":"2024-05-03T22:42:11.740907+0000","last_undegraded":"2024-05-03T22:42:11.740907+0000","last_fullsized":"2024-05-03T22:42:11.740907+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:57:41.654999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740820+0000","last_change":"2024-05-03T22:40:11.776144+0000","last_active":"2024-05-03T22:42:11.740820+0000","last_peered":"2024-05-03T22:42:11.740820+0000","last_clean":"2024-05-03T22:42:11.740820+0000","last_became_active":"2024-05-03T22:40:11.775781+0000","last_became_peered":"2024-05-03T22:40:11.775781+0000","last_unstale":"2024-05-03T22:42:11.740820+0000","last_undegraded":"2024-05-03T22:42:11.740820+0000","last_fullsized":"2024-05-03T22:42:11.740820+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:48:33.774915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748883+0000","last_change":"2024-05-03T22:40:11.773680+0000","last_active":"2024-05-03T22:42:11.748883+0000","last_peered":"2024-05-03T22:42:11.748883+0000","last_clean":"2024-05-03T22:42:11.748883+0000","last_became_active":"2024-05-03T22:40:11.771779+0000","last_became_peered":"2024-05-03T22:40:11.771779+0000","last_unstale":"2024-05-03T22:42:11.748883+0000","last_undegraded":"2024-05-03T22:42:11.748883+0000","last_fullsized":"2024-05-03T22:42:11.748883+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:29:58.849141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433145+0000","last_change":"2024-05-03T22:40:11.770873+0000","last_active":"2024-05-03T22:42:11.433145+0000","last_peered":"2024-05-03T22:42:11.433145+0000","last_clean":"2024-05-03T22:42:11.433145+0000","last_became_active":"2024-05-03T22:40:11.770361+0000","last_became_peered":"2024-05-03T22:40:11.770361+0000","last_unstale":"2024-05-03T22:42:11.433145+0000","last_undegraded":"2024-05-03T22:42:11.433145+0000","last_fullsized":"2024-05-03T22:42:11.433145+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:24:11.038058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439751+0000","last_change":"2024-05-03T22:42:11.439751+0000","last_active":"2024-05-03T22:42:11.439751+0000","last_peered":"2024-05-03T22:42:11.439751+0000","last_clean":"2024-05-03T22:42:11.439751+0000","last_became_active":"2024-05-03T22:42:11.438556+0000","last_became_peered":"2024-05-03T22:42:11.438556+0000","last_unstale":"2024-05-03T22:42:11.439751+0000","last_undegraded":"2024-05-03T22:42:11.439751+0000","last_fullsized":"2024-05-03T22:42:11.439751+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:25:14.716559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749464+0000","last_change":"2024-05-03T22:40:11.772616+0000","last_active":"2024-05-03T22:42:11.749464+0000","last_peered":"2024-05-03T22:42:11.749464+0000","last_clean":"2024-05-03T22:42:11.749464+0000","last_became_active":"2024-05-03T22:40:11.772237+0000","last_became_peered":"2024-05-03T22:40:11.772237+0000","last_unstale":"2024-05-03T22:42:11.749464+0000","last_undegraded":"2024-05-03T22:42:11.749464+0000","last_fullsized":"2024-05-03T22:42:11.749464+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:36:36.825989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748124+0000","last_change":"2024-05-03T22:40:11.771192+0000","last_active":"2024-05-03T22:42:11.748124+0000","last_peered":"2024-05-03T22:42:11.748124+0000","last_clean":"2024-05-03T22:42:11.748124+0000","last_became_active":"2024-05-03T22:40:11.770820+0000","last_became_peered":"2024-05-03T22:40:11.770820+0000","last_unstale":"2024-05-03T22:42:11.748124+0000","last_undegraded":"2024-05-03T22:42:11.748124+0000","last_fullsized":"2024-05-03T22:42:11.748124+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:51:22.303448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.751423+0000","last_change":"2024-05-03T22:42:11.751423+0000","last_active":"2024-05-03T22:42:11.751423+0000","last_peered":"2024-05-03T22:42:11.751423+0000","last_clean":"2024-05-03T22:42:11.751423+0000","last_became_active":"2024-05-03T22:42:11.750956+0000","last_became_peered":"2024-05-03T22:42:11.750956+0000","last_unstale":"2024-05-03T22:42:11.751423+0000","last_undegraded":"2024-05-03T22:42:11.751423+0000","last_fullsized":"2024-05-03T22:42:11.751423+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:07:12.615712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.437447+0000","last_change":"2024-05-03T22:42:11.437447+0000","last_active":"2024-05-03T22:42:11.437447+0000","last_peered":"2024-05-03T22:42:11.437447+0000","last_clean":"2024-05-03T22:42:11.437447+0000","last_became_active":"2024-05-03T22:42:11.436202+0000","last_became_peered":"2024-05-03T22:42:11.436202+0000","last_unstale":"2024-05-03T22:42:11.437447+0000","last_undegraded":"2024-05-03T22:42:11.437447+0000","last_fullsized":"2024-05-03T22:42:11.437447+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:50:12.891083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750298+0000","last_change":"2024-05-03T22:40:11.781381+0000","last_active":"2024-05-03T22:42:11.750298+0000","last_peered":"2024-05-03T22:42:11.750298+0000","last_clean":"2024-05-03T22:42:11.750298+0000","last_became_active":"2024-05-03T22:40:11.779293+0000","last_became_peered":"2024-05-03T22:40:11.779293+0000","last_unstale":"2024-05-03T22:42:11.750298+0000","last_undegraded":"2024-05-03T22:42:11.750298+0000","last_fullsized":"2024-05-03T22:42:11.750298+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:54:12.774746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748734+0000","last_change":"2024-05-03T22:40:11.784059+0000","last_active":"2024-05-03T22:42:11.748734+0000","last_peered":"2024-05-03T22:42:11.748734+0000","last_clean":"2024-05-03T22:42:11.748734+0000","last_became_active":"2024-05-03T22:40:11.783674+0000","last_became_peered":"2024-05-03T22:40:11.783674+0000","last_unstale":"2024-05-03T22:42:11.748734+0000","last_undegraded":"2024-05-03T22:42:11.748734+0000","last_fullsized":"2024-05-03T22:42:11.748734+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:20:53.546365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.432169+0000","last_change":"2024-05-03T22:40:11.780950+0000","last_active":"2024-05-03T22:42:11.432169+0000","last_peered":"2024-05-03T22:42:11.432169+0000","last_clean":"2024-05-03T22:42:11.432169+0000","last_became_active":"2024-05-03T22:40:11.780434+0000","last_became_peered":"2024-05-03T22:40:11.780434+0000","last_unstale":"2024-05-03T22:42:11.432169+0000","last_undegraded":"2024-05-03T22:42:11.432169+0000","last_fullsized":"2024-05-03T22:42:11.432169+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:28:46.616675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740534+0000","last_change":"2024-05-03T22:40:11.785985+0000","last_active":"2024-05-03T22:42:11.740534+0000","last_peered":"2024-05-03T22:42:11.740534+0000","last_clean":"2024-05-03T22:42:11.740534+0000","last_became_active":"2024-05-03T22:40:11.785615+0000","last_became_peered":"2024-05-03T22:40:11.785615+0000","last_unstale":"2024-05-03T22:42:11.740534+0000","last_undegraded":"2024-05-03T22:42:11.740534+0000","last_fullsized":"2024-05-03T22:42:11.740534+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:51:19.038726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740606+0000","last_change":"2024-05-03T22:40:11.777142+0000","last_active":"2024-05-03T22:42:11.740606+0000","last_peered":"2024-05-03T22:42:11.740606+0000","last_clean":"2024-05-03T22:42:11.740606+0000","last_became_active":"2024-05-03T22:40:11.775364+0000","last_became_peered":"2024-05-03T22:40:11.775364+0000","last_unstale":"2024-05-03T22:42:11.740606+0000","last_undegraded":"2024-05-03T22:42:11.740606+0000","last_fullsized":"2024-05-03T22:42:11.740606+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:48:06.634135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439450+0000","last_change":"2024-05-03T22:40:11.774928+0000","last_active":"2024-05-03T22:42:11.439450+0000","last_peered":"2024-05-03T22:42:11.439450+0000","last_clean":"2024-05-03T22:42:11.439450+0000","last_became_active":"2024-05-03T22:40:11.772942+0000","last_became_peered":"2024-05-03T22:40:11.772942+0000","last_unstale":"2024-05-03T22:42:11.439450+0000","last_undegraded":"2024-05-03T22:42:11.439450+0000","last_fullsized":"2024-05-03T22:42:11.439450+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.054532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534896+0000","last_change":"2024-05-03T22:40:11.777739+0000","last_active":"2024-05-03T22:42:11.534896+0000","last_peered":"2024-05-03T22:42:11.534896+0000","last_clean":"2024-05-03T22:42:11.534896+0000","last_became_active":"2024-05-03T22:40:11.776615+0000","last_became_peered":"2024-05-03T22:40:11.776615+0000","last_unstale":"2024-05-03T22:42:11.534896+0000","last_undegraded":"2024-05-03T22:42:11.534896+0000","last_fullsized":"2024-05-03T22:42:11.534896+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:34:17.672863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428516+0000","last_change":"2024-05-03T22:40:11.778880+0000","last_active":"2024-05-03T22:42:11.428516+0000","last_peered":"2024-05-03T22:42:11.428516+0000","last_clean":"2024-05-03T22:42:11.428516+0000","last_became_active":"2024-05-03T22:40:11.776901+0000","last_became_peered":"2024-05-03T22:40:11.776901+0000","last_unstale":"2024-05-03T22:42:11.428516+0000","last_undegraded":"2024-05-03T22:42:11.428516+0000","last_fullsized":"2024-05-03T22:42:11.428516+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:55:47.849284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425961+0000","last_change":"2024-05-03T22:40:11.768612+0000","last_active":"2024-05-03T22:42:11.425961+0000","last_peered":"2024-05-03T22:42:11.425961+0000","last_clean":"2024-05-03T22:42:11.425961+0000","last_became_active":"2024-05-03T22:40:11.767553+0000","last_became_peered":"2024-05-03T22:40:11.767553+0000","last_unstale":"2024-05-03T22:42:11.425961+0000","last_undegraded":"2024-05-03T22:42:11.425961+0000","last_fullsized":"2024-05-03T22:42:11.425961+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:04:36.348401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425251+0000","last_change":"2024-05-03T22:40:25.088489+0000","last_active":"2024-05-03T22:42:11.425251+0000","last_peered":"2024-05-03T22:42:11.425251+0000","last_clean":"2024-05-03T22:42:11.425251+0000","last_became_active":"2024-05-03T22:40:25.087028+0000","last_became_peered":"2024-05-03T22:40:25.087028+0000","last_unstale":"2024-05-03T22:42:11.425251+0000","last_undegraded":"2024-05-03T22:42:11.425251+0000","last_fullsized":"2024-05-03T22:42:11.425251+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:38:00.084610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'13","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:14.323477+0000","last_change":"2024-05-03T22:40:06.682624+0000","last_active":"2024-05-03T22:42:14.323477+0000","last_peered":"2024-05-03T22:42:14.323477+0000","last_clean":"2024-05-03T22:42:14.323477+0000","last_became_active":"2024-05-03T22:40:06.682040+0000","last_became_peered":"2024-05-03T22:40:06.682040+0000","last_unstale":"2024-05-03T22:42:14.323477+0000","last_undegraded":"2024-05-03T22:42:14.323477+0000","last_fullsized":"2024-05-03T22:42:14.323477+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:39:52.905802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748274+0000","last_change":"2024-05-03T22:40:11.771570+0000","last_active":"2024-05-03T22:42:11.748274+0000","last_peered":"2024-05-03T22:42:11.748274+0000","last_clean":"2024-05-03T22:42:11.748274+0000","last_became_active":"2024-05-03T22:40:11.771165+0000","last_became_peered":"2024-05-03T22:40:11.771165+0000","last_unstale":"2024-05-03T22:42:11.748274+0000","last_undegraded":"2024-05-03T22:42:11.748274+0000","last_fullsized":"2024-05-03T22:42:11.748274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:32:08.302284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749088+0000","last_change":"2024-05-03T22:40:25.081258+0000","last_active":"2024-05-03T22:42:11.749088+0000","last_peered":"2024-05-03T22:42:11.749088+0000","last_clean":"2024-05-03T22:42:11.749088+0000","last_became_active":"2024-05-03T22:40:25.080733+0000","last_became_peered":"2024-05-03T22:40:25.080733+0000","last_unstale":"2024-05-03T22:42:11.749088+0000","last_undegraded":"2024-05-03T22:42:11.749088+0000","last_fullsized":"2024-05-03T22:42:11.749088+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:46:13.570625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748957+0000","last_change":"2024-05-03T22:40:06.747674+0000","last_active":"2024-05-03T22:42:11.748957+0000","last_peered":"2024-05-03T22:42:11.748957+0000","last_clean":"2024-05-03T22:42:11.748957+0000","last_became_active":"2024-05-03T22:40:06.747267+0000","last_became_peered":"2024-05-03T22:40:06.747267+0000","last_unstale":"2024-05-03T22:42:11.748957+0000","last_undegraded":"2024-05-03T22:42:11.748957+0000","last_fullsized":"2024-05-03T22:42:11.748957+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:14:26.142063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740838+0000","last_change":"2024-05-03T22:40:11.769623+0000","last_active":"2024-05-03T22:42:11.740838+0000","last_peered":"2024-05-03T22:42:11.740838+0000","last_clean":"2024-05-03T22:42:11.740838+0000","last_became_active":"2024-05-03T22:40:11.769292+0000","last_became_peered":"2024-05-03T22:40:11.769292+0000","last_unstale":"2024-05-03T22:42:11.740838+0000","last_undegraded":"2024-05-03T22:42:11.740838+0000","last_fullsized":"2024-05-03T22:42:11.740838+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:37:49.533502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748372+0000","last_change":"2024-05-03T22:41:10.787906+0000","last_active":"2024-05-03T22:42:11.748372+0000","last_peered":"2024-05-03T22:42:11.748372+0000","last_clean":"2024-05-03T22:42:11.748372+0000","last_became_active":"2024-05-03T22:41:10.787233+0000","last_became_peered":"2024-05-03T22:41:10.787233+0000","last_unstale":"2024-05-03T22:42:11.748372+0000","last_undegraded":"2024-05-03T22:42:11.748372+0000","last_fullsized":"2024-05-03T22:42:11.748372+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:38:50.312605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'12","reported_seq":57,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433607+0000","last_change":"2024-05-03T22:40:06.685620+0000","last_active":"2024-05-03T22:42:11.433607+0000","last_peered":"2024-05-03T22:42:11.433607+0000","last_clean":"2024-05-03T22:42:11.433607+0000","last_became_active":"2024-05-03T22:40:06.684517+0000","last_became_peered":"2024-05-03T22:40:06.684517+0000","last_unstale":"2024-05-03T22:42:11.433607+0000","last_undegraded":"2024-05-03T22:42:11.433607+0000","last_fullsized":"2024-05-03T22:42:11.433607+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:59:26.303253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.438439+0000","last_change":"2024-05-03T22:40:11.778444+0000","last_active":"2024-05-03T22:42:11.438439+0000","last_peered":"2024-05-03T22:42:11.438439+0000","last_clean":"2024-05-03T22:42:11.438439+0000","last_became_active":"2024-05-03T22:40:11.778063+0000","last_became_peered":"2024-05-03T22:40:11.778063+0000","last_unstale":"2024-05-03T22:42:11.438439+0000","last_undegraded":"2024-05-03T22:42:11.438439+0000","last_fullsized":"2024-05-03T22:42:11.438439+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:35:53.638075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.751972+0000","last_change":"2024-05-03T22:41:11.625988+0000","last_active":"2024-05-03T22:42:11.751972+0000","last_peered":"2024-05-03T22:42:11.751972+0000","last_clean":"2024-05-03T22:42:11.751972+0000","last_became_active":"2024-05-03T22:41:11.624324+0000","last_became_peered":"2024-05-03T22:41:11.624324+0000","last_unstale":"2024-05-03T22:42:11.751972+0000","last_undegraded":"2024-05-03T22:42:11.751972+0000","last_fullsized":"2024-05-03T22:42:11.751972+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:25:34.600801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,10,3],"acting":[4,6,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"87'5","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433598+0000","last_change":"2024-05-03T22:40:06.690402+0000","last_active":"2024-05-03T22:42:11.433598+0000","last_peered":"2024-05-03T22:42:11.433598+0000","last_clean":"2024-05-03T22:42:11.433598+0000","last_became_active":"2024-05-03T22:40:06.689876+0000","last_became_peered":"2024-05-03T22:40:06.689876+0000","last_unstale":"2024-05-03T22:42:11.433598+0000","last_undegraded":"2024-05-03T22:42:11.433598+0000","last_fullsized":"2024-05-03T22:42:11.433598+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:28:36.929306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749188+0000","last_change":"2024-05-03T22:40:11.779901+0000","last_active":"2024-05-03T22:42:11.749188+0000","last_peered":"2024-05-03T22:42:11.749188+0000","last_clean":"2024-05-03T22:42:11.749188+0000","last_became_active":"2024-05-03T22:40:11.779565+0000","last_became_peered":"2024-05-03T22:40:11.779565+0000","last_unstale":"2024-05-03T22:42:11.749188+0000","last_undegraded":"2024-05-03T22:42:11.749188+0000","last_fullsized":"2024-05-03T22:42:11.749188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:05:51.650569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425697+0000","last_change":"2024-05-03T22:40:25.080244+0000","last_active":"2024-05-03T22:42:11.425697+0000","last_peered":"2024-05-03T22:42:11.425697+0000","last_clean":"2024-05-03T22:42:11.425697+0000","last_became_active":"2024-05-03T22:40:25.079711+0000","last_became_peered":"2024-05-03T22:40:25.079711+0000","last_unstale":"2024-05-03T22:42:11.425697+0000","last_undegraded":"2024-05-03T22:42:11.425697+0000","last_fullsized":"2024-05-03T22:42:11.425697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:15:55.577907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":84,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:14.331980+0000","last_change":"2024-05-03T22:40:06.686480+0000","last_active":"2024-05-03T22:42:14.331980+0000","last_peered":"2024-05-03T22:42:14.331980+0000","last_clean":"2024-05-03T22:42:14.331980+0000","last_became_active":"2024-05-03T22:40:06.685932+0000","last_became_peered":"2024-05-03T22:40:06.685932+0000","last_unstale":"2024-05-03T22:42:14.331980+0000","last_undegraded":"2024-05-03T22:42:14.331980+0000","last_fullsized":"2024-05-03T22:42:14.331980+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:40:50.952599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.442450+0000","last_change":"2024-05-03T22:42:11.442450+0000","last_active":"2024-05-03T22:42:11.442450+0000","last_peered":"2024-05-03T22:42:11.442450+0000","last_clean":"2024-05-03T22:42:11.442450+0000","last_became_active":"2024-05-03T22:42:11.441682+0000","last_became_peered":"2024-05-03T22:42:11.441682+0000","last_unstale":"2024-05-03T22:42:11.442450+0000","last_undegraded":"2024-05-03T22:42:11.442450+0000","last_fullsized":"2024-05-03T22:42:11.442450+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:03:42.054789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426504+0000","last_change":"2024-05-03T22:40:25.086337+0000","last_active":"2024-05-03T22:42:11.426504+0000","last_peered":"2024-05-03T22:42:11.426504+0000","last_clean":"2024-05-03T22:42:11.426504+0000","last_became_active":"2024-05-03T22:40:25.085878+0000","last_became_peered":"2024-05-03T22:40:25.085878+0000","last_unstale":"2024-05-03T22:42:11.426504+0000","last_undegraded":"2024-05-03T22:42:11.426504+0000","last_fullsized":"2024-05-03T22:42:11.426504+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:54.855929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425617+0000","last_change":"2024-05-03T22:40:06.694509+0000","last_active":"2024-05-03T22:42:11.425617+0000","last_peered":"2024-05-03T22:42:11.425617+0000","last_clean":"2024-05-03T22:42:11.425617+0000","last_became_active":"2024-05-03T22:40:06.693782+0000","last_became_peered":"2024-05-03T22:40:06.693782+0000","last_unstale":"2024-05-03T22:42:11.425617+0000","last_undegraded":"2024-05-03T22:42:11.425617+0000","last_fullsized":"2024-05-03T22:42:11.425617+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:44:19.457506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748934+0000","last_change":"2024-05-03T22:40:11.777600+0000","last_active":"2024-05-03T22:42:11.748934+0000","last_peered":"2024-05-03T22:42:11.748934+0000","last_clean":"2024-05-03T22:42:11.748934+0000","last_became_active":"2024-05-03T22:40:11.777231+0000","last_became_peered":"2024-05-03T22:40:11.777231+0000","last_unstale":"2024-05-03T22:42:11.748934+0000","last_undegraded":"2024-05-03T22:42:11.748934+0000","last_fullsized":"2024-05-03T22:42:11.748934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:47.701482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534423+0000","last_change":"2024-05-03T22:40:25.077289+0000","last_active":"2024-05-03T22:42:11.534423+0000","last_peered":"2024-05-03T22:42:11.534423+0000","last_clean":"2024-05-03T22:42:11.534423+0000","last_became_active":"2024-05-03T22:40:25.075368+0000","last_became_peered":"2024-05-03T22:40:25.075368+0000","last_unstale":"2024-05-03T22:42:11.534423+0000","last_undegraded":"2024-05-03T22:42:11.534423+0000","last_fullsized":"2024-05-03T22:42:11.534423+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:56:12.352251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.435138+0000","last_change":"2024-05-03T22:40:06.677202+0000","last_active":"2024-05-03T22:42:11.435138+0000","last_peered":"2024-05-03T22:42:11.435138+0000","last_clean":"2024-05-03T22:42:11.435138+0000","last_became_active":"2024-05-03T22:40:06.674152+0000","last_became_peered":"2024-05-03T22:40:06.674152+0000","last_unstale":"2024-05-03T22:42:11.435138+0000","last_undegraded":"2024-05-03T22:42:11.435138+0000","last_fullsized":"2024-05-03T22:42:11.435138+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:09:18.631126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.538163+0000","last_change":"2024-05-03T22:42:11.538163+0000","last_active":"2024-05-03T22:42:11.538163+0000","last_peered":"2024-05-03T22:42:11.538163+0000","last_clean":"2024-05-03T22:42:11.538163+0000","last_became_active":"2024-05-03T22:42:11.536762+0000","last_became_peered":"2024-05-03T22:42:11.536762+0000","last_unstale":"2024-05-03T22:42:11.538163+0000","last_undegraded":"2024-05-03T22:42:11.538163+0000","last_fullsized":"2024-05-03T22:42:11.538163+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:29:56.947667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740812+0000","last_change":"2024-05-03T22:40:25.076722+0000","last_active":"2024-05-03T22:42:11.740812+0000","last_peered":"2024-05-03T22:42:11.740812+0000","last_clean":"2024-05-03T22:42:11.740812+0000","last_became_active":"2024-05-03T22:40:25.076251+0000","last_became_peered":"2024-05-03T22:40:25.076251+0000","last_unstale":"2024-05-03T22:42:11.740812+0000","last_undegraded":"2024-05-03T22:42:11.740812+0000","last_fullsized":"2024-05-03T22:42:11.740812+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:34:12.236790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"87'3","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748364+0000","last_change":"2024-05-03T22:40:06.690531+0000","last_active":"2024-05-03T22:42:11.748364+0000","last_peered":"2024-05-03T22:42:11.748364+0000","last_clean":"2024-05-03T22:42:11.748364+0000","last_became_active":"2024-05-03T22:40:06.690110+0000","last_became_peered":"2024-05-03T22:40:06.690110+0000","last_unstale":"2024-05-03T22:42:11.748364+0000","last_undegraded":"2024-05-03T22:42:11.748364+0000","last_fullsized":"2024-05-03T22:42:11.748364+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:51.350473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428077+0000","last_change":"2024-05-03T22:40:11.774633+0000","last_active":"2024-05-03T22:42:11.428077+0000","last_peered":"2024-05-03T22:42:11.428077+0000","last_clean":"2024-05-03T22:42:11.428077+0000","last_became_active":"2024-05-03T22:40:11.774294+0000","last_became_peered":"2024-05-03T22:40:11.774294+0000","last_unstale":"2024-05-03T22:42:11.428077+0000","last_undegraded":"2024-05-03T22:42:11.428077+0000","last_fullsized":"2024-05-03T22:42:11.428077+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:11:56.967077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748063+0000","last_change":"2024-05-03T22:40:25.085649+0000","last_active":"2024-05-03T22:42:11.748063+0000","last_peered":"2024-05-03T22:42:11.748063+0000","last_clean":"2024-05-03T22:42:11.748063+0000","last_became_active":"2024-05-03T22:40:25.078260+0000","last_became_peered":"2024-05-03T22:40:25.078260+0000","last_unstale":"2024-05-03T22:42:11.748063+0000","last_undegraded":"2024-05-03T22:42:11.748063+0000","last_fullsized":"2024-05-03T22:42:11.748063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:29.040741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":118,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:17.340272+0000","last_change":"2024-05-03T22:40:06.688665+0000","last_active":"2024-05-03T22:42:17.340272+0000","last_peered":"2024-05-03T22:42:17.340272+0000","last_clean":"2024-05-03T22:42:17.340272+0000","last_became_active":"2024-05-03T22:40:06.687944+0000","last_became_peered":"2024-05-03T22:40:06.687944+0000","last_unstale":"2024-05-03T22:42:17.340272+0000","last_undegraded":"2024-05-03T22:42:17.340272+0000","last_fullsized":"2024-05-03T22:42:17.340272+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:14:43.679499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.441639+0000","last_change":"2024-05-03T22:40:11.774446+0000","last_active":"2024-05-03T22:42:11.441639+0000","last_peered":"2024-05-03T22:42:11.441639+0000","last_clean":"2024-05-03T22:42:11.441639+0000","last_became_active":"2024-05-03T22:40:11.774067+0000","last_became_peered":"2024-05-03T22:40:11.774067+0000","last_unstale":"2024-05-03T22:42:11.441639+0000","last_undegraded":"2024-05-03T22:42:11.441639+0000","last_fullsized":"2024-05-03T22:42:11.441639+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:31:34.747963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426234+0000","last_change":"2024-05-03T22:40:25.081436+0000","last_active":"2024-05-03T22:42:11.426234+0000","last_peered":"2024-05-03T22:42:11.426234+0000","last_clean":"2024-05-03T22:42:11.426234+0000","last_became_active":"2024-05-03T22:40:25.080961+0000","last_became_peered":"2024-05-03T22:40:25.080961+0000","last_unstale":"2024-05-03T22:42:11.426234+0000","last_undegraded":"2024-05-03T22:42:11.426234+0000","last_fullsized":"2024-05-03T22:42:11.426234+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:40:59.061298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750496+0000","last_change":"2024-05-03T22:40:06.694998+0000","last_active":"2024-05-03T22:42:11.750496+0000","last_peered":"2024-05-03T22:42:11.750496+0000","last_clean":"2024-05-03T22:42:11.750496+0000","last_became_active":"2024-05-03T22:40:06.691406+0000","last_became_peered":"2024-05-03T22:40:06.691406+0000","last_unstale":"2024-05-03T22:42:11.750496+0000","last_undegraded":"2024-05-03T22:42:11.750496+0000","last_fullsized":"2024-05-03T22:42:11.750496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:14:31.905257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740793+0000","last_change":"2024-05-03T22:40:11.782311+0000","last_active":"2024-05-03T22:42:11.740793+0000","last_peered":"2024-05-03T22:42:11.740793+0000","last_clean":"2024-05-03T22:42:11.740793+0000","last_became_active":"2024-05-03T22:40:11.778580+0000","last_became_peered":"2024-05-03T22:40:11.778580+0000","last_unstale":"2024-05-03T22:42:11.740793+0000","last_undegraded":"2024-05-03T22:42:11.740793+0000","last_fullsized":"2024-05-03T22:42:11.740793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:11:01.150639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748751+0000","last_change":"2024-05-03T22:41:11.166437+0000","last_active":"2024-05-03T22:42:11.748751+0000","last_peered":"2024-05-03T22:42:11.748751+0000","last_clean":"2024-05-03T22:42:11.748751+0000","last_became_active":"2024-05-03T22:41:11.165246+0000","last_became_peered":"2024-05-03T22:41:11.165246+0000","last_unstale":"2024-05-03T22:42:11.748751+0000","last_undegraded":"2024-05-03T22:42:11.748751+0000","last_fullsized":"2024-05-03T22:42:11.748751+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:37:25.103244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748797+0000","last_change":"2024-05-03T22:40:06.749132+0000","last_active":"2024-05-03T22:42:11.748797+0000","last_peered":"2024-05-03T22:42:11.748797+0000","last_clean":"2024-05-03T22:42:11.748797+0000","last_became_active":"2024-05-03T22:40:06.748356+0000","last_became_peered":"2024-05-03T22:40:06.748356+0000","last_unstale":"2024-05-03T22:42:11.748797+0000","last_undegraded":"2024-05-03T22:42:11.748797+0000","last_fullsized":"2024-05-03T22:42:11.748797+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:17:48.243084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439628+0000","last_change":"2024-05-03T22:40:11.781238+0000","last_active":"2024-05-03T22:42:11.439628+0000","last_peered":"2024-05-03T22:42:11.439628+0000","last_clean":"2024-05-03T22:42:11.439628+0000","last_became_active":"2024-05-03T22:40:11.780812+0000","last_became_peered":"2024-05-03T22:40:11.780812+0000","last_unstale":"2024-05-03T22:42:11.439628+0000","last_undegraded":"2024-05-03T22:42:11.439628+0000","last_fullsized":"2024-05-03T22:42:11.439628+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:26:25.470321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.430092+0000","last_change":"2024-05-03T22:40:25.084169+0000","last_active":"2024-05-03T22:42:11.430092+0000","last_peered":"2024-05-03T22:42:11.430092+0000","last_clean":"2024-05-03T22:42:11.430092+0000","last_became_active":"2024-05-03T22:40:25.083547+0000","last_became_peered":"2024-05-03T22:40:25.083547+0000","last_unstale":"2024-05-03T22:42:11.430092+0000","last_undegraded":"2024-05-03T22:42:11.430092+0000","last_fullsized":"2024-05-03T22:42:11.430092+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:43:46.218698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'35","reported_seq":157,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:17.352017+0000","last_change":"2024-05-03T22:40:06.692333+0000","last_active":"2024-05-03T22:42:17.352017+0000","last_peered":"2024-05-03T22:42:17.352017+0000","last_clean":"2024-05-03T22:42:17.352017+0000","last_became_active":"2024-05-03T22:40:06.691737+0000","last_became_peered":"2024-05-03T22:40:06.691737+0000","last_unstale":"2024-05-03T22:42:17.352017+0000","last_undegraded":"2024-05-03T22:42:17.352017+0000","last_fullsized":"2024-05-03T22:42:17.352017+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:41:39.669559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58562,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":78,"num_read_kb":97,"num_write":37,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433396+0000","last_change":"2024-05-03T22:40:11.782887+0000","last_active":"2024-05-03T22:42:11.433396+0000","last_peered":"2024-05-03T22:42:11.433396+0000","last_clean":"2024-05-03T22:42:11.433396+0000","last_became_active":"2024-05-03T22:40:11.782098+0000","last_became_peered":"2024-05-03T22:40:11.782098+0000","last_unstale":"2024-05-03T22:42:11.433396+0000","last_undegraded":"2024-05-03T22:42:11.433396+0000","last_fullsized":"2024-05-03T22:42:11.433396+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:07:14.661890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749437+0000","last_change":"2024-05-03T22:40:25.079794+0000","last_active":"2024-05-03T22:42:11.749437+0000","last_peered":"2024-05-03T22:42:11.749437+0000","last_clean":"2024-05-03T22:42:11.749437+0000","last_became_active":"2024-05-03T22:40:25.078516+0000","last_became_peered":"2024-05-03T22:40:25.078516+0000","last_unstale":"2024-05-03T22:42:11.749437+0000","last_undegraded":"2024-05-03T22:42:11.749437+0000","last_fullsized":"2024-05-03T22:42:11.749437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:55.775154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'9","reported_seq":55,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426119+0000","last_change":"2024-05-03T22:40:06.689509+0000","last_active":"2024-05-03T22:42:11.426119+0000","last_peered":"2024-05-03T22:42:11.426119+0000","last_clean":"2024-05-03T22:42:11.426119+0000","last_became_active":"2024-05-03T22:40:06.688937+0000","last_became_peered":"2024-05-03T22:40:06.688937+0000","last_unstale":"2024-05-03T22:42:11.426119+0000","last_undegraded":"2024-05-03T22:42:11.426119+0000","last_fullsized":"2024-05-03T22:42:11.426119+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:13:48.971563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.431676+0000","last_change":"2024-05-03T22:40:11.780448+0000","last_active":"2024-05-03T22:42:11.431676+0000","last_peered":"2024-05-03T22:42:11.431676+0000","last_clean":"2024-05-03T22:42:11.431676+0000","last_became_active":"2024-05-03T22:40:11.780030+0000","last_became_peered":"2024-05-03T22:40:11.780030+0000","last_unstale":"2024-05-03T22:42:11.431676+0000","last_undegraded":"2024-05-03T22:42:11.431676+0000","last_fullsized":"2024-05-03T22:42:11.431676+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:56.207342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534109+0000","last_change":"2024-05-03T22:40:25.075804+0000","last_active":"2024-05-03T22:42:11.534109+0000","last_peered":"2024-05-03T22:42:11.534109+0000","last_clean":"2024-05-03T22:42:11.534109+0000","last_became_active":"2024-05-03T22:40:25.075326+0000","last_became_peered":"2024-05-03T22:40:25.075326+0000","last_unstale":"2024-05-03T22:42:11.534109+0000","last_undegraded":"2024-05-03T22:42:11.534109+0000","last_fullsized":"2024-05-03T22:42:11.534109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:39:56.065804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"87'5","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748594+0000","last_change":"2024-05-03T22:40:06.690432+0000","last_active":"2024-05-03T22:42:11.748594+0000","last_peered":"2024-05-03T22:42:11.748594+0000","last_clean":"2024-05-03T22:42:11.748594+0000","last_became_active":"2024-05-03T22:40:06.688957+0000","last_became_peered":"2024-05-03T22:40:06.688957+0000","last_unstale":"2024-05-03T22:42:11.748594+0000","last_undegraded":"2024-05-03T22:42:11.748594+0000","last_fullsized":"2024-05-03T22:42:11.748594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:59:22.523855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749913+0000","last_change":"2024-05-03T22:40:11.789816+0000","last_active":"2024-05-03T22:42:11.749913+0000","last_peered":"2024-05-03T22:42:11.749913+0000","last_clean":"2024-05-03T22:42:11.749913+0000","last_became_active":"2024-05-03T22:40:11.789439+0000","last_became_peered":"2024-05-03T22:40:11.789439+0000","last_unstale":"2024-05-03T22:42:11.749913+0000","last_undegraded":"2024-05-03T22:42:11.749913+0000","last_fullsized":"2024-05-03T22:42:11.749913+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:24:52.874791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428676+0000","last_change":"2024-05-03T22:40:25.091156+0000","last_active":"2024-05-03T22:42:11.428676+0000","last_peered":"2024-05-03T22:42:11.428676+0000","last_clean":"2024-05-03T22:42:11.428676+0000","last_became_active":"2024-05-03T22:40:25.090584+0000","last_became_peered":"2024-05-03T22:40:25.090584+0000","last_unstale":"2024-05-03T22:42:11.428676+0000","last_undegraded":"2024-05-03T22:42:11.428676+0000","last_fullsized":"2024-05-03T22:42:11.428676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:12:47.194197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":89,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:17.353232+0000","last_change":"2024-05-03T22:40:06.687847+0000","last_active":"2024-05-03T22:42:17.353232+0000","last_peered":"2024-05-03T22:42:17.353232+0000","last_clean":"2024-05-03T22:42:17.353232+0000","last_became_active":"2024-05-03T22:40:06.685784+0000","last_became_peered":"2024-05-03T22:40:06.685784+0000","last_unstale":"2024-05-03T22:42:17.353232+0000","last_undegraded":"2024-05-03T22:42:17.353232+0000","last_fullsized":"2024-05-03T22:42:17.353232+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:31:36.403709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":40,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748343+0000","last_change":"2024-05-03T22:40:11.777881+0000","last_active":"2024-05-03T22:42:11.748343+0000","last_peered":"2024-05-03T22:42:11.748343+0000","last_clean":"2024-05-03T22:42:11.748343+0000","last_became_active":"2024-05-03T22:40:11.777142+0000","last_became_peered":"2024-05-03T22:40:11.777142+0000","last_unstale":"2024-05-03T22:42:11.748343+0000","last_undegraded":"2024-05-03T22:42:11.748343+0000","last_fullsized":"2024-05-03T22:42:11.748343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:43:19.150547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.437122+0000","last_change":"2024-05-03T22:40:25.072488+0000","last_active":"2024-05-03T22:42:11.437122+0000","last_peered":"2024-05-03T22:42:11.437122+0000","last_clean":"2024-05-03T22:42:11.437122+0000","last_became_active":"2024-05-03T22:40:25.072030+0000","last_became_peered":"2024-05-03T22:40:25.072030+0000","last_unstale":"2024-05-03T22:42:11.437122+0000","last_undegraded":"2024-05-03T22:42:11.437122+0000","last_fullsized":"2024-05-03T22:42:11.437122+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:01:13.875349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'17","reported_seq":62,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.432659+0000","last_change":"2024-05-03T22:40:06.748069+0000","last_active":"2024-05-03T22:42:11.432659+0000","last_peered":"2024-05-03T22:42:11.432659+0000","last_clean":"2024-05-03T22:42:11.432659+0000","last_became_active":"2024-05-03T22:40:06.747095+0000","last_became_peered":"2024-05-03T22:40:06.747095+0000","last_unstale":"2024-05-03T22:42:11.432659+0000","last_undegraded":"2024-05-03T22:42:11.432659+0000","last_fullsized":"2024-05-03T22:42:11.432659+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:56:39.715496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748752+0000","last_change":"2024-05-03T22:40:11.780695+0000","last_active":"2024-05-03T22:42:11.748752+0000","last_peered":"2024-05-03T22:42:11.748752+0000","last_clean":"2024-05-03T22:42:11.748752+0000","last_became_active":"2024-05-03T22:40:11.780103+0000","last_became_peered":"2024-05-03T22:40:11.780103+0000","last_unstale":"2024-05-03T22:42:11.748752+0000","last_undegraded":"2024-05-03T22:42:11.748752+0000","last_fullsized":"2024-05-03T22:42:11.748752+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:29:22.862772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748581+0000","last_change":"2024-05-03T22:40:25.088547+0000","last_active":"2024-05-03T22:42:11.748581+0000","last_peered":"2024-05-03T22:42:11.748581+0000","last_clean":"2024-05-03T22:42:11.748581+0000","last_became_active":"2024-05-03T22:40:25.088046+0000","last_became_peered":"2024-05-03T22:40:25.088046+0000","last_unstale":"2024-05-03T22:42:11.748581+0000","last_undegraded":"2024-05-03T22:42:11.748581+0000","last_fullsized":"2024-05-03T22:42:11.748581+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:18:15.904858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433286+0000","last_change":"2024-05-03T22:40:06.691109+0000","last_active":"2024-05-03T22:42:11.433286+0000","last_peered":"2024-05-03T22:42:11.433286+0000","last_clean":"2024-05-03T22:42:11.433286+0000","last_became_active":"2024-05-03T22:40:06.690539+0000","last_became_peered":"2024-05-03T22:40:06.690539+0000","last_unstale":"2024-05-03T22:42:11.433286+0000","last_undegraded":"2024-05-03T22:42:11.433286+0000","last_fullsized":"2024-05-03T22:42:11.433286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:18:00.701472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534864+0000","last_change":"2024-05-03T22:40:11.774465+0000","last_active":"2024-05-03T22:42:11.534864+0000","last_peered":"2024-05-03T22:42:11.534864+0000","last_clean":"2024-05-03T22:42:11.534864+0000","last_became_active":"2024-05-03T22:40:11.772816+0000","last_became_peered":"2024-05-03T22:40:11.772816+0000","last_unstale":"2024-05-03T22:42:11.534864+0000","last_undegraded":"2024-05-03T22:42:11.534864+0000","last_fullsized":"2024-05-03T22:42:11.534864+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:14:28.206641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.432985+0000","last_change":"2024-05-03T22:40:25.089301+0000","last_active":"2024-05-03T22:42:11.432985+0000","last_peered":"2024-05-03T22:42:11.432985+0000","last_clean":"2024-05-03T22:42:11.432985+0000","last_became_active":"2024-05-03T22:40:25.086336+0000","last_became_peered":"2024-05-03T22:40:25.086336+0000","last_unstale":"2024-05-03T22:42:11.432985+0000","last_undegraded":"2024-05-03T22:42:11.432985+0000","last_fullsized":"2024-05-03T22:42:11.432985+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:25:07.377584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428951+0000","last_change":"2024-05-03T22:40:06.750880+0000","last_active":"2024-05-03T22:42:11.428951+0000","last_peered":"2024-05-03T22:42:11.428951+0000","last_clean":"2024-05-03T22:42:11.428951+0000","last_became_active":"2024-05-03T22:40:06.750288+0000","last_became_peered":"2024-05-03T22:40:06.750288+0000","last_unstale":"2024-05-03T22:42:11.428951+0000","last_undegraded":"2024-05-03T22:42:11.428951+0000","last_fullsized":"2024-05-03T22:42:11.428951+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:29:09.545101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.427517+0000","last_change":"2024-05-03T22:40:11.769141+0000","last_active":"2024-05-03T22:42:11.427517+0000","last_peered":"2024-05-03T22:42:11.427517+0000","last_clean":"2024-05-03T22:42:11.427517+0000","last_became_active":"2024-05-03T22:40:11.768778+0000","last_became_peered":"2024-05-03T22:40:11.768778+0000","last_unstale":"2024-05-03T22:42:11.427517+0000","last_undegraded":"2024-05-03T22:42:11.427517+0000","last_fullsized":"2024-05-03T22:42:11.427517+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:15:45.811547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.432978+0000","last_change":"2024-05-03T22:40:25.080100+0000","last_active":"2024-05-03T22:42:11.432978+0000","last_peered":"2024-05-03T22:42:11.432978+0000","last_clean":"2024-05-03T22:42:11.432978+0000","last_became_active":"2024-05-03T22:40:25.077009+0000","last_became_peered":"2024-05-03T22:40:25.077009+0000","last_unstale":"2024-05-03T22:42:11.432978+0000","last_undegraded":"2024-05-03T22:42:11.432978+0000","last_fullsized":"2024-05-03T22:42:11.432978+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:40:24.771677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"87'5","reported_seq":56,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:16.329762+0000","last_change":"2024-05-03T22:41:11.166956+0000","last_active":"2024-05-03T22:42:16.329762+0000","last_peered":"2024-05-03T22:42:16.329762+0000","last_clean":"2024-05-03T22:42:16.329762+0000","last_became_active":"2024-05-03T22:41:11.165811+0000","last_became_peered":"2024-05-03T22:41:11.165811+0000","last_unstale":"2024-05-03T22:42:16.329762+0000","last_undegraded":"2024-05-03T22:42:16.329762+0000","last_fullsized":"2024-05-03T22:42:16.329762+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:39:37.554975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426142+0000","last_change":"2024-05-03T22:40:11.776660+0000","last_active":"2024-05-03T22:42:11.426142+0000","last_peered":"2024-05-03T22:42:11.426142+0000","last_clean":"2024-05-03T22:42:11.426142+0000","last_became_active":"2024-05-03T22:40:11.775877+0000","last_became_peered":"2024-05-03T22:40:11.775877+0000","last_unstale":"2024-05-03T22:42:11.426142+0000","last_undegraded":"2024-05-03T22:42:11.426142+0000","last_fullsized":"2024-05-03T22:42:11.426142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:12:34.902276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.436393+0000","last_change":"2024-05-03T22:40:25.078900+0000","last_active":"2024-05-03T22:42:11.436393+0000","last_peered":"2024-05-03T22:42:11.436393+0000","last_clean":"2024-05-03T22:42:11.436393+0000","last_became_active":"2024-05-03T22:40:25.078440+0000","last_became_peered":"2024-05-03T22:40:25.078440+0000","last_unstale":"2024-05-03T22:42:11.436393+0000","last_undegraded":"2024-05-03T22:42:11.436393+0000","last_fullsized":"2024-05-03T22:42:11.436393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:04:02.204303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748648+0000","last_change":"2024-05-03T22:40:11.780141+0000","last_active":"2024-05-03T22:42:11.748648+0000","last_peered":"2024-05-03T22:42:11.748648+0000","last_clean":"2024-05-03T22:42:11.748648+0000","last_became_active":"2024-05-03T22:40:11.779740+0000","last_became_peered":"2024-05-03T22:40:11.779740+0000","last_unstale":"2024-05-03T22:42:11.748648+0000","last_undegraded":"2024-05-03T22:42:11.748648+0000","last_fullsized":"2024-05-03T22:42:11.748648+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:48:14.419409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":87,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:17.351894+0000","last_change":"2024-05-03T22:40:06.747825+0000","last_active":"2024-05-03T22:42:17.351894+0000","last_peered":"2024-05-03T22:42:17.351894+0000","last_clean":"2024-05-03T22:42:17.351894+0000","last_became_active":"2024-05-03T22:40:06.747345+0000","last_became_peered":"2024-05-03T22:40:06.747345+0000","last_unstale":"2024-05-03T22:42:17.351894+0000","last_undegraded":"2024-05-03T22:42:17.351894+0000","last_fullsized":"2024-05-03T22:42:17.351894+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:23:58.770807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750109+0000","last_change":"2024-05-03T22:40:25.076382+0000","last_active":"2024-05-03T22:42:11.750109+0000","last_peered":"2024-05-03T22:42:11.750109+0000","last_clean":"2024-05-03T22:42:11.750109+0000","last_became_active":"2024-05-03T22:40:25.075866+0000","last_became_peered":"2024-05-03T22:40:25.075866+0000","last_unstale":"2024-05-03T22:42:11.750109+0000","last_undegraded":"2024-05-03T22:42:11.750109+0000","last_fullsized":"2024-05-03T22:42:11.750109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:10:58.048190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748398+0000","last_change":"2024-05-03T22:40:11.768232+0000","last_active":"2024-05-03T22:42:11.748398+0000","last_peered":"2024-05-03T22:42:11.748398+0000","last_clean":"2024-05-03T22:42:11.748398+0000","last_became_active":"2024-05-03T22:40:11.767784+0000","last_became_peered":"2024-05-03T22:40:11.767784+0000","last_unstale":"2024-05-03T22:42:11.748398+0000","last_undegraded":"2024-05-03T22:42:11.748398+0000","last_fullsized":"2024-05-03T22:42:11.748398+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:37:41.299588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":54,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748610+0000","last_change":"2024-05-03T22:40:06.681934+0000","last_active":"2024-05-03T22:42:11.748610+0000","last_peered":"2024-05-03T22:42:11.748610+0000","last_clean":"2024-05-03T22:42:11.748610+0000","last_became_active":"2024-05-03T22:40:06.675829+0000","last_became_peered":"2024-05-03T22:40:06.675829+0000","last_unstale":"2024-05-03T22:42:11.748610+0000","last_undegraded":"2024-05-03T22:42:11.748610+0000","last_fullsized":"2024-05-03T22:42:11.748610+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:06:23.890364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":115,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748184+0000","last_change":"2024-05-03T22:38:10.625763+0000","last_active":"2024-05-03T22:42:11.748184+0000","last_peered":"2024-05-03T22:42:11.748184+0000","last_clean":"2024-05-03T22:42:11.748184+0000","last_became_active":"2024-05-03T22:38:10.607711+0000","last_became_peered":"2024-05-03T22:38:10.607711+0000","last_unstale":"2024-05-03T22:42:11.748184+0000","last_undegraded":"2024-05-03T22:42:11.748184+0000","last_fullsized":"2024-05-03T22:42:11.748184+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:33:25.181816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:33:25.181816+0000","last_clean_scrub_stamp":"2024-05-03T22:33:25.181816+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:10:54.973897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749336+0000","last_change":"2024-05-03T22:41:11.623002+0000","last_active":"2024-05-03T22:42:11.749336+0000","last_peered":"2024-05-03T22:42:11.749336+0000","last_clean":"2024-05-03T22:42:11.749336+0000","last_became_active":"2024-05-03T22:41:11.621904+0000","last_became_peered":"2024-05-03T22:41:11.621904+0000","last_unstale":"2024-05-03T22:42:11.749336+0000","last_undegraded":"2024-05-03T22:42:11.749336+0000","last_fullsized":"2024-05-03T22:42:11.749336+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:01:12.917296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.442292+0000","last_change":"2024-05-03T22:42:11.440087+0000","last_active":"2024-05-03T22:42:11.442292+0000","last_peered":"2024-05-03T22:42:11.442292+0000","last_clean":"2024-05-03T22:42:11.442292+0000","last_became_active":"2024-05-03T22:42:11.438630+0000","last_became_peered":"2024-05-03T22:42:11.438630+0000","last_unstale":"2024-05-03T22:42:11.442292+0000","last_undegraded":"2024-05-03T22:42:11.442292+0000","last_fullsized":"2024-05-03T22:42:11.442292+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:21:37.660638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":55,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748282+0000","last_change":"2024-05-03T22:41:10.787499+0000","last_active":"2024-05-03T22:42:11.748282+0000","last_peered":"2024-05-03T22:42:11.748282+0000","last_clean":"2024-05-03T22:42:11.748282+0000","last_became_active":"2024-05-03T22:41:10.786987+0000","last_became_peered":"2024-05-03T22:41:10.786987+0000","last_unstale":"2024-05-03T22:42:11.748282+0000","last_undegraded":"2024-05-03T22:42:11.748282+0000","last_fullsized":"2024-05-03T22:42:11.748282+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:18:39.460516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.533977+0000","last_change":"2024-05-03T22:40:25.072522+0000","last_active":"2024-05-03T22:42:11.533977+0000","last_peered":"2024-05-03T22:42:11.533977+0000","last_clean":"2024-05-03T22:42:11.533977+0000","last_became_active":"2024-05-03T22:40:25.071988+0000","last_became_peered":"2024-05-03T22:40:25.071988+0000","last_unstale":"2024-05-03T22:42:11.533977+0000","last_undegraded":"2024-05-03T22:42:11.533977+0000","last_fullsized":"2024-05-03T22:42:11.533977+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:36:49.992077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'4","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433575+0000","last_change":"2024-05-03T22:40:06.748316+0000","last_active":"2024-05-03T22:42:11.433575+0000","last_peered":"2024-05-03T22:42:11.433575+0000","last_clean":"2024-05-03T22:42:11.433575+0000","last_became_active":"2024-05-03T22:40:06.747321+0000","last_became_peered":"2024-05-03T22:40:06.747321+0000","last_unstale":"2024-05-03T22:42:11.433575+0000","last_undegraded":"2024-05-03T22:42:11.433575+0000","last_fullsized":"2024-05-03T22:42:11.433575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:59:52.305810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433571+0000","last_change":"2024-05-03T22:40:11.773115+0000","last_active":"2024-05-03T22:42:11.433571+0000","last_peered":"2024-05-03T22:42:11.433571+0000","last_clean":"2024-05-03T22:42:11.433571+0000","last_became_active":"2024-05-03T22:40:11.771352+0000","last_became_peered":"2024-05-03T22:40:11.771352+0000","last_unstale":"2024-05-03T22:42:11.433571+0000","last_undegraded":"2024-05-03T22:42:11.433571+0000","last_fullsized":"2024-05-03T22:42:11.433571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:24:36.913141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748044+0000","last_change":"2024-05-03T22:40:25.083290+0000","last_active":"2024-05-03T22:42:11.748044+0000","last_peered":"2024-05-03T22:42:11.748044+0000","last_clean":"2024-05-03T22:42:11.748044+0000","last_became_active":"2024-05-03T22:40:25.077556+0000","last_became_peered":"2024-05-03T22:40:25.077556+0000","last_unstale":"2024-05-03T22:42:11.748044+0000","last_undegraded":"2024-05-03T22:42:11.748044+0000","last_fullsized":"2024-05-03T22:42:11.748044+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:43.848783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'13","reported_seq":68,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428450+0000","last_change":"2024-05-03T22:41:10.795185+0000","last_active":"2024-05-03T22:42:11.428450+0000","last_peered":"2024-05-03T22:42:11.428450+0000","last_clean":"2024-05-03T22:42:11.428450+0000","last_became_active":"2024-05-03T22:41:10.790617+0000","last_became_peered":"2024-05-03T22:41:10.790617+0000","last_unstale":"2024-05-03T22:42:11.428450+0000","last_undegraded":"2024-05-03T22:42:11.428450+0000","last_fullsized":"2024-05-03T22:42:11.428450+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:15:00.364227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749052+0000","last_change":"2024-05-03T22:40:11.769663+0000","last_active":"2024-05-03T22:42:11.749052+0000","last_peered":"2024-05-03T22:42:11.749052+0000","last_clean":"2024-05-03T22:42:11.749052+0000","last_became_active":"2024-05-03T22:40:11.769330+0000","last_became_peered":"2024-05-03T22:40:11.769330+0000","last_unstale":"2024-05-03T22:42:11.749052+0000","last_undegraded":"2024-05-03T22:42:11.749052+0000","last_fullsized":"2024-05-03T22:42:11.749052+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:44:12.326952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425096+0000","last_change":"2024-05-03T22:40:25.079604+0000","last_active":"2024-05-03T22:42:11.425096+0000","last_peered":"2024-05-03T22:42:11.425096+0000","last_clean":"2024-05-03T22:42:11.425096+0000","last_became_active":"2024-05-03T22:40:25.076067+0000","last_became_peered":"2024-05-03T22:40:25.076067+0000","last_unstale":"2024-05-03T22:42:11.425096+0000","last_undegraded":"2024-05-03T22:42:11.425096+0000","last_fullsized":"2024-05-03T22:42:11.425096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:27:03.905659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":53,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749519+0000","last_change":"2024-05-03T22:40:07.327718+0000","last_active":"2024-05-03T22:42:11.749519+0000","last_peered":"2024-05-03T22:42:11.749519+0000","last_clean":"2024-05-03T22:42:11.749519+0000","last_became_active":"2024-05-03T22:40:07.326930+0000","last_became_peered":"2024-05-03T22:40:07.326930+0000","last_unstale":"2024-05-03T22:42:11.749519+0000","last_undegraded":"2024-05-03T22:42:11.749519+0000","last_fullsized":"2024-05-03T22:42:11.749519+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:46:55.497971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740939+0000","last_change":"2024-05-03T22:40:11.766023+0000","last_active":"2024-05-03T22:42:11.740939+0000","last_peered":"2024-05-03T22:42:11.740939+0000","last_clean":"2024-05-03T22:42:11.740939+0000","last_became_active":"2024-05-03T22:40:11.765263+0000","last_became_peered":"2024-05-03T22:40:11.765263+0000","last_unstale":"2024-05-03T22:42:11.740939+0000","last_undegraded":"2024-05-03T22:42:11.740939+0000","last_fullsized":"2024-05-03T22:42:11.740939+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:55.002669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748779+0000","last_change":"2024-05-03T22:40:25.085411+0000","last_active":"2024-05-03T22:42:11.748779+0000","last_peered":"2024-05-03T22:42:11.748779+0000","last_clean":"2024-05-03T22:42:11.748779+0000","last_became_active":"2024-05-03T22:40:25.084813+0000","last_became_peered":"2024-05-03T22:40:25.084813+0000","last_unstale":"2024-05-03T22:42:11.748779+0000","last_undegraded":"2024-05-03T22:42:11.748779+0000","last_fullsized":"2024-05-03T22:42:11.748779+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:41:38.455648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439805+0000","last_change":"2024-05-03T22:40:06.748099+0000","last_active":"2024-05-03T22:42:11.439805+0000","last_peered":"2024-05-03T22:42:11.439805+0000","last_clean":"2024-05-03T22:42:11.439805+0000","last_became_active":"2024-05-03T22:40:06.747702+0000","last_became_peered":"2024-05-03T22:40:06.747702+0000","last_unstale":"2024-05-03T22:42:11.439805+0000","last_undegraded":"2024-05-03T22:42:11.439805+0000","last_fullsized":"2024-05-03T22:42:11.439805+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:12:09.736986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.432862+0000","last_change":"2024-05-03T22:40:11.780914+0000","last_active":"2024-05-03T22:42:11.432862+0000","last_peered":"2024-05-03T22:42:11.432862+0000","last_clean":"2024-05-03T22:42:11.432862+0000","last_became_active":"2024-05-03T22:40:11.780481+0000","last_became_peered":"2024-05-03T22:40:11.780481+0000","last_unstale":"2024-05-03T22:42:11.432862+0000","last_undegraded":"2024-05-03T22:42:11.432862+0000","last_fullsized":"2024-05-03T22:42:11.432862+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:34:11.676590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428816+0000","last_change":"2024-05-03T22:40:25.091028+0000","last_active":"2024-05-03T22:42:11.428816+0000","last_peered":"2024-05-03T22:42:11.428816+0000","last_clean":"2024-05-03T22:42:11.428816+0000","last_became_active":"2024-05-03T22:40:25.090516+0000","last_became_peered":"2024-05-03T22:40:25.090516+0000","last_unstale":"2024-05-03T22:42:11.428816+0000","last_undegraded":"2024-05-03T22:42:11.428816+0000","last_fullsized":"2024-05-03T22:42:11.428816+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:16:17.803991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'7","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748234+0000","last_change":"2024-05-03T22:40:06.686659+0000","last_active":"2024-05-03T22:42:11.748234+0000","last_peered":"2024-05-03T22:42:11.748234+0000","last_clean":"2024-05-03T22:42:11.748234+0000","last_became_active":"2024-05-03T22:40:06.686049+0000","last_became_peered":"2024-05-03T22:40:06.686049+0000","last_unstale":"2024-05-03T22:42:11.748234+0000","last_undegraded":"2024-05-03T22:42:11.748234+0000","last_fullsized":"2024-05-03T22:42:11.748234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:18:52.198642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534600+0000","last_change":"2024-05-03T22:40:11.770188+0000","last_active":"2024-05-03T22:42:11.534600+0000","last_peered":"2024-05-03T22:42:11.534600+0000","last_clean":"2024-05-03T22:42:11.534600+0000","last_became_active":"2024-05-03T22:40:11.769792+0000","last_became_peered":"2024-05-03T22:40:11.769792+0000","last_unstale":"2024-05-03T22:42:11.534600+0000","last_undegraded":"2024-05-03T22:42:11.534600+0000","last_fullsized":"2024-05-03T22:42:11.534600+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:33:44.917398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748335+0000","last_change":"2024-05-03T22:40:25.086799+0000","last_active":"2024-05-03T22:42:11.748335+0000","last_peered":"2024-05-03T22:42:11.748335+0000","last_clean":"2024-05-03T22:42:11.748335+0000","last_became_active":"2024-05-03T22:40:25.086318+0000","last_became_peered":"2024-05-03T22:40:25.086318+0000","last_unstale":"2024-05-03T22:42:11.748335+0000","last_undegraded":"2024-05-03T22:42:11.748335+0000","last_fullsized":"2024-05-03T22:42:11.748335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:58.895616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"87'3","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425939+0000","last_change":"2024-05-03T22:40:06.687143+0000","last_active":"2024-05-03T22:42:11.425939+0000","last_peered":"2024-05-03T22:42:11.425939+0000","last_clean":"2024-05-03T22:42:11.425939+0000","last_became_active":"2024-05-03T22:40:06.686479+0000","last_became_peered":"2024-05-03T22:40:06.686479+0000","last_unstale":"2024-05-03T22:42:11.425939+0000","last_undegraded":"2024-05-03T22:42:11.425939+0000","last_fullsized":"2024-05-03T22:42:11.425939+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:23:11.325334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748613+0000","last_change":"2024-05-03T22:40:11.766225+0000","last_active":"2024-05-03T22:42:11.748613+0000","last_peered":"2024-05-03T22:42:11.748613+0000","last_clean":"2024-05-03T22:42:11.748613+0000","last_became_active":"2024-05-03T22:40:11.765888+0000","last_became_peered":"2024-05-03T22:40:11.765888+0000","last_unstale":"2024-05-03T22:42:11.748613+0000","last_undegraded":"2024-05-03T22:42:11.748613+0000","last_fullsized":"2024-05-03T22:42:11.748613+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:12:31.300562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749071+0000","last_change":"2024-05-03T22:40:25.081276+0000","last_active":"2024-05-03T22:42:11.749071+0000","last_peered":"2024-05-03T22:42:11.749071+0000","last_clean":"2024-05-03T22:42:11.749071+0000","last_became_active":"2024-05-03T22:40:25.080766+0000","last_became_peered":"2024-05-03T22:40:25.080766+0000","last_unstale":"2024-05-03T22:42:11.749071+0000","last_undegraded":"2024-05-03T22:42:11.749071+0000","last_fullsized":"2024-05-03T22:42:11.749071+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:54:49.970169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":59,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433010+0000","last_change":"2024-05-03T22:41:10.790834+0000","last_active":"2024-05-03T22:42:11.433010+0000","last_peered":"2024-05-03T22:42:11.433010+0000","last_clean":"2024-05-03T22:42:11.433010+0000","last_became_active":"2024-05-03T22:41:10.777613+0000","last_became_peered":"2024-05-03T22:41:10.777613+0000","last_unstale":"2024-05-03T22:42:11.433010+0000","last_undegraded":"2024-05-03T22:42:11.433010+0000","last_fullsized":"2024-05-03T22:42:11.433010+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:28:12.000819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749885+0000","last_change":"2024-05-03T22:40:11.779626+0000","last_active":"2024-05-03T22:42:11.749885+0000","last_peered":"2024-05-03T22:42:11.749885+0000","last_clean":"2024-05-03T22:42:11.749885+0000","last_became_active":"2024-05-03T22:40:11.779232+0000","last_became_peered":"2024-05-03T22:40:11.779232+0000","last_unstale":"2024-05-03T22:42:11.749885+0000","last_undegraded":"2024-05-03T22:42:11.749885+0000","last_fullsized":"2024-05-03T22:42:11.749885+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:46:09.507758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.438960+0000","last_change":"2024-05-03T22:40:25.079098+0000","last_active":"2024-05-03T22:42:11.438960+0000","last_peered":"2024-05-03T22:42:11.438960+0000","last_clean":"2024-05-03T22:42:11.438960+0000","last_became_active":"2024-05-03T22:40:25.078646+0000","last_became_peered":"2024-05-03T22:40:25.078646+0000","last_unstale":"2024-05-03T22:42:11.438960+0000","last_undegraded":"2024-05-03T22:42:11.438960+0000","last_fullsized":"2024-05-03T22:42:11.438960+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:54:17.938515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"87'6","reported_seq":89,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:17.341680+0000","last_change":"2024-05-03T22:40:07.327901+0000","last_active":"2024-05-03T22:42:17.341680+0000","last_peered":"2024-05-03T22:42:17.341680+0000","last_clean":"2024-05-03T22:42:17.341680+0000","last_became_active":"2024-05-03T22:40:07.326619+0000","last_became_peered":"2024-05-03T22:40:07.326619+0000","last_unstale":"2024-05-03T22:42:17.341680+0000","last_undegraded":"2024-05-03T22:42:17.341680+0000","last_fullsized":"2024-05-03T22:42:17.341680+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:38:00.537433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750378+0000","last_change":"2024-05-03T22:40:11.783624+0000","last_active":"2024-05-03T22:42:11.750378+0000","last_peered":"2024-05-03T22:42:11.750378+0000","last_clean":"2024-05-03T22:42:11.750378+0000","last_became_active":"2024-05-03T22:40:11.779891+0000","last_became_peered":"2024-05-03T22:40:11.779891+0000","last_unstale":"2024-05-03T22:42:11.750378+0000","last_undegraded":"2024-05-03T22:42:11.750378+0000","last_fullsized":"2024-05-03T22:42:11.750378+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:54:05.069207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740444+0000","last_change":"2024-05-03T22:40:25.089793+0000","last_active":"2024-05-03T22:42:11.740444+0000","last_peered":"2024-05-03T22:42:11.740444+0000","last_clean":"2024-05-03T22:42:11.740444+0000","last_became_active":"2024-05-03T22:40:25.087879+0000","last_became_peered":"2024-05-03T22:40:25.087879+0000","last_unstale":"2024-05-03T22:42:11.740444+0000","last_undegraded":"2024-05-03T22:42:11.740444+0000","last_fullsized":"2024-05-03T22:42:11.740444+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:36:39.533480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"87'3","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749243+0000","last_change":"2024-05-03T22:40:06.679093+0000","last_active":"2024-05-03T22:42:11.749243+0000","last_peered":"2024-05-03T22:42:11.749243+0000","last_clean":"2024-05-03T22:42:11.749243+0000","last_became_active":"2024-05-03T22:40:06.677527+0000","last_became_peered":"2024-05-03T22:40:06.677527+0000","last_unstale":"2024-05-03T22:42:11.749243+0000","last_undegraded":"2024-05-03T22:42:11.749243+0000","last_fullsized":"2024-05-03T22:42:11.749243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:26:34.600615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749570+0000","last_change":"2024-05-03T22:40:11.774786+0000","last_active":"2024-05-03T22:42:11.749570+0000","last_peered":"2024-05-03T22:42:11.749570+0000","last_clean":"2024-05-03T22:42:11.749570+0000","last_became_active":"2024-05-03T22:40:11.767060+0000","last_became_peered":"2024-05-03T22:40:11.767060+0000","last_unstale":"2024-05-03T22:42:11.749570+0000","last_undegraded":"2024-05-03T22:42:11.749570+0000","last_fullsized":"2024-05-03T22:42:11.749570+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:28:47.576215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748244+0000","last_change":"2024-05-03T22:40:25.076231+0000","last_active":"2024-05-03T22:42:11.748244+0000","last_peered":"2024-05-03T22:42:11.748244+0000","last_clean":"2024-05-03T22:42:11.748244+0000","last_became_active":"2024-05-03T22:40:25.075787+0000","last_became_peered":"2024-05-03T22:40:25.075787+0000","last_unstale":"2024-05-03T22:42:11.748244+0000","last_undegraded":"2024-05-03T22:42:11.748244+0000","last_fullsized":"2024-05-03T22:42:11.748244+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:17:10.068772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":59,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.436842+0000","last_change":"2024-05-03T22:41:11.174406+0000","last_active":"2024-05-03T22:42:11.436842+0000","last_peered":"2024-05-03T22:42:11.436842+0000","last_clean":"2024-05-03T22:42:11.436842+0000","last_became_active":"2024-05-03T22:41:11.166209+0000","last_became_peered":"2024-05-03T22:41:11.166209+0000","last_unstale":"2024-05-03T22:42:11.436842+0000","last_undegraded":"2024-05-03T22:42:11.436842+0000","last_fullsized":"2024-05-03T22:42:11.436842+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:35:06.117972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750556+0000","last_change":"2024-05-03T22:40:11.781047+0000","last_active":"2024-05-03T22:42:11.750556+0000","last_peered":"2024-05-03T22:42:11.750556+0000","last_clean":"2024-05-03T22:42:11.750556+0000","last_became_active":"2024-05-03T22:40:11.779374+0000","last_became_peered":"2024-05-03T22:40:11.779374+0000","last_unstale":"2024-05-03T22:42:11.750556+0000","last_undegraded":"2024-05-03T22:42:11.750556+0000","last_fullsized":"2024-05-03T22:42:11.750556+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:18:35.718495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534982+0000","last_change":"2024-05-03T22:40:11.773640+0000","last_active":"2024-05-03T22:42:11.534982+0000","last_peered":"2024-05-03T22:42:11.534982+0000","last_clean":"2024-05-03T22:42:11.534982+0000","last_became_active":"2024-05-03T22:40:11.772554+0000","last_became_peered":"2024-05-03T22:40:11.772554+0000","last_unstale":"2024-05-03T22:42:11.534982+0000","last_undegraded":"2024-05-03T22:42:11.534982+0000","last_fullsized":"2024-05-03T22:42:11.534982+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:19:24.593238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425429+0000","last_change":"2024-05-03T22:41:10.787952+0000","last_active":"2024-05-03T22:42:11.425429+0000","last_peered":"2024-05-03T22:42:11.425429+0000","last_clean":"2024-05-03T22:42:11.425429+0000","last_became_active":"2024-05-03T22:41:10.787399+0000","last_became_peered":"2024-05-03T22:41:10.787399+0000","last_unstale":"2024-05-03T22:42:11.425429+0000","last_undegraded":"2024-05-03T22:42:11.425429+0000","last_fullsized":"2024-05-03T22:42:11.425429+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:56:00.722885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426316+0000","last_change":"2024-05-03T22:40:11.767997+0000","last_active":"2024-05-03T22:42:11.426316+0000","last_peered":"2024-05-03T22:42:11.426316+0000","last_clean":"2024-05-03T22:42:11.426316+0000","last_became_active":"2024-05-03T22:40:11.765779+0000","last_became_peered":"2024-05-03T22:40:11.765779+0000","last_unstale":"2024-05-03T22:42:11.426316+0000","last_undegraded":"2024-05-03T22:42:11.426316+0000","last_fullsized":"2024-05-03T22:42:11.426316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:46:57.126690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740670+0000","last_change":"2024-05-03T22:40:11.774012+0000","last_active":"2024-05-03T22:42:11.740670+0000","last_peered":"2024-05-03T22:42:11.740670+0000","last_clean":"2024-05-03T22:42:11.740670+0000","last_became_active":"2024-05-03T22:40:11.771152+0000","last_became_peered":"2024-05-03T22:40:11.771152+0000","last_unstale":"2024-05-03T22:42:11.740670+0000","last_undegraded":"2024-05-03T22:42:11.740670+0000","last_fullsized":"2024-05-03T22:42:11.740670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:44:27.905860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433737+0000","last_change":"2024-05-03T22:40:11.772190+0000","last_active":"2024-05-03T22:42:11.433737+0000","last_peered":"2024-05-03T22:42:11.433737+0000","last_clean":"2024-05-03T22:42:11.433737+0000","last_became_active":"2024-05-03T22:40:11.771788+0000","last_became_peered":"2024-05-03T22:40:11.771788+0000","last_unstale":"2024-05-03T22:42:11.433737+0000","last_undegraded":"2024-05-03T22:42:11.433737+0000","last_fullsized":"2024-05-03T22:42:11.433737+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:55:47.610034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.535123+0000","last_change":"2024-05-03T22:40:11.776770+0000","last_active":"2024-05-03T22:42:11.535123+0000","last_peered":"2024-05-03T22:42:11.535123+0000","last_clean":"2024-05-03T22:42:11.535123+0000","last_became_active":"2024-05-03T22:40:11.773644+0000","last_became_peered":"2024-05-03T22:40:11.773644+0000","last_unstale":"2024-05-03T22:42:11.535123+0000","last_undegraded":"2024-05-03T22:42:11.535123+0000","last_fullsized":"2024-05-03T22:42:11.535123+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:15:38.145066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426376+0000","last_change":"2024-05-03T22:40:11.771708+0000","last_active":"2024-05-03T22:42:11.426376+0000","last_peered":"2024-05-03T22:42:11.426376+0000","last_clean":"2024-05-03T22:42:11.426376+0000","last_became_active":"2024-05-03T22:40:11.770806+0000","last_became_peered":"2024-05-03T22:40:11.770806+0000","last_unstale":"2024-05-03T22:42:11.426376+0000","last_undegraded":"2024-05-03T22:42:11.426376+0000","last_fullsized":"2024-05-03T22:42:11.426376+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:25:46.219330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749167+0000","last_change":"2024-05-03T22:40:11.773209+0000","last_active":"2024-05-03T22:42:11.749167+0000","last_peered":"2024-05-03T22:42:11.749167+0000","last_clean":"2024-05-03T22:42:11.749167+0000","last_became_active":"2024-05-03T22:40:11.771783+0000","last_became_peered":"2024-05-03T22:40:11.771783+0000","last_unstale":"2024-05-03T22:42:11.749167+0000","last_undegraded":"2024-05-03T22:42:11.749167+0000","last_fullsized":"2024-05-03T22:42:11.749167+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:06:28.133378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748454+0000","last_change":"2024-05-03T22:40:11.771988+0000","last_active":"2024-05-03T22:42:11.748454+0000","last_peered":"2024-05-03T22:42:11.748454+0000","last_clean":"2024-05-03T22:42:11.748454+0000","last_became_active":"2024-05-03T22:40:11.771542+0000","last_became_peered":"2024-05-03T22:40:11.771542+0000","last_unstale":"2024-05-03T22:42:11.748454+0000","last_undegraded":"2024-05-03T22:42:11.748454+0000","last_fullsized":"2024-05-03T22:42:11.748454+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:31:59.912571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748204+0000","last_change":"2024-05-03T22:40:11.762129+0000","last_active":"2024-05-03T22:42:11.748204+0000","last_peered":"2024-05-03T22:42:11.748204+0000","last_clean":"2024-05-03T22:42:11.748204+0000","last_became_active":"2024-05-03T22:40:11.761770+0000","last_became_peered":"2024-05-03T22:40:11.761770+0000","last_unstale":"2024-05-03T22:42:11.748204+0000","last_undegraded":"2024-05-03T22:42:11.748204+0000","last_fullsized":"2024-05-03T22:42:11.748204+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:02:10.618602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439814+0000","last_change":"2024-05-03T22:40:11.788411+0000","last_active":"2024-05-03T22:42:11.439814+0000","last_peered":"2024-05-03T22:42:11.439814+0000","last_clean":"2024-05-03T22:42:11.439814+0000","last_became_active":"2024-05-03T22:40:11.785013+0000","last_became_peered":"2024-05-03T22:40:11.785013+0000","last_unstale":"2024-05-03T22:42:11.439814+0000","last_undegraded":"2024-05-03T22:42:11.439814+0000","last_fullsized":"2024-05-03T22:42:11.439814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:36:41.638224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.432001+0000","last_change":"2024-05-03T22:40:11.773992+0000","last_active":"2024-05-03T22:42:11.432001+0000","last_peered":"2024-05-03T22:42:11.432001+0000","last_clean":"2024-05-03T22:42:11.432001+0000","last_became_active":"2024-05-03T22:40:11.772926+0000","last_became_peered":"2024-05-03T22:40:11.772926+0000","last_unstale":"2024-05-03T22:42:11.432001+0000","last_undegraded":"2024-05-03T22:42:11.432001+0000","last_fullsized":"2024-05-03T22:42:11.432001+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:02:57.215605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534770+0000","last_change":"2024-05-03T22:40:11.777987+0000","last_active":"2024-05-03T22:42:11.534770+0000","last_peered":"2024-05-03T22:42:11.534770+0000","last_clean":"2024-05-03T22:42:11.534770+0000","last_became_active":"2024-05-03T22:40:11.774177+0000","last_became_peered":"2024-05-03T22:40:11.774177+0000","last_unstale":"2024-05-03T22:42:11.534770+0000","last_undegraded":"2024-05-03T22:42:11.534770+0000","last_fullsized":"2024-05-03T22:42:11.534770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:21:57.332460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65766,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":389,"num_read_kb":268,"num_write":244,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":197298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710765,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":516983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906997,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37028,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708124,"statfs":{"total":95995035648,"available":95957118976,"internally_reserved":0,"allocated":1724416,"data_stored":1161773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070524,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":520030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266755,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1052672,"data_stored":516312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462986,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1646592,"data_stored":1112221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626512,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":511438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1097728,"data_stored":571030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738489,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":513285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411438,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1118208,"data_stored":571641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182502,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1044480,"data_stored":511146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986271,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1040384,"data_stored":515903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822744,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32804,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712348,"statfs":{"total":95995035648,"available":95961444352,"internally_reserved":0,"allocated":1658880,"data_stored":1108000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-03T22:42:22.221 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-03T22:42:22.333 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:22 smithi044 ceph-mon[28604]: pgmap v445: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 10 op/s 2024-05-03T22:42:22.333 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:22 smithi044 ceph-mon[28604]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:42:22.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:22 smithi060 ceph-mon[31721]: pgmap v445: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 10 op/s 2024-05-03T22:42:22.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:22 smithi060 ceph-mon[31721]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:42:22.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:22 smithi160 ceph-mon[32531]: pgmap v445: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 921 B/s wr, 10 op/s 2024-05-03T22:42:22.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:22 smithi160 ceph-mon[32531]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:42:22.725 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:24.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:24 smithi044 ceph-mon[28604]: pgmap v446: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 706 B/s wr, 9 op/s 2024-05-03T22:42:24.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:24 smithi060 ceph-mon[31721]: pgmap v446: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 706 B/s wr, 9 op/s 2024-05-03T22:42:24.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:24 smithi160 ceph-mon[32531]: pgmap v446: 129 pgs: 129 active+clean; 641 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 706 B/s wr, 9 op/s 2024-05-03T22:42:25.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.177+0000 7f11bfa00700 1 -- 172.21.15.44:0/2160507587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11b8102d60 msgr2=0x7f11b810f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:25.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.177+0000 7f11bfa00700 1 --2- 172.21.15.44:0/2160507587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11b8102d60 0x7f11b810f250 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f11b000b0a0 tx=0x7f11b000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:42:25.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.177+0000 7f11bfa00700 1 -- 172.21.15.44:0/2160507587 shutdown_connections 2024-05-03T22:42:25.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.177+0000 7f11bfa00700 1 --2- 172.21.15.44:0/2160507587 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11b8102d60 0x7f11b810f250 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:25.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.177+0000 7f11bfa00700 1 --2- 172.21.15.44:0/2160507587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b8108410 0x7f11b81087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:25.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.177+0000 7f11bfa00700 1 --2- 172.21.15.44:0/2160507587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11b81023a0 0x7f11b8102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:25.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.177+0000 7f11bfa00700 1 -- 172.21.15.44:0/2160507587 >> 172.21.15.44:0/2160507587 conn(0x7f11b8079350 msgr2=0x7f11b8079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:25.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.177+0000 7f11bfa00700 1 -- 172.21.15.44:0/2160507587 shutdown_connections 2024-05-03T22:42:25.180 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.178+0000 7f11bfa00700 1 -- 172.21.15.44:0/2160507587 wait complete. 2024-05-03T22:42:25.181 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.179+0000 7f11bfa00700 1 Processor -- start 2024-05-03T22:42:25.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.179+0000 7f11bfa00700 1 -- start start 2024-05-03T22:42:25.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.179+0000 7f11bfa00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b81023a0 0x7f11b819caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:25.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.179+0000 7f11bfa00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11b8102d60 0x7f11b819d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:25.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.179+0000 7f11bfa00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11b8108410 0x7f11b81a79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:25.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.179+0000 7f11bfa00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81115f0 con 0x7f11b8102d60 2024-05-03T22:42:25.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.179+0000 7f11bfa00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f11b806c0b0 con 0x7f11b81023a0 2024-05-03T22:42:25.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.179+0000 7f11bfa00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f11b8111770 con 0x7f11b8108410 2024-05-03T22:42:25.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.180+0000 7f11b7e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11b8102d60 0x7f11b819d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:25.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.180+0000 7f11b7e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11b8102d60 0x7f11b819d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47636/0 (socket says 172.21.15.44:47636) 2024-05-03T22:42:25.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.180+0000 7f11b7e00700 1 -- 172.21.15.44:0/2390434520 learned_addr learned my addr 172.21.15.44:0/2390434520 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:42:25.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.180+0000 7f11bd000700 1 --2- 172.21.15.44:0/2390434520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b81023a0 0x7f11b819caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:25.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.180+0000 7f11bda00700 1 --2- 172.21.15.44:0/2390434520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11b8108410 0x7f11b81a79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:25.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.180+0000 7f11b7e00700 1 -- 172.21.15.44:0/2390434520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11b8108410 msgr2=0x7f11b81a79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:25.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.180+0000 7f11b7e00700 1 --2- 172.21.15.44:0/2390434520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11b8108410 0x7f11b81a79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:25.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.180+0000 7f11b7e00700 1 -- 172.21.15.44:0/2390434520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b81023a0 msgr2=0x7f11b819caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:25.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.180+0000 7f11b7e00700 1 --2- 172.21.15.44:0/2390434520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b81023a0 0x7f11b819caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:25.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.180+0000 7f11b7e00700 1 -- 172.21.15.44:0/2390434520 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b81a80d0 con 0x7f11b8102d60 2024-05-03T22:42:25.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.181+0000 7f11b7e00700 1 --2- 172.21.15.44:0/2390434520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11b8102d60 0x7f11b819d030 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f11a400d980 tx=0x7f11a400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:25.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.181+0000 7f11b5600700 1 -- 172.21.15.44:0/2390434520 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a4017070 con 0x7f11b8102d60 2024-05-03T22:42:25.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.181+0000 7f11b5600700 1 -- 172.21.15.44:0/2390434520 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f11a4005020 con 0x7f11b8102d60 2024-05-03T22:42:25.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.181+0000 7f11bfa00700 1 -- 172.21.15.44:0/2390434520 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b81a83c0 con 0x7f11b8102d60 2024-05-03T22:42:25.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.181+0000 7f11b5600700 1 -- 172.21.15.44:0/2390434520 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a400fb30 con 0x7f11b8102d60 2024-05-03T22:42:25.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.181+0000 7f11bfa00700 1 -- 172.21.15.44:0/2390434520 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b81a8900 con 0x7f11b8102d60 2024-05-03T22:42:25.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.182+0000 7f11bfa00700 1 -- 172.21.15.44:0/2390434520 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11b806a190 con 0x7f11b8102d60 2024-05-03T22:42:25.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.185+0000 7f11b5600700 1 -- 172.21.15.44:0/2390434520 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f11a400fcd0 con 0x7f11b8102d60 2024-05-03T22:42:25.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.186+0000 7f11b5600700 1 --2- 172.21.15.44:0/2390434520 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f11a00b2990 0x7f11a00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:25.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.186+0000 7f11b5600700 1 -- 172.21.15.44:0/2390434520 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f11a40e2a10 con 0x7f11b8102d60 2024-05-03T22:42:25.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.187+0000 7f11bd000700 1 --2- 172.21.15.44:0/2390434520 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f11a00b2990 0x7f11a00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:25.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.187+0000 7f11bd000700 1 --2- 172.21.15.44:0/2390434520 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f11a00b2990 0x7f11a00b4e50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f11ac005950 tx=0x7f11ac00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:25.190 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.189+0000 7f11b5600700 1 -- 172.21.15.44:0/2390434520 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f11a4020020 con 0x7f11b8102d60 2024-05-03T22:42:25.425 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.423+0000 7f11bfa00700 1 -- 172.21.15.44:0/2390434520 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f11b80638e0 con 0x7f11a00b2990 2024-05-03T22:42:25.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.440+0000 7f11b5600700 1 -- 172.21.15.44:0/2390434520 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340443 (secure 0 0 0) 0x7f11b80638e0 con 0x7f11a00b2990 2024-05-03T22:42:25.447 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:42:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.446+0000 7f11bfa00700 1 -- 172.21.15.44:0/2390434520 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f11a00b2990 msgr2=0x7f11a00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.446+0000 7f11bfa00700 1 --2- 172.21.15.44:0/2390434520 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f11a00b2990 0x7f11a00b4e50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f11ac005950 tx=0x7f11ac00b410 comp rx=0 tx=0).stop 2024-05-03T22:42:25.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.447+0000 7f11bfa00700 1 -- 172.21.15.44:0/2390434520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11b8102d60 msgr2=0x7f11b819d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:25.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.447+0000 7f11bfa00700 1 --2- 172.21.15.44:0/2390434520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11b8102d60 0x7f11b819d030 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f11a400d980 tx=0x7f11a400dc90 comp rx=0 tx=0).stop 2024-05-03T22:42:25.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.447+0000 7f11bfa00700 1 -- 172.21.15.44:0/2390434520 shutdown_connections 2024-05-03T22:42:25.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.447+0000 7f11bfa00700 1 --2- 172.21.15.44:0/2390434520 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f11a00b2990 0x7f11a00b4e50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:25.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.447+0000 7f11bfa00700 1 --2- 172.21.15.44:0/2390434520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11b8108410 0x7f11b81a79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:25.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.447+0000 7f11bfa00700 1 --2- 172.21.15.44:0/2390434520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11b81023a0 0x7f11b819caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:25.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.447+0000 7f11bfa00700 1 --2- 172.21.15.44:0/2390434520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f11b8102d60 0x7f11b819d030 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:25.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.447+0000 7f11bfa00700 1 -- 172.21.15.44:0/2390434520 >> 172.21.15.44:0/2390434520 conn(0x7f11b8079350 msgr2=0x7f11b8101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:25.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.447+0000 7f11bfa00700 1 -- 172.21.15.44:0/2390434520 shutdown_connections 2024-05-03T22:42:25.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:25.447+0000 7f11bfa00700 1 -- 172.21.15.44:0/2390434520 wait complete. 2024-05-03T22:42:25.450 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-05-03T22:42:26.344 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:26 smithi044 ceph-mon[28604]: pgmap v447: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 852 B/s wr, 11 op/s 2024-05-03T22:42:26.405 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":447,"stamp":"2024-05-03T22:42:25.016234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658020,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":516,"num_read_kb":359,"num_write":370,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":307,"ondisk_log_size":307,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384252,"kb_used_data":14228,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557572,"statfs":{"total":1151940427776,"available":1151546953728,"internally_reserved":0,"allocated":14569472,"data_stored":8133066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6955,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":75,"num_write":5,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004967"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.535408+0000","last_change":"2024-05-03T22:40:11.775947+0000","last_active":"2024-05-03T22:42:11.535408+0000","last_peered":"2024-05-03T22:42:11.535408+0000","last_clean":"2024-05-03T22:42:11.535408+0000","last_became_active":"2024-05-03T22:40:11.770836+0000","last_became_peered":"2024-05-03T22:40:11.770836+0000","last_unstale":"2024-05-03T22:42:11.535408+0000","last_undegraded":"2024-05-03T22:42:11.535408+0000","last_fullsized":"2024-05-03T22:42:11.535408+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:38:36.107368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740907+0000","last_change":"2024-05-03T22:40:11.781597+0000","last_active":"2024-05-03T22:42:11.740907+0000","last_peered":"2024-05-03T22:42:11.740907+0000","last_clean":"2024-05-03T22:42:11.740907+0000","last_became_active":"2024-05-03T22:40:11.781160+0000","last_became_peered":"2024-05-03T22:40:11.781160+0000","last_unstale":"2024-05-03T22:42:11.740907+0000","last_undegraded":"2024-05-03T22:42:11.740907+0000","last_fullsized":"2024-05-03T22:42:11.740907+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:57:41.654999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740820+0000","last_change":"2024-05-03T22:40:11.776144+0000","last_active":"2024-05-03T22:42:11.740820+0000","last_peered":"2024-05-03T22:42:11.740820+0000","last_clean":"2024-05-03T22:42:11.740820+0000","last_became_active":"2024-05-03T22:40:11.775781+0000","last_became_peered":"2024-05-03T22:40:11.775781+0000","last_unstale":"2024-05-03T22:42:11.740820+0000","last_undegraded":"2024-05-03T22:42:11.740820+0000","last_fullsized":"2024-05-03T22:42:11.740820+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:48:33.774915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748883+0000","last_change":"2024-05-03T22:40:11.773680+0000","last_active":"2024-05-03T22:42:11.748883+0000","last_peered":"2024-05-03T22:42:11.748883+0000","last_clean":"2024-05-03T22:42:11.748883+0000","last_became_active":"2024-05-03T22:40:11.771779+0000","last_became_peered":"2024-05-03T22:40:11.771779+0000","last_unstale":"2024-05-03T22:42:11.748883+0000","last_undegraded":"2024-05-03T22:42:11.748883+0000","last_fullsized":"2024-05-03T22:42:11.748883+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:29:58.849141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433145+0000","last_change":"2024-05-03T22:40:11.770873+0000","last_active":"2024-05-03T22:42:11.433145+0000","last_peered":"2024-05-03T22:42:11.433145+0000","last_clean":"2024-05-03T22:42:11.433145+0000","last_became_active":"2024-05-03T22:40:11.770361+0000","last_became_peered":"2024-05-03T22:40:11.770361+0000","last_unstale":"2024-05-03T22:42:11.433145+0000","last_undegraded":"2024-05-03T22:42:11.433145+0000","last_fullsized":"2024-05-03T22:42:11.433145+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:24:11.038058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439751+0000","last_change":"2024-05-03T22:42:11.439751+0000","last_active":"2024-05-03T22:42:11.439751+0000","last_peered":"2024-05-03T22:42:11.439751+0000","last_clean":"2024-05-03T22:42:11.439751+0000","last_became_active":"2024-05-03T22:42:11.438556+0000","last_became_peered":"2024-05-03T22:42:11.438556+0000","last_unstale":"2024-05-03T22:42:11.439751+0000","last_undegraded":"2024-05-03T22:42:11.439751+0000","last_fullsized":"2024-05-03T22:42:11.439751+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:25:14.716559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749464+0000","last_change":"2024-05-03T22:40:11.772616+0000","last_active":"2024-05-03T22:42:11.749464+0000","last_peered":"2024-05-03T22:42:11.749464+0000","last_clean":"2024-05-03T22:42:11.749464+0000","last_became_active":"2024-05-03T22:40:11.772237+0000","last_became_peered":"2024-05-03T22:40:11.772237+0000","last_unstale":"2024-05-03T22:42:11.749464+0000","last_undegraded":"2024-05-03T22:42:11.749464+0000","last_fullsized":"2024-05-03T22:42:11.749464+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:36:36.825989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748124+0000","last_change":"2024-05-03T22:40:11.771192+0000","last_active":"2024-05-03T22:42:11.748124+0000","last_peered":"2024-05-03T22:42:11.748124+0000","last_clean":"2024-05-03T22:42:11.748124+0000","last_became_active":"2024-05-03T22:40:11.770820+0000","last_became_peered":"2024-05-03T22:40:11.770820+0000","last_unstale":"2024-05-03T22:42:11.748124+0000","last_undegraded":"2024-05-03T22:42:11.748124+0000","last_fullsized":"2024-05-03T22:42:11.748124+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:51:22.303448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.751423+0000","last_change":"2024-05-03T22:42:11.751423+0000","last_active":"2024-05-03T22:42:11.751423+0000","last_peered":"2024-05-03T22:42:11.751423+0000","last_clean":"2024-05-03T22:42:11.751423+0000","last_became_active":"2024-05-03T22:42:11.750956+0000","last_became_peered":"2024-05-03T22:42:11.750956+0000","last_unstale":"2024-05-03T22:42:11.751423+0000","last_undegraded":"2024-05-03T22:42:11.751423+0000","last_fullsized":"2024-05-03T22:42:11.751423+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:07:12.615712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.437447+0000","last_change":"2024-05-03T22:42:11.437447+0000","last_active":"2024-05-03T22:42:11.437447+0000","last_peered":"2024-05-03T22:42:11.437447+0000","last_clean":"2024-05-03T22:42:11.437447+0000","last_became_active":"2024-05-03T22:42:11.436202+0000","last_became_peered":"2024-05-03T22:42:11.436202+0000","last_unstale":"2024-05-03T22:42:11.437447+0000","last_undegraded":"2024-05-03T22:42:11.437447+0000","last_fullsized":"2024-05-03T22:42:11.437447+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:50:12.891083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750298+0000","last_change":"2024-05-03T22:40:11.781381+0000","last_active":"2024-05-03T22:42:11.750298+0000","last_peered":"2024-05-03T22:42:11.750298+0000","last_clean":"2024-05-03T22:42:11.750298+0000","last_became_active":"2024-05-03T22:40:11.779293+0000","last_became_peered":"2024-05-03T22:40:11.779293+0000","last_unstale":"2024-05-03T22:42:11.750298+0000","last_undegraded":"2024-05-03T22:42:11.750298+0000","last_fullsized":"2024-05-03T22:42:11.750298+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:54:12.774746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748734+0000","last_change":"2024-05-03T22:40:11.784059+0000","last_active":"2024-05-03T22:42:11.748734+0000","last_peered":"2024-05-03T22:42:11.748734+0000","last_clean":"2024-05-03T22:42:11.748734+0000","last_became_active":"2024-05-03T22:40:11.783674+0000","last_became_peered":"2024-05-03T22:40:11.783674+0000","last_unstale":"2024-05-03T22:42:11.748734+0000","last_undegraded":"2024-05-03T22:42:11.748734+0000","last_fullsized":"2024-05-03T22:42:11.748734+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:20:53.546365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.432169+0000","last_change":"2024-05-03T22:40:11.780950+0000","last_active":"2024-05-03T22:42:11.432169+0000","last_peered":"2024-05-03T22:42:11.432169+0000","last_clean":"2024-05-03T22:42:11.432169+0000","last_became_active":"2024-05-03T22:40:11.780434+0000","last_became_peered":"2024-05-03T22:40:11.780434+0000","last_unstale":"2024-05-03T22:42:11.432169+0000","last_undegraded":"2024-05-03T22:42:11.432169+0000","last_fullsized":"2024-05-03T22:42:11.432169+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:28:46.616675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740534+0000","last_change":"2024-05-03T22:40:11.785985+0000","last_active":"2024-05-03T22:42:11.740534+0000","last_peered":"2024-05-03T22:42:11.740534+0000","last_clean":"2024-05-03T22:42:11.740534+0000","last_became_active":"2024-05-03T22:40:11.785615+0000","last_became_peered":"2024-05-03T22:40:11.785615+0000","last_unstale":"2024-05-03T22:42:11.740534+0000","last_undegraded":"2024-05-03T22:42:11.740534+0000","last_fullsized":"2024-05-03T22:42:11.740534+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:51:19.038726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740606+0000","last_change":"2024-05-03T22:40:11.777142+0000","last_active":"2024-05-03T22:42:11.740606+0000","last_peered":"2024-05-03T22:42:11.740606+0000","last_clean":"2024-05-03T22:42:11.740606+0000","last_became_active":"2024-05-03T22:40:11.775364+0000","last_became_peered":"2024-05-03T22:40:11.775364+0000","last_unstale":"2024-05-03T22:42:11.740606+0000","last_undegraded":"2024-05-03T22:42:11.740606+0000","last_fullsized":"2024-05-03T22:42:11.740606+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:48:06.634135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439450+0000","last_change":"2024-05-03T22:40:11.774928+0000","last_active":"2024-05-03T22:42:11.439450+0000","last_peered":"2024-05-03T22:42:11.439450+0000","last_clean":"2024-05-03T22:42:11.439450+0000","last_became_active":"2024-05-03T22:40:11.772942+0000","last_became_peered":"2024-05-03T22:40:11.772942+0000","last_unstale":"2024-05-03T22:42:11.439450+0000","last_undegraded":"2024-05-03T22:42:11.439450+0000","last_fullsized":"2024-05-03T22:42:11.439450+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.054532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534896+0000","last_change":"2024-05-03T22:40:11.777739+0000","last_active":"2024-05-03T22:42:11.534896+0000","last_peered":"2024-05-03T22:42:11.534896+0000","last_clean":"2024-05-03T22:42:11.534896+0000","last_became_active":"2024-05-03T22:40:11.776615+0000","last_became_peered":"2024-05-03T22:40:11.776615+0000","last_unstale":"2024-05-03T22:42:11.534896+0000","last_undegraded":"2024-05-03T22:42:11.534896+0000","last_fullsized":"2024-05-03T22:42:11.534896+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:34:17.672863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428516+0000","last_change":"2024-05-03T22:40:11.778880+0000","last_active":"2024-05-03T22:42:11.428516+0000","last_peered":"2024-05-03T22:42:11.428516+0000","last_clean":"2024-05-03T22:42:11.428516+0000","last_became_active":"2024-05-03T22:40:11.776901+0000","last_became_peered":"2024-05-03T22:40:11.776901+0000","last_unstale":"2024-05-03T22:42:11.428516+0000","last_undegraded":"2024-05-03T22:42:11.428516+0000","last_fullsized":"2024-05-03T22:42:11.428516+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:55:47.849284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425961+0000","last_change":"2024-05-03T22:40:11.768612+0000","last_active":"2024-05-03T22:42:11.425961+0000","last_peered":"2024-05-03T22:42:11.425961+0000","last_clean":"2024-05-03T22:42:11.425961+0000","last_became_active":"2024-05-03T22:40:11.767553+0000","last_became_peered":"2024-05-03T22:40:11.767553+0000","last_unstale":"2024-05-03T22:42:11.425961+0000","last_undegraded":"2024-05-03T22:42:11.425961+0000","last_fullsized":"2024-05-03T22:42:11.425961+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:04:36.348401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425251+0000","last_change":"2024-05-03T22:40:25.088489+0000","last_active":"2024-05-03T22:42:11.425251+0000","last_peered":"2024-05-03T22:42:11.425251+0000","last_clean":"2024-05-03T22:42:11.425251+0000","last_became_active":"2024-05-03T22:40:25.087028+0000","last_became_peered":"2024-05-03T22:40:25.087028+0000","last_unstale":"2024-05-03T22:42:11.425251+0000","last_undegraded":"2024-05-03T22:42:11.425251+0000","last_fullsized":"2024-05-03T22:42:11.425251+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:38:00.084610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'13","reported_seq":97,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:19.337007+0000","last_change":"2024-05-03T22:40:06.682624+0000","last_active":"2024-05-03T22:42:19.337007+0000","last_peered":"2024-05-03T22:42:19.337007+0000","last_clean":"2024-05-03T22:42:19.337007+0000","last_became_active":"2024-05-03T22:40:06.682040+0000","last_became_peered":"2024-05-03T22:40:06.682040+0000","last_unstale":"2024-05-03T22:42:19.337007+0000","last_undegraded":"2024-05-03T22:42:19.337007+0000","last_fullsized":"2024-05-03T22:42:19.337007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:39:52.905802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748274+0000","last_change":"2024-05-03T22:40:11.771570+0000","last_active":"2024-05-03T22:42:11.748274+0000","last_peered":"2024-05-03T22:42:11.748274+0000","last_clean":"2024-05-03T22:42:11.748274+0000","last_became_active":"2024-05-03T22:40:11.771165+0000","last_became_peered":"2024-05-03T22:40:11.771165+0000","last_unstale":"2024-05-03T22:42:11.748274+0000","last_undegraded":"2024-05-03T22:42:11.748274+0000","last_fullsized":"2024-05-03T22:42:11.748274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:32:08.302284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749088+0000","last_change":"2024-05-03T22:40:25.081258+0000","last_active":"2024-05-03T22:42:11.749088+0000","last_peered":"2024-05-03T22:42:11.749088+0000","last_clean":"2024-05-03T22:42:11.749088+0000","last_became_active":"2024-05-03T22:40:25.080733+0000","last_became_peered":"2024-05-03T22:40:25.080733+0000","last_unstale":"2024-05-03T22:42:11.749088+0000","last_undegraded":"2024-05-03T22:42:11.749088+0000","last_fullsized":"2024-05-03T22:42:11.749088+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:46:13.570625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748957+0000","last_change":"2024-05-03T22:40:06.747674+0000","last_active":"2024-05-03T22:42:11.748957+0000","last_peered":"2024-05-03T22:42:11.748957+0000","last_clean":"2024-05-03T22:42:11.748957+0000","last_became_active":"2024-05-03T22:40:06.747267+0000","last_became_peered":"2024-05-03T22:40:06.747267+0000","last_unstale":"2024-05-03T22:42:11.748957+0000","last_undegraded":"2024-05-03T22:42:11.748957+0000","last_fullsized":"2024-05-03T22:42:11.748957+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:14:26.142063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740838+0000","last_change":"2024-05-03T22:40:11.769623+0000","last_active":"2024-05-03T22:42:11.740838+0000","last_peered":"2024-05-03T22:42:11.740838+0000","last_clean":"2024-05-03T22:42:11.740838+0000","last_became_active":"2024-05-03T22:40:11.769292+0000","last_became_peered":"2024-05-03T22:40:11.769292+0000","last_unstale":"2024-05-03T22:42:11.740838+0000","last_undegraded":"2024-05-03T22:42:11.740838+0000","last_fullsized":"2024-05-03T22:42:11.740838+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:37:49.533502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748372+0000","last_change":"2024-05-03T22:41:10.787906+0000","last_active":"2024-05-03T22:42:11.748372+0000","last_peered":"2024-05-03T22:42:11.748372+0000","last_clean":"2024-05-03T22:42:11.748372+0000","last_became_active":"2024-05-03T22:41:10.787233+0000","last_became_peered":"2024-05-03T22:41:10.787233+0000","last_unstale":"2024-05-03T22:42:11.748372+0000","last_undegraded":"2024-05-03T22:42:11.748372+0000","last_fullsized":"2024-05-03T22:42:11.748372+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:38:50.312605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'12","reported_seq":57,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433607+0000","last_change":"2024-05-03T22:40:06.685620+0000","last_active":"2024-05-03T22:42:11.433607+0000","last_peered":"2024-05-03T22:42:11.433607+0000","last_clean":"2024-05-03T22:42:11.433607+0000","last_became_active":"2024-05-03T22:40:06.684517+0000","last_became_peered":"2024-05-03T22:40:06.684517+0000","last_unstale":"2024-05-03T22:42:11.433607+0000","last_undegraded":"2024-05-03T22:42:11.433607+0000","last_fullsized":"2024-05-03T22:42:11.433607+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:59:26.303253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.438439+0000","last_change":"2024-05-03T22:40:11.778444+0000","last_active":"2024-05-03T22:42:11.438439+0000","last_peered":"2024-05-03T22:42:11.438439+0000","last_clean":"2024-05-03T22:42:11.438439+0000","last_became_active":"2024-05-03T22:40:11.778063+0000","last_became_peered":"2024-05-03T22:40:11.778063+0000","last_unstale":"2024-05-03T22:42:11.438439+0000","last_undegraded":"2024-05-03T22:42:11.438439+0000","last_fullsized":"2024-05-03T22:42:11.438439+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:35:53.638075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.751972+0000","last_change":"2024-05-03T22:41:11.625988+0000","last_active":"2024-05-03T22:42:11.751972+0000","last_peered":"2024-05-03T22:42:11.751972+0000","last_clean":"2024-05-03T22:42:11.751972+0000","last_became_active":"2024-05-03T22:41:11.624324+0000","last_became_peered":"2024-05-03T22:41:11.624324+0000","last_unstale":"2024-05-03T22:42:11.751972+0000","last_undegraded":"2024-05-03T22:42:11.751972+0000","last_fullsized":"2024-05-03T22:42:11.751972+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:25:34.600801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,10,3],"acting":[4,6,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"87'5","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433598+0000","last_change":"2024-05-03T22:40:06.690402+0000","last_active":"2024-05-03T22:42:11.433598+0000","last_peered":"2024-05-03T22:42:11.433598+0000","last_clean":"2024-05-03T22:42:11.433598+0000","last_became_active":"2024-05-03T22:40:06.689876+0000","last_became_peered":"2024-05-03T22:40:06.689876+0000","last_unstale":"2024-05-03T22:42:11.433598+0000","last_undegraded":"2024-05-03T22:42:11.433598+0000","last_fullsized":"2024-05-03T22:42:11.433598+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:28:36.929306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749188+0000","last_change":"2024-05-03T22:40:11.779901+0000","last_active":"2024-05-03T22:42:11.749188+0000","last_peered":"2024-05-03T22:42:11.749188+0000","last_clean":"2024-05-03T22:42:11.749188+0000","last_became_active":"2024-05-03T22:40:11.779565+0000","last_became_peered":"2024-05-03T22:40:11.779565+0000","last_unstale":"2024-05-03T22:42:11.749188+0000","last_undegraded":"2024-05-03T22:42:11.749188+0000","last_fullsized":"2024-05-03T22:42:11.749188+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:05:51.650569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425697+0000","last_change":"2024-05-03T22:40:25.080244+0000","last_active":"2024-05-03T22:42:11.425697+0000","last_peered":"2024-05-03T22:42:11.425697+0000","last_clean":"2024-05-03T22:42:11.425697+0000","last_became_active":"2024-05-03T22:40:25.079711+0000","last_became_peered":"2024-05-03T22:40:25.079711+0000","last_unstale":"2024-05-03T22:42:11.425697+0000","last_undegraded":"2024-05-03T22:42:11.425697+0000","last_fullsized":"2024-05-03T22:42:11.425697+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:15:55.577907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":89,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:19.346685+0000","last_change":"2024-05-03T22:40:06.686480+0000","last_active":"2024-05-03T22:42:19.346685+0000","last_peered":"2024-05-03T22:42:19.346685+0000","last_clean":"2024-05-03T22:42:19.346685+0000","last_became_active":"2024-05-03T22:40:06.685932+0000","last_became_peered":"2024-05-03T22:40:06.685932+0000","last_unstale":"2024-05-03T22:42:19.346685+0000","last_undegraded":"2024-05-03T22:42:19.346685+0000","last_fullsized":"2024-05-03T22:42:19.346685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:40:50.952599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.442450+0000","last_change":"2024-05-03T22:42:11.442450+0000","last_active":"2024-05-03T22:42:11.442450+0000","last_peered":"2024-05-03T22:42:11.442450+0000","last_clean":"2024-05-03T22:42:11.442450+0000","last_became_active":"2024-05-03T22:42:11.441682+0000","last_became_peered":"2024-05-03T22:42:11.441682+0000","last_unstale":"2024-05-03T22:42:11.442450+0000","last_undegraded":"2024-05-03T22:42:11.442450+0000","last_fullsized":"2024-05-03T22:42:11.442450+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:03:42.054789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426504+0000","last_change":"2024-05-03T22:40:25.086337+0000","last_active":"2024-05-03T22:42:11.426504+0000","last_peered":"2024-05-03T22:42:11.426504+0000","last_clean":"2024-05-03T22:42:11.426504+0000","last_became_active":"2024-05-03T22:40:25.085878+0000","last_became_peered":"2024-05-03T22:40:25.085878+0000","last_unstale":"2024-05-03T22:42:11.426504+0000","last_undegraded":"2024-05-03T22:42:11.426504+0000","last_fullsized":"2024-05-03T22:42:11.426504+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:54.855929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425617+0000","last_change":"2024-05-03T22:40:06.694509+0000","last_active":"2024-05-03T22:42:11.425617+0000","last_peered":"2024-05-03T22:42:11.425617+0000","last_clean":"2024-05-03T22:42:11.425617+0000","last_became_active":"2024-05-03T22:40:06.693782+0000","last_became_peered":"2024-05-03T22:40:06.693782+0000","last_unstale":"2024-05-03T22:42:11.425617+0000","last_undegraded":"2024-05-03T22:42:11.425617+0000","last_fullsized":"2024-05-03T22:42:11.425617+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:44:19.457506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748934+0000","last_change":"2024-05-03T22:40:11.777600+0000","last_active":"2024-05-03T22:42:11.748934+0000","last_peered":"2024-05-03T22:42:11.748934+0000","last_clean":"2024-05-03T22:42:11.748934+0000","last_became_active":"2024-05-03T22:40:11.777231+0000","last_became_peered":"2024-05-03T22:40:11.777231+0000","last_unstale":"2024-05-03T22:42:11.748934+0000","last_undegraded":"2024-05-03T22:42:11.748934+0000","last_fullsized":"2024-05-03T22:42:11.748934+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:47.701482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534423+0000","last_change":"2024-05-03T22:40:25.077289+0000","last_active":"2024-05-03T22:42:11.534423+0000","last_peered":"2024-05-03T22:42:11.534423+0000","last_clean":"2024-05-03T22:42:11.534423+0000","last_became_active":"2024-05-03T22:40:25.075368+0000","last_became_peered":"2024-05-03T22:40:25.075368+0000","last_unstale":"2024-05-03T22:42:11.534423+0000","last_undegraded":"2024-05-03T22:42:11.534423+0000","last_fullsized":"2024-05-03T22:42:11.534423+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:56:12.352251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.435138+0000","last_change":"2024-05-03T22:40:06.677202+0000","last_active":"2024-05-03T22:42:11.435138+0000","last_peered":"2024-05-03T22:42:11.435138+0000","last_clean":"2024-05-03T22:42:11.435138+0000","last_became_active":"2024-05-03T22:40:06.674152+0000","last_became_peered":"2024-05-03T22:40:06.674152+0000","last_unstale":"2024-05-03T22:42:11.435138+0000","last_undegraded":"2024-05-03T22:42:11.435138+0000","last_fullsized":"2024-05-03T22:42:11.435138+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:09:18.631126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.538163+0000","last_change":"2024-05-03T22:42:11.538163+0000","last_active":"2024-05-03T22:42:11.538163+0000","last_peered":"2024-05-03T22:42:11.538163+0000","last_clean":"2024-05-03T22:42:11.538163+0000","last_became_active":"2024-05-03T22:42:11.536762+0000","last_became_peered":"2024-05-03T22:42:11.536762+0000","last_unstale":"2024-05-03T22:42:11.538163+0000","last_undegraded":"2024-05-03T22:42:11.538163+0000","last_fullsized":"2024-05-03T22:42:11.538163+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:29:56.947667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740812+0000","last_change":"2024-05-03T22:40:25.076722+0000","last_active":"2024-05-03T22:42:11.740812+0000","last_peered":"2024-05-03T22:42:11.740812+0000","last_clean":"2024-05-03T22:42:11.740812+0000","last_became_active":"2024-05-03T22:40:25.076251+0000","last_became_peered":"2024-05-03T22:40:25.076251+0000","last_unstale":"2024-05-03T22:42:11.740812+0000","last_undegraded":"2024-05-03T22:42:11.740812+0000","last_fullsized":"2024-05-03T22:42:11.740812+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:34:12.236790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"87'3","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748364+0000","last_change":"2024-05-03T22:40:06.690531+0000","last_active":"2024-05-03T22:42:11.748364+0000","last_peered":"2024-05-03T22:42:11.748364+0000","last_clean":"2024-05-03T22:42:11.748364+0000","last_became_active":"2024-05-03T22:40:06.690110+0000","last_became_peered":"2024-05-03T22:40:06.690110+0000","last_unstale":"2024-05-03T22:42:11.748364+0000","last_undegraded":"2024-05-03T22:42:11.748364+0000","last_fullsized":"2024-05-03T22:42:11.748364+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:51.350473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428077+0000","last_change":"2024-05-03T22:40:11.774633+0000","last_active":"2024-05-03T22:42:11.428077+0000","last_peered":"2024-05-03T22:42:11.428077+0000","last_clean":"2024-05-03T22:42:11.428077+0000","last_became_active":"2024-05-03T22:40:11.774294+0000","last_became_peered":"2024-05-03T22:40:11.774294+0000","last_unstale":"2024-05-03T22:42:11.428077+0000","last_undegraded":"2024-05-03T22:42:11.428077+0000","last_fullsized":"2024-05-03T22:42:11.428077+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:11:56.967077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748063+0000","last_change":"2024-05-03T22:40:25.085649+0000","last_active":"2024-05-03T22:42:11.748063+0000","last_peered":"2024-05-03T22:42:11.748063+0000","last_clean":"2024-05-03T22:42:11.748063+0000","last_became_active":"2024-05-03T22:40:25.078260+0000","last_became_peered":"2024-05-03T22:40:25.078260+0000","last_unstale":"2024-05-03T22:42:11.748063+0000","last_undegraded":"2024-05-03T22:42:11.748063+0000","last_fullsized":"2024-05-03T22:42:11.748063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:29.040741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":128,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:22.354510+0000","last_change":"2024-05-03T22:40:06.688665+0000","last_active":"2024-05-03T22:42:22.354510+0000","last_peered":"2024-05-03T22:42:22.354510+0000","last_clean":"2024-05-03T22:42:22.354510+0000","last_became_active":"2024-05-03T22:40:06.687944+0000","last_became_peered":"2024-05-03T22:40:06.687944+0000","last_unstale":"2024-05-03T22:42:22.354510+0000","last_undegraded":"2024-05-03T22:42:22.354510+0000","last_fullsized":"2024-05-03T22:42:22.354510+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:14:43.679499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.441639+0000","last_change":"2024-05-03T22:40:11.774446+0000","last_active":"2024-05-03T22:42:11.441639+0000","last_peered":"2024-05-03T22:42:11.441639+0000","last_clean":"2024-05-03T22:42:11.441639+0000","last_became_active":"2024-05-03T22:40:11.774067+0000","last_became_peered":"2024-05-03T22:40:11.774067+0000","last_unstale":"2024-05-03T22:42:11.441639+0000","last_undegraded":"2024-05-03T22:42:11.441639+0000","last_fullsized":"2024-05-03T22:42:11.441639+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:31:34.747963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426234+0000","last_change":"2024-05-03T22:40:25.081436+0000","last_active":"2024-05-03T22:42:11.426234+0000","last_peered":"2024-05-03T22:42:11.426234+0000","last_clean":"2024-05-03T22:42:11.426234+0000","last_became_active":"2024-05-03T22:40:25.080961+0000","last_became_peered":"2024-05-03T22:40:25.080961+0000","last_unstale":"2024-05-03T22:42:11.426234+0000","last_undegraded":"2024-05-03T22:42:11.426234+0000","last_fullsized":"2024-05-03T22:42:11.426234+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:40:59.061298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750496+0000","last_change":"2024-05-03T22:40:06.694998+0000","last_active":"2024-05-03T22:42:11.750496+0000","last_peered":"2024-05-03T22:42:11.750496+0000","last_clean":"2024-05-03T22:42:11.750496+0000","last_became_active":"2024-05-03T22:40:06.691406+0000","last_became_peered":"2024-05-03T22:40:06.691406+0000","last_unstale":"2024-05-03T22:42:11.750496+0000","last_undegraded":"2024-05-03T22:42:11.750496+0000","last_fullsized":"2024-05-03T22:42:11.750496+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:14:31.905257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740793+0000","last_change":"2024-05-03T22:40:11.782311+0000","last_active":"2024-05-03T22:42:11.740793+0000","last_peered":"2024-05-03T22:42:11.740793+0000","last_clean":"2024-05-03T22:42:11.740793+0000","last_became_active":"2024-05-03T22:40:11.778580+0000","last_became_peered":"2024-05-03T22:40:11.778580+0000","last_unstale":"2024-05-03T22:42:11.740793+0000","last_undegraded":"2024-05-03T22:42:11.740793+0000","last_fullsized":"2024-05-03T22:42:11.740793+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:11:01.150639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748751+0000","last_change":"2024-05-03T22:41:11.166437+0000","last_active":"2024-05-03T22:42:11.748751+0000","last_peered":"2024-05-03T22:42:11.748751+0000","last_clean":"2024-05-03T22:42:11.748751+0000","last_became_active":"2024-05-03T22:41:11.165246+0000","last_became_peered":"2024-05-03T22:41:11.165246+0000","last_unstale":"2024-05-03T22:42:11.748751+0000","last_undegraded":"2024-05-03T22:42:11.748751+0000","last_fullsized":"2024-05-03T22:42:11.748751+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:37:25.103244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748797+0000","last_change":"2024-05-03T22:40:06.749132+0000","last_active":"2024-05-03T22:42:11.748797+0000","last_peered":"2024-05-03T22:42:11.748797+0000","last_clean":"2024-05-03T22:42:11.748797+0000","last_became_active":"2024-05-03T22:40:06.748356+0000","last_became_peered":"2024-05-03T22:40:06.748356+0000","last_unstale":"2024-05-03T22:42:11.748797+0000","last_undegraded":"2024-05-03T22:42:11.748797+0000","last_fullsized":"2024-05-03T22:42:11.748797+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:17:48.243084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439628+0000","last_change":"2024-05-03T22:40:11.781238+0000","last_active":"2024-05-03T22:42:11.439628+0000","last_peered":"2024-05-03T22:42:11.439628+0000","last_clean":"2024-05-03T22:42:11.439628+0000","last_became_active":"2024-05-03T22:40:11.780812+0000","last_became_peered":"2024-05-03T22:40:11.780812+0000","last_unstale":"2024-05-03T22:42:11.439628+0000","last_undegraded":"2024-05-03T22:42:11.439628+0000","last_fullsized":"2024-05-03T22:42:11.439628+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:26:25.470321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.430092+0000","last_change":"2024-05-03T22:40:25.084169+0000","last_active":"2024-05-03T22:42:11.430092+0000","last_peered":"2024-05-03T22:42:11.430092+0000","last_clean":"2024-05-03T22:42:11.430092+0000","last_became_active":"2024-05-03T22:40:25.083547+0000","last_became_peered":"2024-05-03T22:40:25.083547+0000","last_unstale":"2024-05-03T22:42:11.430092+0000","last_undegraded":"2024-05-03T22:42:11.430092+0000","last_fullsized":"2024-05-03T22:42:11.430092+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:43:46.218698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'36","reported_seq":169,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:22.368046+0000","last_change":"2024-05-03T22:40:06.692333+0000","last_active":"2024-05-03T22:42:22.368046+0000","last_peered":"2024-05-03T22:42:22.368046+0000","last_clean":"2024-05-03T22:42:22.368046+0000","last_became_active":"2024-05-03T22:40:06.691737+0000","last_became_peered":"2024-05-03T22:40:06.691737+0000","last_unstale":"2024-05-03T22:42:22.368046+0000","last_undegraded":"2024-05-03T22:42:22.368046+0000","last_fullsized":"2024-05-03T22:42:22.368046+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:41:39.669559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60214,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":89,"num_read_kb":104,"num_write":38,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433396+0000","last_change":"2024-05-03T22:40:11.782887+0000","last_active":"2024-05-03T22:42:11.433396+0000","last_peered":"2024-05-03T22:42:11.433396+0000","last_clean":"2024-05-03T22:42:11.433396+0000","last_became_active":"2024-05-03T22:40:11.782098+0000","last_became_peered":"2024-05-03T22:40:11.782098+0000","last_unstale":"2024-05-03T22:42:11.433396+0000","last_undegraded":"2024-05-03T22:42:11.433396+0000","last_fullsized":"2024-05-03T22:42:11.433396+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:07:14.661890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749437+0000","last_change":"2024-05-03T22:40:25.079794+0000","last_active":"2024-05-03T22:42:11.749437+0000","last_peered":"2024-05-03T22:42:11.749437+0000","last_clean":"2024-05-03T22:42:11.749437+0000","last_became_active":"2024-05-03T22:40:25.078516+0000","last_became_peered":"2024-05-03T22:40:25.078516+0000","last_unstale":"2024-05-03T22:42:11.749437+0000","last_undegraded":"2024-05-03T22:42:11.749437+0000","last_fullsized":"2024-05-03T22:42:11.749437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:55.775154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'9","reported_seq":55,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426119+0000","last_change":"2024-05-03T22:40:06.689509+0000","last_active":"2024-05-03T22:42:11.426119+0000","last_peered":"2024-05-03T22:42:11.426119+0000","last_clean":"2024-05-03T22:42:11.426119+0000","last_became_active":"2024-05-03T22:40:06.688937+0000","last_became_peered":"2024-05-03T22:40:06.688937+0000","last_unstale":"2024-05-03T22:42:11.426119+0000","last_undegraded":"2024-05-03T22:42:11.426119+0000","last_fullsized":"2024-05-03T22:42:11.426119+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:13:48.971563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.431676+0000","last_change":"2024-05-03T22:40:11.780448+0000","last_active":"2024-05-03T22:42:11.431676+0000","last_peered":"2024-05-03T22:42:11.431676+0000","last_clean":"2024-05-03T22:42:11.431676+0000","last_became_active":"2024-05-03T22:40:11.780030+0000","last_became_peered":"2024-05-03T22:40:11.780030+0000","last_unstale":"2024-05-03T22:42:11.431676+0000","last_undegraded":"2024-05-03T22:42:11.431676+0000","last_fullsized":"2024-05-03T22:42:11.431676+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:56.207342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534109+0000","last_change":"2024-05-03T22:40:25.075804+0000","last_active":"2024-05-03T22:42:11.534109+0000","last_peered":"2024-05-03T22:42:11.534109+0000","last_clean":"2024-05-03T22:42:11.534109+0000","last_became_active":"2024-05-03T22:40:25.075326+0000","last_became_peered":"2024-05-03T22:40:25.075326+0000","last_unstale":"2024-05-03T22:42:11.534109+0000","last_undegraded":"2024-05-03T22:42:11.534109+0000","last_fullsized":"2024-05-03T22:42:11.534109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:39:56.065804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"87'5","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748594+0000","last_change":"2024-05-03T22:40:06.690432+0000","last_active":"2024-05-03T22:42:11.748594+0000","last_peered":"2024-05-03T22:42:11.748594+0000","last_clean":"2024-05-03T22:42:11.748594+0000","last_became_active":"2024-05-03T22:40:06.688957+0000","last_became_peered":"2024-05-03T22:40:06.688957+0000","last_unstale":"2024-05-03T22:42:11.748594+0000","last_undegraded":"2024-05-03T22:42:11.748594+0000","last_fullsized":"2024-05-03T22:42:11.748594+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:59:22.523855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749913+0000","last_change":"2024-05-03T22:40:11.789816+0000","last_active":"2024-05-03T22:42:11.749913+0000","last_peered":"2024-05-03T22:42:11.749913+0000","last_clean":"2024-05-03T22:42:11.749913+0000","last_became_active":"2024-05-03T22:40:11.789439+0000","last_became_peered":"2024-05-03T22:40:11.789439+0000","last_unstale":"2024-05-03T22:42:11.749913+0000","last_undegraded":"2024-05-03T22:42:11.749913+0000","last_fullsized":"2024-05-03T22:42:11.749913+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:24:52.874791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428676+0000","last_change":"2024-05-03T22:40:25.091156+0000","last_active":"2024-05-03T22:42:11.428676+0000","last_peered":"2024-05-03T22:42:11.428676+0000","last_clean":"2024-05-03T22:42:11.428676+0000","last_became_active":"2024-05-03T22:40:25.090584+0000","last_became_peered":"2024-05-03T22:40:25.090584+0000","last_unstale":"2024-05-03T22:42:11.428676+0000","last_undegraded":"2024-05-03T22:42:11.428676+0000","last_fullsized":"2024-05-03T22:42:11.428676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:12:47.194197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":94,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:22.368387+0000","last_change":"2024-05-03T22:40:06.687847+0000","last_active":"2024-05-03T22:42:22.368387+0000","last_peered":"2024-05-03T22:42:22.368387+0000","last_clean":"2024-05-03T22:42:22.368387+0000","last_became_active":"2024-05-03T22:40:06.685784+0000","last_became_peered":"2024-05-03T22:40:06.685784+0000","last_unstale":"2024-05-03T22:42:22.368387+0000","last_undegraded":"2024-05-03T22:42:22.368387+0000","last_fullsized":"2024-05-03T22:42:22.368387+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:31:36.403709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748343+0000","last_change":"2024-05-03T22:40:11.777881+0000","last_active":"2024-05-03T22:42:11.748343+0000","last_peered":"2024-05-03T22:42:11.748343+0000","last_clean":"2024-05-03T22:42:11.748343+0000","last_became_active":"2024-05-03T22:40:11.777142+0000","last_became_peered":"2024-05-03T22:40:11.777142+0000","last_unstale":"2024-05-03T22:42:11.748343+0000","last_undegraded":"2024-05-03T22:42:11.748343+0000","last_fullsized":"2024-05-03T22:42:11.748343+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:43:19.150547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.437122+0000","last_change":"2024-05-03T22:40:25.072488+0000","last_active":"2024-05-03T22:42:11.437122+0000","last_peered":"2024-05-03T22:42:11.437122+0000","last_clean":"2024-05-03T22:42:11.437122+0000","last_became_active":"2024-05-03T22:40:25.072030+0000","last_became_peered":"2024-05-03T22:40:25.072030+0000","last_unstale":"2024-05-03T22:42:11.437122+0000","last_undegraded":"2024-05-03T22:42:11.437122+0000","last_fullsized":"2024-05-03T22:42:11.437122+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:01:13.875349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'17","reported_seq":62,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.432659+0000","last_change":"2024-05-03T22:40:06.748069+0000","last_active":"2024-05-03T22:42:11.432659+0000","last_peered":"2024-05-03T22:42:11.432659+0000","last_clean":"2024-05-03T22:42:11.432659+0000","last_became_active":"2024-05-03T22:40:06.747095+0000","last_became_peered":"2024-05-03T22:40:06.747095+0000","last_unstale":"2024-05-03T22:42:11.432659+0000","last_undegraded":"2024-05-03T22:42:11.432659+0000","last_fullsized":"2024-05-03T22:42:11.432659+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:56:39.715496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748752+0000","last_change":"2024-05-03T22:40:11.780695+0000","last_active":"2024-05-03T22:42:11.748752+0000","last_peered":"2024-05-03T22:42:11.748752+0000","last_clean":"2024-05-03T22:42:11.748752+0000","last_became_active":"2024-05-03T22:40:11.780103+0000","last_became_peered":"2024-05-03T22:40:11.780103+0000","last_unstale":"2024-05-03T22:42:11.748752+0000","last_undegraded":"2024-05-03T22:42:11.748752+0000","last_fullsized":"2024-05-03T22:42:11.748752+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:29:22.862772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748581+0000","last_change":"2024-05-03T22:40:25.088547+0000","last_active":"2024-05-03T22:42:11.748581+0000","last_peered":"2024-05-03T22:42:11.748581+0000","last_clean":"2024-05-03T22:42:11.748581+0000","last_became_active":"2024-05-03T22:40:25.088046+0000","last_became_peered":"2024-05-03T22:40:25.088046+0000","last_unstale":"2024-05-03T22:42:11.748581+0000","last_undegraded":"2024-05-03T22:42:11.748581+0000","last_fullsized":"2024-05-03T22:42:11.748581+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:18:15.904858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433451+0000","last_change":"2024-05-03T22:40:06.691109+0000","last_active":"2024-05-03T22:42:11.433451+0000","last_peered":"2024-05-03T22:42:11.433451+0000","last_clean":"2024-05-03T22:42:11.433451+0000","last_became_active":"2024-05-03T22:40:06.690539+0000","last_became_peered":"2024-05-03T22:40:06.690539+0000","last_unstale":"2024-05-03T22:42:11.433451+0000","last_undegraded":"2024-05-03T22:42:11.433451+0000","last_fullsized":"2024-05-03T22:42:11.433451+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:18:00.701472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534864+0000","last_change":"2024-05-03T22:40:11.774465+0000","last_active":"2024-05-03T22:42:11.534864+0000","last_peered":"2024-05-03T22:42:11.534864+0000","last_clean":"2024-05-03T22:42:11.534864+0000","last_became_active":"2024-05-03T22:40:11.772816+0000","last_became_peered":"2024-05-03T22:40:11.772816+0000","last_unstale":"2024-05-03T22:42:11.534864+0000","last_undegraded":"2024-05-03T22:42:11.534864+0000","last_fullsized":"2024-05-03T22:42:11.534864+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:14:28.206641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.432985+0000","last_change":"2024-05-03T22:40:25.089301+0000","last_active":"2024-05-03T22:42:11.432985+0000","last_peered":"2024-05-03T22:42:11.432985+0000","last_clean":"2024-05-03T22:42:11.432985+0000","last_became_active":"2024-05-03T22:40:25.086336+0000","last_became_peered":"2024-05-03T22:40:25.086336+0000","last_unstale":"2024-05-03T22:42:11.432985+0000","last_undegraded":"2024-05-03T22:42:11.432985+0000","last_fullsized":"2024-05-03T22:42:11.432985+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:25:07.377584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428951+0000","last_change":"2024-05-03T22:40:06.750880+0000","last_active":"2024-05-03T22:42:11.428951+0000","last_peered":"2024-05-03T22:42:11.428951+0000","last_clean":"2024-05-03T22:42:11.428951+0000","last_became_active":"2024-05-03T22:40:06.750288+0000","last_became_peered":"2024-05-03T22:40:06.750288+0000","last_unstale":"2024-05-03T22:42:11.428951+0000","last_undegraded":"2024-05-03T22:42:11.428951+0000","last_fullsized":"2024-05-03T22:42:11.428951+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:29:09.545101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.427517+0000","last_change":"2024-05-03T22:40:11.769141+0000","last_active":"2024-05-03T22:42:11.427517+0000","last_peered":"2024-05-03T22:42:11.427517+0000","last_clean":"2024-05-03T22:42:11.427517+0000","last_became_active":"2024-05-03T22:40:11.768778+0000","last_became_peered":"2024-05-03T22:40:11.768778+0000","last_unstale":"2024-05-03T22:42:11.427517+0000","last_undegraded":"2024-05-03T22:42:11.427517+0000","last_fullsized":"2024-05-03T22:42:11.427517+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:15:45.811547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.432978+0000","last_change":"2024-05-03T22:40:25.080100+0000","last_active":"2024-05-03T22:42:11.432978+0000","last_peered":"2024-05-03T22:42:11.432978+0000","last_clean":"2024-05-03T22:42:11.432978+0000","last_became_active":"2024-05-03T22:40:25.077009+0000","last_became_peered":"2024-05-03T22:40:25.077009+0000","last_unstale":"2024-05-03T22:42:11.432978+0000","last_undegraded":"2024-05-03T22:42:11.432978+0000","last_fullsized":"2024-05-03T22:42:11.432978+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:40:24.771677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"87'5","reported_seq":61,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:21.343441+0000","last_change":"2024-05-03T22:41:11.166956+0000","last_active":"2024-05-03T22:42:21.343441+0000","last_peered":"2024-05-03T22:42:21.343441+0000","last_clean":"2024-05-03T22:42:21.343441+0000","last_became_active":"2024-05-03T22:41:11.165811+0000","last_became_peered":"2024-05-03T22:41:11.165811+0000","last_unstale":"2024-05-03T22:42:21.343441+0000","last_undegraded":"2024-05-03T22:42:21.343441+0000","last_fullsized":"2024-05-03T22:42:21.343441+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:39:37.554975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426142+0000","last_change":"2024-05-03T22:40:11.776660+0000","last_active":"2024-05-03T22:42:11.426142+0000","last_peered":"2024-05-03T22:42:11.426142+0000","last_clean":"2024-05-03T22:42:11.426142+0000","last_became_active":"2024-05-03T22:40:11.775877+0000","last_became_peered":"2024-05-03T22:40:11.775877+0000","last_unstale":"2024-05-03T22:42:11.426142+0000","last_undegraded":"2024-05-03T22:42:11.426142+0000","last_fullsized":"2024-05-03T22:42:11.426142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:12:34.902276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.436393+0000","last_change":"2024-05-03T22:40:25.078900+0000","last_active":"2024-05-03T22:42:11.436393+0000","last_peered":"2024-05-03T22:42:11.436393+0000","last_clean":"2024-05-03T22:42:11.436393+0000","last_became_active":"2024-05-03T22:40:25.078440+0000","last_became_peered":"2024-05-03T22:40:25.078440+0000","last_unstale":"2024-05-03T22:42:11.436393+0000","last_undegraded":"2024-05-03T22:42:11.436393+0000","last_fullsized":"2024-05-03T22:42:11.436393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:04:02.204303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748648+0000","last_change":"2024-05-03T22:40:11.780141+0000","last_active":"2024-05-03T22:42:11.748648+0000","last_peered":"2024-05-03T22:42:11.748648+0000","last_clean":"2024-05-03T22:42:11.748648+0000","last_became_active":"2024-05-03T22:40:11.779740+0000","last_became_peered":"2024-05-03T22:40:11.779740+0000","last_unstale":"2024-05-03T22:42:11.748648+0000","last_undegraded":"2024-05-03T22:42:11.748648+0000","last_fullsized":"2024-05-03T22:42:11.748648+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:48:14.419409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:22.366969+0000","last_change":"2024-05-03T22:40:06.747825+0000","last_active":"2024-05-03T22:42:22.366969+0000","last_peered":"2024-05-03T22:42:22.366969+0000","last_clean":"2024-05-03T22:42:22.366969+0000","last_became_active":"2024-05-03T22:40:06.747345+0000","last_became_peered":"2024-05-03T22:40:06.747345+0000","last_unstale":"2024-05-03T22:42:22.366969+0000","last_undegraded":"2024-05-03T22:42:22.366969+0000","last_fullsized":"2024-05-03T22:42:22.366969+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:23:58.770807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750109+0000","last_change":"2024-05-03T22:40:25.076382+0000","last_active":"2024-05-03T22:42:11.750109+0000","last_peered":"2024-05-03T22:42:11.750109+0000","last_clean":"2024-05-03T22:42:11.750109+0000","last_became_active":"2024-05-03T22:40:25.075866+0000","last_became_peered":"2024-05-03T22:40:25.075866+0000","last_unstale":"2024-05-03T22:42:11.750109+0000","last_undegraded":"2024-05-03T22:42:11.750109+0000","last_fullsized":"2024-05-03T22:42:11.750109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:10:58.048190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748398+0000","last_change":"2024-05-03T22:40:11.768232+0000","last_active":"2024-05-03T22:42:11.748398+0000","last_peered":"2024-05-03T22:42:11.748398+0000","last_clean":"2024-05-03T22:42:11.748398+0000","last_became_active":"2024-05-03T22:40:11.767784+0000","last_became_peered":"2024-05-03T22:40:11.767784+0000","last_unstale":"2024-05-03T22:42:11.748398+0000","last_undegraded":"2024-05-03T22:42:11.748398+0000","last_fullsized":"2024-05-03T22:42:11.748398+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:37:41.299588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":54,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748610+0000","last_change":"2024-05-03T22:40:06.681934+0000","last_active":"2024-05-03T22:42:11.748610+0000","last_peered":"2024-05-03T22:42:11.748610+0000","last_clean":"2024-05-03T22:42:11.748610+0000","last_became_active":"2024-05-03T22:40:06.675829+0000","last_became_peered":"2024-05-03T22:40:06.675829+0000","last_unstale":"2024-05-03T22:42:11.748610+0000","last_undegraded":"2024-05-03T22:42:11.748610+0000","last_fullsized":"2024-05-03T22:42:11.748610+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:06:23.890364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":116,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748263+0000","last_change":"2024-05-03T22:38:10.625763+0000","last_active":"2024-05-03T22:42:11.748263+0000","last_peered":"2024-05-03T22:42:11.748263+0000","last_clean":"2024-05-03T22:42:11.748263+0000","last_became_active":"2024-05-03T22:38:10.607711+0000","last_became_peered":"2024-05-03T22:38:10.607711+0000","last_unstale":"2024-05-03T22:42:11.748263+0000","last_undegraded":"2024-05-03T22:42:11.748263+0000","last_fullsized":"2024-05-03T22:42:11.748263+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:33:25.181816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:33:25.181816+0000","last_clean_scrub_stamp":"2024-05-03T22:33:25.181816+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:10:54.973897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749336+0000","last_change":"2024-05-03T22:41:11.623002+0000","last_active":"2024-05-03T22:42:11.749336+0000","last_peered":"2024-05-03T22:42:11.749336+0000","last_clean":"2024-05-03T22:42:11.749336+0000","last_became_active":"2024-05-03T22:41:11.621904+0000","last_became_peered":"2024-05-03T22:41:11.621904+0000","last_unstale":"2024-05-03T22:42:11.749336+0000","last_undegraded":"2024-05-03T22:42:11.749336+0000","last_fullsized":"2024-05-03T22:42:11.749336+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:01:12.917296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.442292+0000","last_change":"2024-05-03T22:42:11.440087+0000","last_active":"2024-05-03T22:42:11.442292+0000","last_peered":"2024-05-03T22:42:11.442292+0000","last_clean":"2024-05-03T22:42:11.442292+0000","last_became_active":"2024-05-03T22:42:11.438630+0000","last_became_peered":"2024-05-03T22:42:11.438630+0000","last_unstale":"2024-05-03T22:42:11.442292+0000","last_undegraded":"2024-05-03T22:42:11.442292+0000","last_fullsized":"2024-05-03T22:42:11.442292+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:21:37.660638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":55,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748282+0000","last_change":"2024-05-03T22:41:10.787499+0000","last_active":"2024-05-03T22:42:11.748282+0000","last_peered":"2024-05-03T22:42:11.748282+0000","last_clean":"2024-05-03T22:42:11.748282+0000","last_became_active":"2024-05-03T22:41:10.786987+0000","last_became_peered":"2024-05-03T22:41:10.786987+0000","last_unstale":"2024-05-03T22:42:11.748282+0000","last_undegraded":"2024-05-03T22:42:11.748282+0000","last_fullsized":"2024-05-03T22:42:11.748282+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:18:39.460516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.533977+0000","last_change":"2024-05-03T22:40:25.072522+0000","last_active":"2024-05-03T22:42:11.533977+0000","last_peered":"2024-05-03T22:42:11.533977+0000","last_clean":"2024-05-03T22:42:11.533977+0000","last_became_active":"2024-05-03T22:40:25.071988+0000","last_became_peered":"2024-05-03T22:40:25.071988+0000","last_unstale":"2024-05-03T22:42:11.533977+0000","last_undegraded":"2024-05-03T22:42:11.533977+0000","last_fullsized":"2024-05-03T22:42:11.533977+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:36:49.992077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'4","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433575+0000","last_change":"2024-05-03T22:40:06.748316+0000","last_active":"2024-05-03T22:42:11.433575+0000","last_peered":"2024-05-03T22:42:11.433575+0000","last_clean":"2024-05-03T22:42:11.433575+0000","last_became_active":"2024-05-03T22:40:06.747321+0000","last_became_peered":"2024-05-03T22:40:06.747321+0000","last_unstale":"2024-05-03T22:42:11.433575+0000","last_undegraded":"2024-05-03T22:42:11.433575+0000","last_fullsized":"2024-05-03T22:42:11.433575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:59:52.305810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433571+0000","last_change":"2024-05-03T22:40:11.773115+0000","last_active":"2024-05-03T22:42:11.433571+0000","last_peered":"2024-05-03T22:42:11.433571+0000","last_clean":"2024-05-03T22:42:11.433571+0000","last_became_active":"2024-05-03T22:40:11.771352+0000","last_became_peered":"2024-05-03T22:40:11.771352+0000","last_unstale":"2024-05-03T22:42:11.433571+0000","last_undegraded":"2024-05-03T22:42:11.433571+0000","last_fullsized":"2024-05-03T22:42:11.433571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:24:36.913141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748044+0000","last_change":"2024-05-03T22:40:25.083290+0000","last_active":"2024-05-03T22:42:11.748044+0000","last_peered":"2024-05-03T22:42:11.748044+0000","last_clean":"2024-05-03T22:42:11.748044+0000","last_became_active":"2024-05-03T22:40:25.077556+0000","last_became_peered":"2024-05-03T22:40:25.077556+0000","last_unstale":"2024-05-03T22:42:11.748044+0000","last_undegraded":"2024-05-03T22:42:11.748044+0000","last_fullsized":"2024-05-03T22:42:11.748044+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:43.848783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'13","reported_seq":68,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428450+0000","last_change":"2024-05-03T22:41:10.795185+0000","last_active":"2024-05-03T22:42:11.428450+0000","last_peered":"2024-05-03T22:42:11.428450+0000","last_clean":"2024-05-03T22:42:11.428450+0000","last_became_active":"2024-05-03T22:41:10.790617+0000","last_became_peered":"2024-05-03T22:41:10.790617+0000","last_unstale":"2024-05-03T22:42:11.428450+0000","last_undegraded":"2024-05-03T22:42:11.428450+0000","last_fullsized":"2024-05-03T22:42:11.428450+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:15:00.364227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749106+0000","last_change":"2024-05-03T22:40:11.769663+0000","last_active":"2024-05-03T22:42:11.749106+0000","last_peered":"2024-05-03T22:42:11.749106+0000","last_clean":"2024-05-03T22:42:11.749106+0000","last_became_active":"2024-05-03T22:40:11.769330+0000","last_became_peered":"2024-05-03T22:40:11.769330+0000","last_unstale":"2024-05-03T22:42:11.749106+0000","last_undegraded":"2024-05-03T22:42:11.749106+0000","last_fullsized":"2024-05-03T22:42:11.749106+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:44:12.326952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425096+0000","last_change":"2024-05-03T22:40:25.079604+0000","last_active":"2024-05-03T22:42:11.425096+0000","last_peered":"2024-05-03T22:42:11.425096+0000","last_clean":"2024-05-03T22:42:11.425096+0000","last_became_active":"2024-05-03T22:40:25.076067+0000","last_became_peered":"2024-05-03T22:40:25.076067+0000","last_unstale":"2024-05-03T22:42:11.425096+0000","last_undegraded":"2024-05-03T22:42:11.425096+0000","last_fullsized":"2024-05-03T22:42:11.425096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:27:03.905659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":53,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749519+0000","last_change":"2024-05-03T22:40:07.327718+0000","last_active":"2024-05-03T22:42:11.749519+0000","last_peered":"2024-05-03T22:42:11.749519+0000","last_clean":"2024-05-03T22:42:11.749519+0000","last_became_active":"2024-05-03T22:40:07.326930+0000","last_became_peered":"2024-05-03T22:40:07.326930+0000","last_unstale":"2024-05-03T22:42:11.749519+0000","last_undegraded":"2024-05-03T22:42:11.749519+0000","last_fullsized":"2024-05-03T22:42:11.749519+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:46:55.497971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740985+0000","last_change":"2024-05-03T22:40:11.766023+0000","last_active":"2024-05-03T22:42:11.740985+0000","last_peered":"2024-05-03T22:42:11.740985+0000","last_clean":"2024-05-03T22:42:11.740985+0000","last_became_active":"2024-05-03T22:40:11.765263+0000","last_became_peered":"2024-05-03T22:40:11.765263+0000","last_unstale":"2024-05-03T22:42:11.740985+0000","last_undegraded":"2024-05-03T22:42:11.740985+0000","last_fullsized":"2024-05-03T22:42:11.740985+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:55.002669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748779+0000","last_change":"2024-05-03T22:40:25.085411+0000","last_active":"2024-05-03T22:42:11.748779+0000","last_peered":"2024-05-03T22:42:11.748779+0000","last_clean":"2024-05-03T22:42:11.748779+0000","last_became_active":"2024-05-03T22:40:25.084813+0000","last_became_peered":"2024-05-03T22:40:25.084813+0000","last_unstale":"2024-05-03T22:42:11.748779+0000","last_undegraded":"2024-05-03T22:42:11.748779+0000","last_fullsized":"2024-05-03T22:42:11.748779+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:41:38.455648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439805+0000","last_change":"2024-05-03T22:40:06.748099+0000","last_active":"2024-05-03T22:42:11.439805+0000","last_peered":"2024-05-03T22:42:11.439805+0000","last_clean":"2024-05-03T22:42:11.439805+0000","last_became_active":"2024-05-03T22:40:06.747702+0000","last_became_peered":"2024-05-03T22:40:06.747702+0000","last_unstale":"2024-05-03T22:42:11.439805+0000","last_undegraded":"2024-05-03T22:42:11.439805+0000","last_fullsized":"2024-05-03T22:42:11.439805+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:12:09.736986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433000+0000","last_change":"2024-05-03T22:40:11.780914+0000","last_active":"2024-05-03T22:42:11.433000+0000","last_peered":"2024-05-03T22:42:11.433000+0000","last_clean":"2024-05-03T22:42:11.433000+0000","last_became_active":"2024-05-03T22:40:11.780481+0000","last_became_peered":"2024-05-03T22:40:11.780481+0000","last_unstale":"2024-05-03T22:42:11.433000+0000","last_undegraded":"2024-05-03T22:42:11.433000+0000","last_fullsized":"2024-05-03T22:42:11.433000+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:34:11.676590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428816+0000","last_change":"2024-05-03T22:40:25.091028+0000","last_active":"2024-05-03T22:42:11.428816+0000","last_peered":"2024-05-03T22:42:11.428816+0000","last_clean":"2024-05-03T22:42:11.428816+0000","last_became_active":"2024-05-03T22:40:25.090516+0000","last_became_peered":"2024-05-03T22:40:25.090516+0000","last_unstale":"2024-05-03T22:42:11.428816+0000","last_undegraded":"2024-05-03T22:42:11.428816+0000","last_fullsized":"2024-05-03T22:42:11.428816+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:16:17.803991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'7","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748234+0000","last_change":"2024-05-03T22:40:06.686659+0000","last_active":"2024-05-03T22:42:11.748234+0000","last_peered":"2024-05-03T22:42:11.748234+0000","last_clean":"2024-05-03T22:42:11.748234+0000","last_became_active":"2024-05-03T22:40:06.686049+0000","last_became_peered":"2024-05-03T22:40:06.686049+0000","last_unstale":"2024-05-03T22:42:11.748234+0000","last_undegraded":"2024-05-03T22:42:11.748234+0000","last_fullsized":"2024-05-03T22:42:11.748234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:18:52.198642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534725+0000","last_change":"2024-05-03T22:40:11.770188+0000","last_active":"2024-05-03T22:42:11.534725+0000","last_peered":"2024-05-03T22:42:11.534725+0000","last_clean":"2024-05-03T22:42:11.534725+0000","last_became_active":"2024-05-03T22:40:11.769792+0000","last_became_peered":"2024-05-03T22:40:11.769792+0000","last_unstale":"2024-05-03T22:42:11.534725+0000","last_undegraded":"2024-05-03T22:42:11.534725+0000","last_fullsized":"2024-05-03T22:42:11.534725+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:33:44.917398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748335+0000","last_change":"2024-05-03T22:40:25.086799+0000","last_active":"2024-05-03T22:42:11.748335+0000","last_peered":"2024-05-03T22:42:11.748335+0000","last_clean":"2024-05-03T22:42:11.748335+0000","last_became_active":"2024-05-03T22:40:25.086318+0000","last_became_peered":"2024-05-03T22:40:25.086318+0000","last_unstale":"2024-05-03T22:42:11.748335+0000","last_undegraded":"2024-05-03T22:42:11.748335+0000","last_fullsized":"2024-05-03T22:42:11.748335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:58.895616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"87'3","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425939+0000","last_change":"2024-05-03T22:40:06.687143+0000","last_active":"2024-05-03T22:42:11.425939+0000","last_peered":"2024-05-03T22:42:11.425939+0000","last_clean":"2024-05-03T22:42:11.425939+0000","last_became_active":"2024-05-03T22:40:06.686479+0000","last_became_peered":"2024-05-03T22:40:06.686479+0000","last_unstale":"2024-05-03T22:42:11.425939+0000","last_undegraded":"2024-05-03T22:42:11.425939+0000","last_fullsized":"2024-05-03T22:42:11.425939+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:23:11.325334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748613+0000","last_change":"2024-05-03T22:40:11.766225+0000","last_active":"2024-05-03T22:42:11.748613+0000","last_peered":"2024-05-03T22:42:11.748613+0000","last_clean":"2024-05-03T22:42:11.748613+0000","last_became_active":"2024-05-03T22:40:11.765888+0000","last_became_peered":"2024-05-03T22:40:11.765888+0000","last_unstale":"2024-05-03T22:42:11.748613+0000","last_undegraded":"2024-05-03T22:42:11.748613+0000","last_fullsized":"2024-05-03T22:42:11.748613+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:12:31.300562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749071+0000","last_change":"2024-05-03T22:40:25.081276+0000","last_active":"2024-05-03T22:42:11.749071+0000","last_peered":"2024-05-03T22:42:11.749071+0000","last_clean":"2024-05-03T22:42:11.749071+0000","last_became_active":"2024-05-03T22:40:25.080766+0000","last_became_peered":"2024-05-03T22:40:25.080766+0000","last_unstale":"2024-05-03T22:42:11.749071+0000","last_undegraded":"2024-05-03T22:42:11.749071+0000","last_fullsized":"2024-05-03T22:42:11.749071+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:54:49.970169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":60,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433077+0000","last_change":"2024-05-03T22:41:10.790834+0000","last_active":"2024-05-03T22:42:11.433077+0000","last_peered":"2024-05-03T22:42:11.433077+0000","last_clean":"2024-05-03T22:42:11.433077+0000","last_became_active":"2024-05-03T22:41:10.777613+0000","last_became_peered":"2024-05-03T22:41:10.777613+0000","last_unstale":"2024-05-03T22:42:11.433077+0000","last_undegraded":"2024-05-03T22:42:11.433077+0000","last_fullsized":"2024-05-03T22:42:11.433077+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:28:12.000819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749939+0000","last_change":"2024-05-03T22:40:11.779626+0000","last_active":"2024-05-03T22:42:11.749939+0000","last_peered":"2024-05-03T22:42:11.749939+0000","last_clean":"2024-05-03T22:42:11.749939+0000","last_became_active":"2024-05-03T22:40:11.779232+0000","last_became_peered":"2024-05-03T22:40:11.779232+0000","last_unstale":"2024-05-03T22:42:11.749939+0000","last_undegraded":"2024-05-03T22:42:11.749939+0000","last_fullsized":"2024-05-03T22:42:11.749939+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:46:09.507758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.438960+0000","last_change":"2024-05-03T22:40:25.079098+0000","last_active":"2024-05-03T22:42:11.438960+0000","last_peered":"2024-05-03T22:42:11.438960+0000","last_clean":"2024-05-03T22:42:11.438960+0000","last_became_active":"2024-05-03T22:40:25.078646+0000","last_became_peered":"2024-05-03T22:40:25.078646+0000","last_unstale":"2024-05-03T22:42:11.438960+0000","last_undegraded":"2024-05-03T22:42:11.438960+0000","last_fullsized":"2024-05-03T22:42:11.438960+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:54:17.938515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"87'6","reported_seq":95,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:23.359942+0000","last_change":"2024-05-03T22:40:07.327901+0000","last_active":"2024-05-03T22:42:23.359942+0000","last_peered":"2024-05-03T22:42:23.359942+0000","last_clean":"2024-05-03T22:42:23.359942+0000","last_became_active":"2024-05-03T22:40:07.326619+0000","last_became_peered":"2024-05-03T22:40:07.326619+0000","last_unstale":"2024-05-03T22:42:23.359942+0000","last_undegraded":"2024-05-03T22:42:23.359942+0000","last_fullsized":"2024-05-03T22:42:23.359942+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:38:00.537433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750378+0000","last_change":"2024-05-03T22:40:11.783624+0000","last_active":"2024-05-03T22:42:11.750378+0000","last_peered":"2024-05-03T22:42:11.750378+0000","last_clean":"2024-05-03T22:42:11.750378+0000","last_became_active":"2024-05-03T22:40:11.779891+0000","last_became_peered":"2024-05-03T22:40:11.779891+0000","last_unstale":"2024-05-03T22:42:11.750378+0000","last_undegraded":"2024-05-03T22:42:11.750378+0000","last_fullsized":"2024-05-03T22:42:11.750378+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:54:05.069207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740444+0000","last_change":"2024-05-03T22:40:25.089793+0000","last_active":"2024-05-03T22:42:11.740444+0000","last_peered":"2024-05-03T22:42:11.740444+0000","last_clean":"2024-05-03T22:42:11.740444+0000","last_became_active":"2024-05-03T22:40:25.087879+0000","last_became_peered":"2024-05-03T22:40:25.087879+0000","last_unstale":"2024-05-03T22:42:11.740444+0000","last_undegraded":"2024-05-03T22:42:11.740444+0000","last_fullsized":"2024-05-03T22:42:11.740444+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:36:39.533480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"87'3","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749307+0000","last_change":"2024-05-03T22:40:06.679093+0000","last_active":"2024-05-03T22:42:11.749307+0000","last_peered":"2024-05-03T22:42:11.749307+0000","last_clean":"2024-05-03T22:42:11.749307+0000","last_became_active":"2024-05-03T22:40:06.677527+0000","last_became_peered":"2024-05-03T22:40:06.677527+0000","last_unstale":"2024-05-03T22:42:11.749307+0000","last_undegraded":"2024-05-03T22:42:11.749307+0000","last_fullsized":"2024-05-03T22:42:11.749307+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:26:34.600615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749570+0000","last_change":"2024-05-03T22:40:11.774786+0000","last_active":"2024-05-03T22:42:11.749570+0000","last_peered":"2024-05-03T22:42:11.749570+0000","last_clean":"2024-05-03T22:42:11.749570+0000","last_became_active":"2024-05-03T22:40:11.767060+0000","last_became_peered":"2024-05-03T22:40:11.767060+0000","last_unstale":"2024-05-03T22:42:11.749570+0000","last_undegraded":"2024-05-03T22:42:11.749570+0000","last_fullsized":"2024-05-03T22:42:11.749570+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:28:47.576215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748244+0000","last_change":"2024-05-03T22:40:25.076231+0000","last_active":"2024-05-03T22:42:11.748244+0000","last_peered":"2024-05-03T22:42:11.748244+0000","last_clean":"2024-05-03T22:42:11.748244+0000","last_became_active":"2024-05-03T22:40:25.075787+0000","last_became_peered":"2024-05-03T22:40:25.075787+0000","last_unstale":"2024-05-03T22:42:11.748244+0000","last_undegraded":"2024-05-03T22:42:11.748244+0000","last_fullsized":"2024-05-03T22:42:11.748244+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:17:10.068772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":60,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.436969+0000","last_change":"2024-05-03T22:41:11.174406+0000","last_active":"2024-05-03T22:42:11.436969+0000","last_peered":"2024-05-03T22:42:11.436969+0000","last_clean":"2024-05-03T22:42:11.436969+0000","last_became_active":"2024-05-03T22:41:11.166209+0000","last_became_peered":"2024-05-03T22:41:11.166209+0000","last_unstale":"2024-05-03T22:42:11.436969+0000","last_undegraded":"2024-05-03T22:42:11.436969+0000","last_fullsized":"2024-05-03T22:42:11.436969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:35:06.117972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750556+0000","last_change":"2024-05-03T22:40:11.781047+0000","last_active":"2024-05-03T22:42:11.750556+0000","last_peered":"2024-05-03T22:42:11.750556+0000","last_clean":"2024-05-03T22:42:11.750556+0000","last_became_active":"2024-05-03T22:40:11.779374+0000","last_became_peered":"2024-05-03T22:40:11.779374+0000","last_unstale":"2024-05-03T22:42:11.750556+0000","last_undegraded":"2024-05-03T22:42:11.750556+0000","last_fullsized":"2024-05-03T22:42:11.750556+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:18:35.718495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534982+0000","last_change":"2024-05-03T22:40:11.773640+0000","last_active":"2024-05-03T22:42:11.534982+0000","last_peered":"2024-05-03T22:42:11.534982+0000","last_clean":"2024-05-03T22:42:11.534982+0000","last_became_active":"2024-05-03T22:40:11.772554+0000","last_became_peered":"2024-05-03T22:40:11.772554+0000","last_unstale":"2024-05-03T22:42:11.534982+0000","last_undegraded":"2024-05-03T22:42:11.534982+0000","last_fullsized":"2024-05-03T22:42:11.534982+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:19:24.593238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425429+0000","last_change":"2024-05-03T22:41:10.787952+0000","last_active":"2024-05-03T22:42:11.425429+0000","last_peered":"2024-05-03T22:42:11.425429+0000","last_clean":"2024-05-03T22:42:11.425429+0000","last_became_active":"2024-05-03T22:41:10.787399+0000","last_became_peered":"2024-05-03T22:41:10.787399+0000","last_unstale":"2024-05-03T22:42:11.425429+0000","last_undegraded":"2024-05-03T22:42:11.425429+0000","last_fullsized":"2024-05-03T22:42:11.425429+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:56:00.722885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426316+0000","last_change":"2024-05-03T22:40:11.767997+0000","last_active":"2024-05-03T22:42:11.426316+0000","last_peered":"2024-05-03T22:42:11.426316+0000","last_clean":"2024-05-03T22:42:11.426316+0000","last_became_active":"2024-05-03T22:40:11.765779+0000","last_became_peered":"2024-05-03T22:40:11.765779+0000","last_unstale":"2024-05-03T22:42:11.426316+0000","last_undegraded":"2024-05-03T22:42:11.426316+0000","last_fullsized":"2024-05-03T22:42:11.426316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:46:57.126690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740670+0000","last_change":"2024-05-03T22:40:11.774012+0000","last_active":"2024-05-03T22:42:11.740670+0000","last_peered":"2024-05-03T22:42:11.740670+0000","last_clean":"2024-05-03T22:42:11.740670+0000","last_became_active":"2024-05-03T22:40:11.771152+0000","last_became_peered":"2024-05-03T22:40:11.771152+0000","last_unstale":"2024-05-03T22:42:11.740670+0000","last_undegraded":"2024-05-03T22:42:11.740670+0000","last_fullsized":"2024-05-03T22:42:11.740670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:44:27.905860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433863+0000","last_change":"2024-05-03T22:40:11.772190+0000","last_active":"2024-05-03T22:42:11.433863+0000","last_peered":"2024-05-03T22:42:11.433863+0000","last_clean":"2024-05-03T22:42:11.433863+0000","last_became_active":"2024-05-03T22:40:11.771788+0000","last_became_peered":"2024-05-03T22:40:11.771788+0000","last_unstale":"2024-05-03T22:42:11.433863+0000","last_undegraded":"2024-05-03T22:42:11.433863+0000","last_fullsized":"2024-05-03T22:42:11.433863+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:55:47.610034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.535280+0000","last_change":"2024-05-03T22:40:11.776770+0000","last_active":"2024-05-03T22:42:11.535280+0000","last_peered":"2024-05-03T22:42:11.535280+0000","last_clean":"2024-05-03T22:42:11.535280+0000","last_became_active":"2024-05-03T22:40:11.773644+0000","last_became_peered":"2024-05-03T22:40:11.773644+0000","last_unstale":"2024-05-03T22:42:11.535280+0000","last_undegraded":"2024-05-03T22:42:11.535280+0000","last_fullsized":"2024-05-03T22:42:11.535280+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:15:38.145066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426509+0000","last_change":"2024-05-03T22:40:11.771708+0000","last_active":"2024-05-03T22:42:11.426509+0000","last_peered":"2024-05-03T22:42:11.426509+0000","last_clean":"2024-05-03T22:42:11.426509+0000","last_became_active":"2024-05-03T22:40:11.770806+0000","last_became_peered":"2024-05-03T22:40:11.770806+0000","last_unstale":"2024-05-03T22:42:11.426509+0000","last_undegraded":"2024-05-03T22:42:11.426509+0000","last_fullsized":"2024-05-03T22:42:11.426509+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:25:46.219330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749291+0000","last_change":"2024-05-03T22:40:11.773209+0000","last_active":"2024-05-03T22:42:11.749291+0000","last_peered":"2024-05-03T22:42:11.749291+0000","last_clean":"2024-05-03T22:42:11.749291+0000","last_became_active":"2024-05-03T22:40:11.771783+0000","last_became_peered":"2024-05-03T22:40:11.771783+0000","last_unstale":"2024-05-03T22:42:11.749291+0000","last_undegraded":"2024-05-03T22:42:11.749291+0000","last_fullsized":"2024-05-03T22:42:11.749291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:06:28.133378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748547+0000","last_change":"2024-05-03T22:40:11.771988+0000","last_active":"2024-05-03T22:42:11.748547+0000","last_peered":"2024-05-03T22:42:11.748547+0000","last_clean":"2024-05-03T22:42:11.748547+0000","last_became_active":"2024-05-03T22:40:11.771542+0000","last_became_peered":"2024-05-03T22:40:11.771542+0000","last_unstale":"2024-05-03T22:42:11.748547+0000","last_undegraded":"2024-05-03T22:42:11.748547+0000","last_fullsized":"2024-05-03T22:42:11.748547+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:31:59.912571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748204+0000","last_change":"2024-05-03T22:40:11.762129+0000","last_active":"2024-05-03T22:42:11.748204+0000","last_peered":"2024-05-03T22:42:11.748204+0000","last_clean":"2024-05-03T22:42:11.748204+0000","last_became_active":"2024-05-03T22:40:11.761770+0000","last_became_peered":"2024-05-03T22:40:11.761770+0000","last_unstale":"2024-05-03T22:42:11.748204+0000","last_undegraded":"2024-05-03T22:42:11.748204+0000","last_fullsized":"2024-05-03T22:42:11.748204+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:02:10.618602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439814+0000","last_change":"2024-05-03T22:40:11.788411+0000","last_active":"2024-05-03T22:42:11.439814+0000","last_peered":"2024-05-03T22:42:11.439814+0000","last_clean":"2024-05-03T22:42:11.439814+0000","last_became_active":"2024-05-03T22:40:11.785013+0000","last_became_peered":"2024-05-03T22:40:11.785013+0000","last_unstale":"2024-05-03T22:42:11.439814+0000","last_undegraded":"2024-05-03T22:42:11.439814+0000","last_fullsized":"2024-05-03T22:42:11.439814+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:36:41.638224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.432001+0000","last_change":"2024-05-03T22:40:11.773992+0000","last_active":"2024-05-03T22:42:11.432001+0000","last_peered":"2024-05-03T22:42:11.432001+0000","last_clean":"2024-05-03T22:42:11.432001+0000","last_became_active":"2024-05-03T22:40:11.772926+0000","last_became_peered":"2024-05-03T22:40:11.772926+0000","last_unstale":"2024-05-03T22:42:11.432001+0000","last_undegraded":"2024-05-03T22:42:11.432001+0000","last_fullsized":"2024-05-03T22:42:11.432001+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:02:57.215605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534770+0000","last_change":"2024-05-03T22:40:11.777987+0000","last_active":"2024-05-03T22:42:11.534770+0000","last_peered":"2024-05-03T22:42:11.534770+0000","last_clean":"2024-05-03T22:42:11.534770+0000","last_became_active":"2024-05-03T22:40:11.774177+0000","last_became_peered":"2024-05-03T22:40:11.774177+0000","last_unstale":"2024-05-03T22:42:11.534770+0000","last_undegraded":"2024-05-03T22:42:11.534770+0000","last_fullsized":"2024-05-03T22:42:11.534770+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:21:57.332460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67418,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":440,"num_read_kb":295,"num_write":245,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":200602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":213,"ondisk_log_size":213,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710766,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":516983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906998,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37028,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708124,"statfs":{"total":95995035648,"available":95957118976,"internally_reserved":0,"allocated":1724416,"data_stored":1163425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070525,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":520030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266756,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1052672,"data_stored":516312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462987,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1646592,"data_stored":1112221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626513,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":511438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1097728,"data_stored":571030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738490,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":513285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411439,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1118208,"data_stored":573293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182503,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1044480,"data_stored":511146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986272,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1040384,"data_stored":515903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822745,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32804,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712348,"statfs":{"total":95995035648,"available":95961444352,"internally_reserved":0,"allocated":1658880,"data_stored":1108000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-03T22:42:26.409 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-03T22:42:26.410 INFO:tasks.cephadm:Setting up client nodes... 2024-05-03T22:42:26.410 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-03T22:42:26.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:26 smithi060 ceph-mon[31721]: pgmap v447: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 852 B/s wr, 11 op/s 2024-05-03T22:42:26.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:26 smithi160 ceph-mon[32531]: pgmap v447: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 852 B/s wr, 11 op/s 2024-05-03T22:42:26.926 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:27.409 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:27 smithi044 ceph-mon[28604]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:42:27.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:27 smithi060 ceph-mon[31721]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:42:27.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:27 smithi160 ceph-mon[32531]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:42:28.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:28 smithi044 ceph-mon[28604]: pgmap v448: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-03T22:42:28.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:28 smithi060 ceph-mon[31721]: pgmap v448: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-03T22:42:28.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:28 smithi160 ceph-mon[32531]: pgmap v448: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-03T22:42:29.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.357+0000 7f126e000700 1 -- 172.21.15.44:0/3087693701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1268075f00 msgr2=0x7f1268076380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:29.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.357+0000 7f126e000700 1 --2- 172.21.15.44:0/3087693701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1268075f00 0x7f1268076380 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1254009990 tx=0x7f1254009ca0 comp rx=0 tx=0).stop 2024-05-03T22:42:29.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.357+0000 7f126e000700 1 -- 172.21.15.44:0/3087693701 shutdown_connections 2024-05-03T22:42:29.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.357+0000 7f126e000700 1 --2- 172.21.15.44:0/3087693701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f126810f950 0x7f1268111d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:29.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.357+0000 7f126e000700 1 --2- 172.21.15.44:0/3087693701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12680774d0 0x7f1268075930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:29.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.357+0000 7f126e000700 1 --2- 172.21.15.44:0/3087693701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1268075f00 0x7f1268076380 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:29.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.357+0000 7f126e000700 1 -- 172.21.15.44:0/3087693701 >> 172.21.15.44:0/3087693701 conn(0x7f12680fe910 msgr2=0x7f1268100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:29.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.357+0000 7f126e000700 1 -- 172.21.15.44:0/3087693701 shutdown_connections 2024-05-03T22:42:29.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.357+0000 7f126e000700 1 -- 172.21.15.44:0/3087693701 wait complete. 2024-05-03T22:42:29.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.359+0000 7f126e000700 1 Processor -- start 2024-05-03T22:42:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.359+0000 7f126e000700 1 -- start start 2024-05-03T22:42:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.359+0000 7f126e000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1268075f00 0x7f126819fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.359+0000 7f126e000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12680774d0 0x7f12681a0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.359+0000 7f126e000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f126810f950 0x7f12681a70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.359+0000 7f126e000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1268115590 con 0x7f126810f950 2024-05-03T22:42:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.359+0000 7f126e000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1268115410 con 0x7f12680774d0 2024-05-03T22:42:29.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.359+0000 7f126e000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1268115710 con 0x7f1268075f00 2024-05-03T22:42:29.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.360+0000 7f126d600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f126810f950 0x7f12681a70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:29.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.360+0000 7f126d600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f126810f950 0x7f12681a70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47666/0 (socket says 172.21.15.44:47666) 2024-05-03T22:42:29.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.360+0000 7f126d600700 1 -- 172.21.15.44:0/2636307554 learned_addr learned my addr 172.21.15.44:0/2636307554 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:42:29.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.360+0000 7f126cc00700 1 --2- 172.21.15.44:0/2636307554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1268075f00 0x7f126819fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:29.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.360+0000 7f1267e00700 1 --2- 172.21.15.44:0/2636307554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12680774d0 0x7f12681a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:29.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.360+0000 7f126d600700 1 -- 172.21.15.44:0/2636307554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1268075f00 msgr2=0x7f126819fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:29.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.360+0000 7f126d600700 1 --2- 172.21.15.44:0/2636307554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1268075f00 0x7f126819fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:29.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.360+0000 7f126d600700 1 -- 172.21.15.44:0/2636307554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12680774d0 msgr2=0x7f12681a0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:29.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.360+0000 7f126d600700 1 --2- 172.21.15.44:0/2636307554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12680774d0 0x7f12681a0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:29.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.360+0000 7f126d600700 1 -- 172.21.15.44:0/2636307554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12681a7780 con 0x7f126810f950 2024-05-03T22:42:29.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.361+0000 7f126d600700 1 --2- 172.21.15.44:0/2636307554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f126810f950 0x7f12681a70e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1260007f10 tx=0x7f126000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:29.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.361+0000 7f1265600700 1 -- 172.21.15.44:0/2636307554 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126000ddd0 con 0x7f126810f950 2024-05-03T22:42:29.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.361+0000 7f1265600700 1 -- 172.21.15.44:0/2636307554 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f1260004020 con 0x7f126810f950 2024-05-03T22:42:29.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.361+0000 7f126e000700 1 -- 172.21.15.44:0/2636307554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12681a7a70 con 0x7f126810f950 2024-05-03T22:42:29.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.361+0000 7f1265600700 1 -- 172.21.15.44:0/2636307554 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260015660 con 0x7f126810f950 2024-05-03T22:42:29.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.361+0000 7f126e000700 1 -- 172.21.15.44:0/2636307554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12681a7fb0 con 0x7f126810f950 2024-05-03T22:42:29.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.363+0000 7f126e000700 1 -- 172.21.15.44:0/2636307554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1268064b00 con 0x7f126810f950 2024-05-03T22:42:29.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.365+0000 7f1265600700 1 -- 172.21.15.44:0/2636307554 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f12600041d0 con 0x7f126810f950 2024-05-03T22:42:29.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.367+0000 7f1265600700 1 --2- 172.21.15.44:0/2636307554 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f12500b2a30 0x7f12500b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:29.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.367+0000 7f1265600700 1 -- 172.21.15.44:0/2636307554 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f12600e22c0 con 0x7f126810f950 2024-05-03T22:42:29.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.367+0000 7f126cc00700 1 --2- 172.21.15.44:0/2636307554 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f12500b2a30 0x7f12500b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:29.369 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.368+0000 7f126cc00700 1 --2- 172.21.15.44:0/2636307554 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f12500b2a30 0x7f12500b4ef0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f12680778b0 tx=0x7f125c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:29.373 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.372+0000 7f1265600700 1 -- 172.21.15.44:0/2636307554 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f1260010070 con 0x7f126810f950 2024-05-03T22:42:29.701 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.699+0000 7f126e000700 1 -- 172.21.15.44:0/2636307554 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f126802e5e0 con 0x7f126810f950 2024-05-03T22:42:29.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.704+0000 7f1265600700 1 -- 172.21.15.44:0/2636307554 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v34) ==== 170+0+59 (secure 0 0 0) 0x7f126802e5e0 con 0x7f126810f950 2024-05-03T22:42:29.706 INFO:teuthology.orchestra.run.smithi044.stdout:[client.0] 2024-05-03T22:42:29.706 INFO:teuthology.orchestra.run.smithi044.stdout: key = AQBVaDVm28LPKRAA3f6/QO62s4+sh+cZ6rQjPw== 2024-05-03T22:42:29.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.708+0000 7f126e000700 1 -- 172.21.15.44:0/2636307554 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f12500b2a30 msgr2=0x7f12500b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:29.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.708+0000 7f126e000700 1 --2- 172.21.15.44:0/2636307554 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f12500b2a30 0x7f12500b4ef0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f12680778b0 tx=0x7f125c009260 comp rx=0 tx=0).stop 2024-05-03T22:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.709+0000 7f126e000700 1 -- 172.21.15.44:0/2636307554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f126810f950 msgr2=0x7f12681a70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.709+0000 7f126e000700 1 --2- 172.21.15.44:0/2636307554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f126810f950 0x7f12681a70e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1260007f10 tx=0x7f126000d3b0 comp rx=0 tx=0).stop 2024-05-03T22:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.709+0000 7f126e000700 1 -- 172.21.15.44:0/2636307554 shutdown_connections 2024-05-03T22:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.709+0000 7f126e000700 1 --2- 172.21.15.44:0/2636307554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f126810f950 0x7f12681a70e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.709+0000 7f126e000700 1 --2- 172.21.15.44:0/2636307554 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f12500b2a30 0x7f12500b4ef0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.709+0000 7f126e000700 1 --2- 172.21.15.44:0/2636307554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1268075f00 0x7f126819fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.709+0000 7f126e000700 1 --2- 172.21.15.44:0/2636307554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12680774d0 0x7f12681a0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.709+0000 7f126e000700 1 -- 172.21.15.44:0/2636307554 >> 172.21.15.44:0/2636307554 conn(0x7f12680fe910 msgr2=0x7f1268102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.709+0000 7f126e000700 1 -- 172.21.15.44:0/2636307554 shutdown_connections 2024-05-03T22:42:29.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:29.709+0000 7f126e000700 1 -- 172.21.15.44:0/2636307554 wait complete. 2024-05-03T22:42:30.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:30 smithi044 ceph-mon[28604]: pgmap v449: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-03T22:42:30.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:30 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2636307554' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-03T22:42:30.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:30 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2636307554' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-03T22:42:30.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:30 smithi060 ceph-mon[31721]: pgmap v449: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-03T22:42:30.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:30 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2636307554' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-03T22:42:30.506 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:30 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2636307554' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-03T22:42:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:30 smithi160 ceph-mon[32531]: pgmap v449: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-03T22:42:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:30 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2636307554' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-03T22:42:30.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:30 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2636307554' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-03T22:42:30.637 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T22:42:30.638 DEBUG:teuthology.orchestra.run.smithi044:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-03T22:42:30.638 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-03T22:42:30.756 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-03T22:42:30.756 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-03T22:42:30.756 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph mgr dump --format=json 2024-05-03T22:42:31.272 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:32.473 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:32 smithi044 ceph-mon[28604]: pgmap v450: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-03T22:42:32.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:32 smithi060 ceph-mon[31721]: pgmap v450: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-03T22:42:32.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:32 smithi160 ceph-mon[32531]: pgmap v450: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-03T22:42:33.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.533+0000 7f991a800700 1 -- 172.21.15.44:0/2936824523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991410e8b0 msgr2=0x7f991410ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:33.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.533+0000 7f991a800700 1 --2- 172.21.15.44:0/2936824523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991410e8b0 0x7f991410ec90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9908009990 tx=0x7f9908009ca0 comp rx=0 tx=0).stop 2024-05-03T22:42:33.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.533+0000 7f991a800700 1 -- 172.21.15.44:0/2936824523 shutdown_connections 2024-05-03T22:42:33.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.533+0000 7f991a800700 1 --2- 172.21.15.44:0/2936824523 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f991410a3a0 0x7f9914116840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:33.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.533+0000 7f991a800700 1 --2- 172.21.15.44:0/2936824523 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991410e8b0 0x7f991410ec90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:33.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.533+0000 7f991a800700 1 --2- 172.21.15.44:0/2936824523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99141099e0 0x7f9914109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:33.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.533+0000 7f991a800700 1 -- 172.21.15.44:0/2936824523 >> 172.21.15.44:0/2936824523 conn(0x7f9914079230 msgr2=0x7f99141082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:33.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.534+0000 7f991a800700 1 -- 172.21.15.44:0/2936824523 shutdown_connections 2024-05-03T22:42:33.536 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.534+0000 7f991a800700 1 -- 172.21.15.44:0/2936824523 wait complete. 2024-05-03T22:42:33.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.536+0000 7f991a800700 1 Processor -- start 2024-05-03T22:42:33.537 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.536+0000 7f991a800700 1 -- start start 2024-05-03T22:42:33.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.536+0000 7f991a800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99141099e0 0x7f99141a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:33.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.536+0000 7f991a800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f991410a3a0 0x7f99141a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:33.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.536+0000 7f991a800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991410e8b0 0x7f99141a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:33.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.536+0000 7f991a800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9914119d30 con 0x7f991410e8b0 2024-05-03T22:42:33.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.536+0000 7f991a800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9914119bb0 con 0x7f99141099e0 2024-05-03T22:42:33.538 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.536+0000 7f991a800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9914119eb0 con 0x7f991410a3a0 2024-05-03T22:42:33.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.537+0000 7f9919e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991410e8b0 0x7f99141a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:33.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.537+0000 7f9919e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991410e8b0 0x7f99141a4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59902/0 (socket says 172.21.15.44:59902) 2024-05-03T22:42:33.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.537+0000 7f9919e00700 1 -- 172.21.15.44:0/3430841230 learned_addr learned my addr 172.21.15.44:0/3430841230 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:42:33.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.537+0000 7f9919400700 1 --2- 172.21.15.44:0/3430841230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99141099e0 0x7f99141a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:33.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.537+0000 7f9918a00700 1 --2- 172.21.15.44:0/3430841230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f991410a3a0 0x7f99141a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:33.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.537+0000 7f9919e00700 1 -- 172.21.15.44:0/3430841230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f991410a3a0 msgr2=0x7f99141a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:33.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.537+0000 7f9919e00700 1 --2- 172.21.15.44:0/3430841230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f991410a3a0 0x7f99141a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:33.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.537+0000 7f9919e00700 1 -- 172.21.15.44:0/3430841230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99141099e0 msgr2=0x7f99141a0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:33.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.537+0000 7f9919e00700 1 --2- 172.21.15.44:0/3430841230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99141099e0 0x7f99141a0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:33.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.537+0000 7f9919e00700 1 -- 172.21.15.44:0/3430841230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99141a5170 con 0x7f991410e8b0 2024-05-03T22:42:33.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.538+0000 7f9919e00700 1 --2- 172.21.15.44:0/3430841230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991410e8b0 0x7f99141a4a30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f990c007ee0 tx=0x7f990c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:33.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.538+0000 7f9912000700 1 -- 172.21.15.44:0/3430841230 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990c00dbd0 con 0x7f991410e8b0 2024-05-03T22:42:33.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.538+0000 7f991a800700 1 -- 172.21.15.44:0/3430841230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99141a5460 con 0x7f991410e8b0 2024-05-03T22:42:33.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.538+0000 7f9912000700 1 -- 172.21.15.44:0/3430841230 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f990c00dd70 con 0x7f991410e8b0 2024-05-03T22:42:33.540 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.538+0000 7f9912000700 1 -- 172.21.15.44:0/3430841230 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990c0133f0 con 0x7f991410e8b0 2024-05-03T22:42:33.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.538+0000 7f991a800700 1 -- 172.21.15.44:0/3430841230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99141acce0 con 0x7f991410e8b0 2024-05-03T22:42:33.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.540+0000 7f991a800700 1 -- 172.21.15.44:0/3430841230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f991406a190 con 0x7f991410e8b0 2024-05-03T22:42:33.543 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.542+0000 7f9912000700 1 -- 172.21.15.44:0/3430841230 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f990c01a020 con 0x7f991410e8b0 2024-05-03T22:42:33.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.544+0000 7f9912000700 1 --2- 172.21.15.44:0/3430841230 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f98fc0b2990 0x7f98fc0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:33.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.544+0000 7f9912000700 1 -- 172.21.15.44:0/3430841230 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f990c0e1bd0 con 0x7f991410e8b0 2024-05-03T22:42:33.545 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.544+0000 7f9919400700 1 --2- 172.21.15.44:0/3430841230 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f98fc0b2990 0x7f98fc0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:33.546 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.545+0000 7f9919400700 1 --2- 172.21.15.44:0/3430841230 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f98fc0b2990 0x7f98fc0b4e50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9908006010 tx=0x7f990800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:33.548 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.546+0000 7f9912000700 1 -- 172.21.15.44:0/3430841230 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f990c010070 con 0x7f991410e8b0 2024-05-03T22:42:33.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.845+0000 7f991a800700 1 -- 172.21.15.44:0/3430841230 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f991402e510 con 0x7f991410e8b0 2024-05-03T22:42:33.856 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.854+0000 7f9912000700 1 -- 172.21.15.44:0/3430841230 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+288646 (secure 0 0 0) 0x7f990c0a9320 con 0x7f991410e8b0 2024-05-03T22:42:33.862 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:42:33.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.862+0000 7f991a800700 1 -- 172.21.15.44:0/3430841230 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f98fc0b2990 msgr2=0x7f98fc0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:33.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.862+0000 7f991a800700 1 --2- 172.21.15.44:0/3430841230 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f98fc0b2990 0x7f98fc0b4e50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9908006010 tx=0x7f990800b540 comp rx=0 tx=0).stop 2024-05-03T22:42:33.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.862+0000 7f991a800700 1 -- 172.21.15.44:0/3430841230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991410e8b0 msgr2=0x7f99141a4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:33.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.862+0000 7f991a800700 1 --2- 172.21.15.44:0/3430841230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991410e8b0 0x7f99141a4a30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f990c007ee0 tx=0x7f990c00d3b0 comp rx=0 tx=0).stop 2024-05-03T22:42:33.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.862+0000 7f991a800700 1 -- 172.21.15.44:0/3430841230 shutdown_connections 2024-05-03T22:42:33.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.862+0000 7f991a800700 1 --2- 172.21.15.44:0/3430841230 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f991410e8b0 0x7f99141a4a30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:33.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.862+0000 7f991a800700 1 --2- 172.21.15.44:0/3430841230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99141099e0 0x7f99141a0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:33.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.862+0000 7f991a800700 1 --2- 172.21.15.44:0/3430841230 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f98fc0b2990 0x7f98fc0b4e50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:33.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.862+0000 7f991a800700 1 --2- 172.21.15.44:0/3430841230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f991410a3a0 0x7f99141a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:33.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.862+0000 7f991a800700 1 -- 172.21.15.44:0/3430841230 >> 172.21.15.44:0/3430841230 conn(0x7f9914079230 msgr2=0x7f9914079850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:33.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.862+0000 7f991a800700 1 -- 172.21.15.44:0/3430841230 shutdown_connections 2024-05-03T22:42:33.865 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:33.862+0000 7f991a800700 1 -- 172.21.15.44:0/3430841230 wait complete. 2024-05-03T22:42:34.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:34 smithi044 ceph-mon[28604]: pgmap v451: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-03T22:42:34.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:34 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3430841230' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-03T22:42:34.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:34 smithi060 ceph-mon[31721]: pgmap v451: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-03T22:42:34.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:34 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3430841230' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-03T22:42:34.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:34 smithi160 ceph-mon[32531]: pgmap v451: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-03T22:42:34.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:34 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3430841230' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-03T22:42:34.814 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6800","nonce":1796677758},{"type":"v1","addr":"172.21.15.44:6801","nonce":1796677758}]},"active_addr":"172.21.15.44:6801/1796677758","active_change":"2024-05-03T22:30:08.767160+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14226,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24115,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.44:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":430498993}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":1709108702}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":3620843240}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":3814209315}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.44:0","nonce":2069392818}]}]} 2024-05-03T22:42:34.820 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-03T22:42:34.821 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-03T22:42:34.821 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:42:35.304 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:36.392 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:36 smithi044 ceph-mon[28604]: pgmap v452: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-05-03T22:42:36.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:36 smithi060 ceph-mon[31721]: pgmap v452: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-05-03T22:42:36.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:36 smithi160 ceph-mon[32531]: pgmap v452: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-05-03T22:42:37.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.612+0000 7f580e800700 1 -- 172.21.15.44:0/191743741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f580806b1b0 msgr2=0x7f580806b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:37.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.612+0000 7f580e800700 1 --2- 172.21.15.44:0/191743741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f580806b1b0 0x7f580806b590 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f57f8009990 tx=0x7f57f8009ca0 comp rx=0 tx=0).stop 2024-05-03T22:42:37.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.612+0000 7f580e800700 1 -- 172.21.15.44:0/191743741 shutdown_connections 2024-05-03T22:42:37.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.612+0000 7f580e800700 1 --2- 172.21.15.44:0/191743741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f580810ff50 0x7f5808112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:37.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.612+0000 7f580e800700 1 --2- 172.21.15.44:0/191743741 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f580806b1b0 0x7f580806b590 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:37.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.612+0000 7f580e800700 1 --2- 172.21.15.44:0/191743741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f580806bad0 0x7f580810fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:37.615 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.612+0000 7f580e800700 1 -- 172.21.15.44:0/191743741 >> 172.21.15.44:0/191743741 conn(0x7f5808079350 msgr2=0x7f5808079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.612+0000 7f580e800700 1 -- 172.21.15.44:0/191743741 shutdown_connections 2024-05-03T22:42:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.612+0000 7f580e800700 1 -- 172.21.15.44:0/191743741 wait complete. 2024-05-03T22:42:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.613+0000 7f580e800700 1 Processor -- start 2024-05-03T22:42:37.616 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.614+0000 7f580e800700 1 -- start start 2024-05-03T22:42:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.614+0000 7f580e800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f580806b1b0 0x7f580819be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.614+0000 7f580e800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f580806bad0 0x7f580819c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.614+0000 7f580e800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f580810ff50 0x7f58081a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.614+0000 7f580e800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5808115a00 con 0x7f580810ff50 2024-05-03T22:42:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.614+0000 7f580e800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5808115880 con 0x7f580806b1b0 2024-05-03T22:42:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.614+0000 7f580e800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5808115b80 con 0x7f580806bad0 2024-05-03T22:42:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.614+0000 7f5807e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f580810ff50 0x7f58081a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.614+0000 7f5807e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f580810ff50 0x7f58081a0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59926/0 (socket says 172.21.15.44:59926) 2024-05-03T22:42:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.614+0000 7f5807e00700 1 -- 172.21.15.44:0/3095770943 learned_addr learned my addr 172.21.15.44:0/3095770943 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:42:37.617 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.615+0000 7f57ffe00700 1 --2- 172.21.15.44:0/3095770943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f580806bad0 0x7f580819c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.615+0000 7f5807e00700 1 -- 172.21.15.44:0/3095770943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f580806bad0 msgr2=0x7f580819c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.615+0000 7f5807e00700 1 --2- 172.21.15.44:0/3095770943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f580806bad0 0x7f580819c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.615+0000 7f5807e00700 1 -- 172.21.15.44:0/3095770943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f580806b1b0 msgr2=0x7f580819be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.615+0000 7f5807e00700 1 --2- 172.21.15.44:0/3095770943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f580806b1b0 0x7f580819be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.615+0000 7f5807e00700 1 -- 172.21.15.44:0/3095770943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58081a0ea0 con 0x7f580810ff50 2024-05-03T22:42:37.618 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.615+0000 7f5807e00700 1 --2- 172.21.15.44:0/3095770943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f580810ff50 0x7f58081a0760 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f58000094f0 tx=0x7f580000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.616+0000 7f5804c00700 1 -- 172.21.15.44:0/3095770943 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580000ddd0 con 0x7f580810ff50 2024-05-03T22:42:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.616+0000 7f580e800700 1 -- 172.21.15.44:0/3095770943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58081a1190 con 0x7f580810ff50 2024-05-03T22:42:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.616+0000 7f5804c00700 1 -- 172.21.15.44:0/3095770943 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f5800009e20 con 0x7f580810ff50 2024-05-03T22:42:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.616+0000 7f5804c00700 1 -- 172.21.15.44:0/3095770943 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5800015400 con 0x7f580810ff50 2024-05-03T22:42:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.616+0000 7f580e800700 1 -- 172.21.15.44:0/3095770943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58081a8a10 con 0x7f580810ff50 2024-05-03T22:42:37.619 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.617+0000 7f580e800700 1 -- 172.21.15.44:0/3095770943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f580806a190 con 0x7f580810ff50 2024-05-03T22:42:37.621 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.620+0000 7f5804c00700 1 -- 172.21.15.44:0/3095770943 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5800004ad0 con 0x7f580810ff50 2024-05-03T22:42:37.624 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.622+0000 7f5804c00700 1 --2- 172.21.15.44:0/3095770943 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f57ec0b2990 0x7f57ec0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:37.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.623+0000 7f5804c00700 1 -- 172.21.15.44:0/3095770943 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f58000e29c0 con 0x7f580810ff50 2024-05-03T22:42:37.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.623+0000 7f5807400700 1 --2- 172.21.15.44:0/3095770943 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f57ec0b2990 0x7f57ec0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:37.625 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.624+0000 7f5807400700 1 --2- 172.21.15.44:0/3095770943 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f57ec0b2990 0x7f57ec0b4e50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f57f8005f50 tx=0x7f57f8005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:37.627 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.626+0000 7f5804c00700 1 -- 172.21.15.44:0/3095770943 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f5800010070 con 0x7f580810ff50 2024-05-03T22:42:37.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.868+0000 7f580e800700 1 -- 172.21.15.44:0/3095770943 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f580802e510 con 0x7f580810ff50 2024-05-03T22:42:37.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.871+0000 7f5804c00700 1 -- 172.21.15.44:0/3095770943 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24819 (secure 0 0 0) 0x7f58000aa110 con 0x7f580810ff50 2024-05-03T22:42:37.873 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:42:37.873 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":89,"fsid":"5b0efdca-099c-11ef-bc97-c7b262605968","created":"2024-05-03T22:28:49.471963+0000","modified":"2024-05-03T22:42:11.407700+0000","last_up_change":"2024-05-03T22:38:41.446244+0000","last_in_change":"2024-05-03T22:38:16.952689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:33:24.956832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:40:05.501996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:40:09.732161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:40:23.052845+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05869397-bdc9-4c38-b1c6-deb466454dd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6803","nonce":4219032560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6805","nonce":4219032560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6809","nonce":4219032560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6807","nonce":4219032560}]},"public_addr":"172.21.15.44:6803/4219032560","cluster_addr":"172.21.15.44:6805/4219032560","heartbeat_back_addr":"172.21.15.44:6809/4219032560","heartbeat_front_addr":"172.21.15.44:6807/4219032560","state":["exists","up"]},{"osd":1,"uuid":"ff61ca27-e36b-41c9-898f-1cd7af1d9db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6801","nonce":563003638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6803","nonce":563003638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6807","nonce":563003638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6805","nonce":563003638}]},"public_addr":"172.21.15.60:6801/563003638","cluster_addr":"172.21.15.60:6803/563003638","heartbeat_back_addr":"172.21.15.60:6807/563003638","heartbeat_front_addr":"172.21.15.60:6805/563003638","state":["exists","up"]},{"osd":2,"uuid":"e58f96dc-3486-452e-85a1-847a0e2c523a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6801","nonce":2524540447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6803","nonce":2524540447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6807","nonce":2524540447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6805","nonce":2524540447}]},"public_addr":"172.21.15.160:6801/2524540447","cluster_addr":"172.21.15.160:6803/2524540447","heartbeat_back_addr":"172.21.15.160:6807/2524540447","heartbeat_front_addr":"172.21.15.160:6805/2524540447","state":["exists","up"]},{"osd":3,"uuid":"75c56c3b-5807-4646-885c-1ef16541ff72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6811","nonce":3298926279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6813","nonce":3298926279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6817","nonce":3298926279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6815","nonce":3298926279}]},"public_addr":"172.21.15.44:6811/3298926279","cluster_addr":"172.21.15.44:6813/3298926279","heartbeat_back_addr":"172.21.15.44:6817/3298926279","heartbeat_front_addr":"172.21.15.44:6815/3298926279","state":["exists","up"]},{"osd":4,"uuid":"a8a322e4-6ca1-4727-8b41-5ff523acc591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6809","nonce":3794821539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6811","nonce":3794821539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6815","nonce":3794821539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6813","nonce":3794821539}]},"public_addr":"172.21.15.60:6809/3794821539","cluster_addr":"172.21.15.60:6811/3794821539","heartbeat_back_addr":"172.21.15.60:6815/3794821539","heartbeat_front_addr":"172.21.15.60:6813/3794821539","state":["exists","up"]},{"osd":5,"uuid":"bc718527-bacd-4d1b-90c6-758cbd859e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6809","nonce":429142335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6811","nonce":429142335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6815","nonce":429142335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6813","nonce":429142335}]},"public_addr":"172.21.15.160:6809/429142335","cluster_addr":"172.21.15.160:6811/429142335","heartbeat_back_addr":"172.21.15.160:6815/429142335","heartbeat_front_addr":"172.21.15.160:6813/429142335","state":["exists","up"]},{"osd":6,"uuid":"f95a1d05-a958-4e5c-a90a-6b0c3d9fad43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6819","nonce":2805326764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6821","nonce":2805326764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6825","nonce":2805326764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6823","nonce":2805326764}]},"public_addr":"172.21.15.44:6819/2805326764","cluster_addr":"172.21.15.44:6821/2805326764","heartbeat_back_addr":"172.21.15.44:6825/2805326764","heartbeat_front_addr":"172.21.15.44:6823/2805326764","state":["exists","up"]},{"osd":7,"uuid":"a515e4be-c607-4f4a-96bb-c3d395d7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6817","nonce":693512829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6819","nonce":693512829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6823","nonce":693512829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6821","nonce":693512829}]},"public_addr":"172.21.15.60:6817/693512829","cluster_addr":"172.21.15.60:6819/693512829","heartbeat_back_addr":"172.21.15.60:6823/693512829","heartbeat_front_addr":"172.21.15.60:6821/693512829","state":["exists","up"]},{"osd":8,"uuid":"717aeffb-6c51-4e4e-8344-fba70ac2c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6817","nonce":2920554498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6819","nonce":2920554498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6823","nonce":2920554498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6821","nonce":2920554498}]},"public_addr":"172.21.15.160:6817/2920554498","cluster_addr":"172.21.15.160:6819/2920554498","heartbeat_back_addr":"172.21.15.160:6823/2920554498","heartbeat_front_addr":"172.21.15.160:6821/2920554498","state":["exists","up"]},{"osd":9,"uuid":"ade31284-1246-42c8-9cee-e60dacc58a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6827","nonce":414763386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6829","nonce":414763386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6833","nonce":414763386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6831","nonce":414763386}]},"public_addr":"172.21.15.44:6827/414763386","cluster_addr":"172.21.15.44:6829/414763386","heartbeat_back_addr":"172.21.15.44:6833/414763386","heartbeat_front_addr":"172.21.15.44:6831/414763386","state":["exists","up"]},{"osd":10,"uuid":"e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6825","nonce":2396062554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6827","nonce":2396062554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6831","nonce":2396062554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6829","nonce":2396062554}]},"public_addr":"172.21.15.60:6825/2396062554","cluster_addr":"172.21.15.60:6827/2396062554","heartbeat_back_addr":"172.21.15.60:6831/2396062554","heartbeat_front_addr":"172.21.15.60:6829/2396062554","state":["exists","up"]},{"osd":11,"uuid":"b6951585-9337-4b5a-a691-e765deb4b825","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6825","nonce":1397967755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6827","nonce":1397967755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6831","nonce":1397967755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6829","nonce":1397967755}]},"public_addr":"172.21.15.160:6825/1397967755","cluster_addr":"172.21.15.160:6827/1397967755","heartbeat_back_addr":"172.21.15.160:6831/1397967755","heartbeat_front_addr":"172.21.15.160:6829/1397967755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:15.012060+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:48.390669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:21.227227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:56.388453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:34:31.079377+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:04.912058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:40.941904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:16.757849+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:51.591794+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:37:29.022917+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:05.506391+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:39.793901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2661810503":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3426728285":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/4246410673":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2328074241":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/1738155460":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3461866265":"2024-05-04T22:30:08.766919+0000","172.21.15.44:6800/950841500":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/950841500":"2024-05-04T22:29:32.846592+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:42:37.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.874+0000 7f580e800700 1 -- 172.21.15.44:0/3095770943 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f57ec0b2990 msgr2=0x7f57ec0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:37.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.874+0000 7f580e800700 1 --2- 172.21.15.44:0/3095770943 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f57ec0b2990 0x7f57ec0b4e50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f57f8005f50 tx=0x7f57f8005e80 comp rx=0 tx=0).stop 2024-05-03T22:42:37.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.874+0000 7f580e800700 1 -- 172.21.15.44:0/3095770943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f580810ff50 msgr2=0x7f58081a0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:37.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.874+0000 7f580e800700 1 --2- 172.21.15.44:0/3095770943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f580810ff50 0x7f58081a0760 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f58000094f0 tx=0x7f580000d3b0 comp rx=0 tx=0).stop 2024-05-03T22:42:37.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.874+0000 7f580e800700 1 -- 172.21.15.44:0/3095770943 shutdown_connections 2024-05-03T22:42:37.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.874+0000 7f580e800700 1 --2- 172.21.15.44:0/3095770943 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f580810ff50 0x7f58081a0760 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:37.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.874+0000 7f580e800700 1 --2- 172.21.15.44:0/3095770943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f580806b1b0 0x7f580819be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:37.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.874+0000 7f580e800700 1 --2- 172.21.15.44:0/3095770943 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f57ec0b2990 0x7f57ec0b4e50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:37.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.874+0000 7f580e800700 1 --2- 172.21.15.44:0/3095770943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f580806bad0 0x7f580819c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:37.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.874+0000 7f580e800700 1 -- 172.21.15.44:0/3095770943 >> 172.21.15.44:0/3095770943 conn(0x7f5808079350 msgr2=0x7f5808111360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:37.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.875+0000 7f580e800700 1 -- 172.21.15.44:0/3095770943 shutdown_connections 2024-05-03T22:42:37.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:37.875+0000 7f580e800700 1 -- 172.21.15.44:0/3095770943 wait complete. 2024-05-03T22:42:38.132 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:38 smithi044 ceph-mon[28604]: pgmap v453: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:42:38.133 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:38 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3095770943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:42:38.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:38 smithi060 ceph-mon[31721]: pgmap v453: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:42:38.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:38 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3095770943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:42:38.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:38 smithi160 ceph-mon[32531]: pgmap v453: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:42:38.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:38 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3095770943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:42:38.711 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-03T22:42:38.711 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:42:39.156 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:40.402 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:40 smithi044 ceph-mon[28604]: pgmap v454: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:42:40.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:40 smithi060 ceph-mon[31721]: pgmap v454: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:42:40.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:40 smithi160 ceph-mon[32531]: pgmap v454: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:42:41.476 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.474+0000 7f70c4200700 1 -- 172.21.15.44:0/3858601818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70bc1023a0 msgr2=0x7f70bc102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:41.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.474+0000 7f70c4200700 1 --2- 172.21.15.44:0/3858601818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70bc1023a0 0x7f70bc102820 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f70a8009990 tx=0x7f70a8009ca0 comp rx=0 tx=0).stop 2024-05-03T22:42:41.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.474+0000 7f70c4200700 1 -- 172.21.15.44:0/3858601818 shutdown_connections 2024-05-03T22:42:41.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.474+0000 7f70c4200700 1 --2- 172.21.15.44:0/3858601818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70bc102d60 0x7f70bc10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:41.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.474+0000 7f70c4200700 1 --2- 172.21.15.44:0/3858601818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70bc108410 0x7f70bc1087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:41.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.474+0000 7f70c4200700 1 --2- 172.21.15.44:0/3858601818 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70bc1023a0 0x7f70bc102820 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:41.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.474+0000 7f70c4200700 1 -- 172.21.15.44:0/3858601818 >> 172.21.15.44:0/3858601818 conn(0x7f70bc079350 msgr2=0x7f70bc079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:41.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.474+0000 7f70c4200700 1 -- 172.21.15.44:0/3858601818 shutdown_connections 2024-05-03T22:42:41.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.474+0000 7f70c4200700 1 -- 172.21.15.44:0/3858601818 wait complete. 2024-05-03T22:42:41.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.476+0000 7f70c4200700 1 Processor -- start 2024-05-03T22:42:41.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.476+0000 7f70c4200700 1 -- start start 2024-05-03T22:42:41.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.476+0000 7f70c4200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70bc1023a0 0x7f70bc104310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:41.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.476+0000 7f70c4200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70bc102d60 0x7f70bc104850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:41.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.477+0000 7f70c4200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70bc108410 0x7f70bc104d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:41.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.477+0000 7f70c4200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc1126a0 con 0x7f70bc108410 2024-05-03T22:42:41.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.477+0000 7f70c4200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc112520 con 0x7f70bc1023a0 2024-05-03T22:42:41.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.477+0000 7f70c4200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f70bc112820 con 0x7f70bc102d60 2024-05-03T22:42:41.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.477+0000 7f70c2200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70bc108410 0x7f70bc104d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:41.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.477+0000 7f70c2200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70bc108410 0x7f70bc104d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38222/0 (socket says 172.21.15.44:38222) 2024-05-03T22:42:41.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.477+0000 7f70c2200700 1 -- 172.21.15.44:0/1766403669 learned_addr learned my addr 172.21.15.44:0/1766403669 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:42:41.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.477+0000 7f70c1800700 1 --2- 172.21.15.44:0/1766403669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70bc1023a0 0x7f70bc104310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:41.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.477+0000 7f70c0e00700 1 --2- 172.21.15.44:0/1766403669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70bc102d60 0x7f70bc104850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:41.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.478+0000 7f70c2200700 1 -- 172.21.15.44:0/1766403669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70bc102d60 msgr2=0x7f70bc104850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:41.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.478+0000 7f70c2200700 1 --2- 172.21.15.44:0/1766403669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70bc102d60 0x7f70bc104850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:41.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.478+0000 7f70c2200700 1 -- 172.21.15.44:0/1766403669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70bc1023a0 msgr2=0x7f70bc104310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:41.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.478+0000 7f70c2200700 1 --2- 172.21.15.44:0/1766403669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70bc1023a0 0x7f70bc104310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:41.484 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.478+0000 7f70c2200700 1 -- 172.21.15.44:0/1766403669 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70bc1a80d0 con 0x7f70bc108410 2024-05-03T22:42:41.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.478+0000 7f70c2200700 1 --2- 172.21.15.44:0/1766403669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70bc108410 0x7f70bc104d90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f70b4007ee0 tx=0x7f70b400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:41.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.478+0000 7f70ba000700 1 -- 172.21.15.44:0/1766403669 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b4004bb0 con 0x7f70bc108410 2024-05-03T22:42:41.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.478+0000 7f70ba000700 1 -- 172.21.15.44:0/1766403669 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f70b4004d50 con 0x7f70bc108410 2024-05-03T22:42:41.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.478+0000 7f70c4200700 1 -- 172.21.15.44:0/1766403669 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70bc1a83c0 con 0x7f70bc108410 2024-05-03T22:42:41.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.479+0000 7f70ba000700 1 -- 172.21.15.44:0/1766403669 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b4005950 con 0x7f70bc108410 2024-05-03T22:42:41.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.479+0000 7f70c4200700 1 -- 172.21.15.44:0/1766403669 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70bc1a88d0 con 0x7f70bc108410 2024-05-03T22:42:41.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.480+0000 7f70c4200700 1 -- 172.21.15.44:0/1766403669 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70bc06a190 con 0x7f70bc108410 2024-05-03T22:42:41.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.482+0000 7f70ba000700 1 -- 172.21.15.44:0/1766403669 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f70b401a020 con 0x7f70bc108410 2024-05-03T22:42:41.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.484+0000 7f70ba000700 1 --2- 172.21.15.44:0/1766403669 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f70a40b2910 0x7f70a40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:41.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.484+0000 7f70ba000700 1 -- 172.21.15.44:0/1766403669 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f70b40e25a0 con 0x7f70bc108410 2024-05-03T22:42:41.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.484+0000 7f70c1800700 1 --2- 172.21.15.44:0/1766403669 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f70a40b2910 0x7f70a40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:41.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.485+0000 7f70c1800700 1 --2- 172.21.15.44:0/1766403669 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f70a40b2910 0x7f70a40b4dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f70b000abd0 tx=0x7f70b000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:41.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.486+0000 7f70ba000700 1 -- 172.21.15.44:0/1766403669 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f70b4010070 con 0x7f70bc108410 2024-05-03T22:42:41.728 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.726+0000 7f70c4200700 1 -- 172.21.15.44:0/1766403669 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70bc1a8b00 con 0x7f70bc108410 2024-05-03T22:42:41.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.731+0000 7f70ba000700 1 -- 172.21.15.44:0/1766403669 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24819 (secure 0 0 0) 0x7f70b40a9cf0 con 0x7f70bc108410 2024-05-03T22:42:41.733 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:42:41.733 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":89,"fsid":"5b0efdca-099c-11ef-bc97-c7b262605968","created":"2024-05-03T22:28:49.471963+0000","modified":"2024-05-03T22:42:11.407700+0000","last_up_change":"2024-05-03T22:38:41.446244+0000","last_in_change":"2024-05-03T22:38:16.952689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:33:24.956832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:40:05.501996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:40:09.732161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:40:23.052845+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05869397-bdc9-4c38-b1c6-deb466454dd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6803","nonce":4219032560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6805","nonce":4219032560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6809","nonce":4219032560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6807","nonce":4219032560}]},"public_addr":"172.21.15.44:6803/4219032560","cluster_addr":"172.21.15.44:6805/4219032560","heartbeat_back_addr":"172.21.15.44:6809/4219032560","heartbeat_front_addr":"172.21.15.44:6807/4219032560","state":["exists","up"]},{"osd":1,"uuid":"ff61ca27-e36b-41c9-898f-1cd7af1d9db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6801","nonce":563003638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6803","nonce":563003638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6807","nonce":563003638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6805","nonce":563003638}]},"public_addr":"172.21.15.60:6801/563003638","cluster_addr":"172.21.15.60:6803/563003638","heartbeat_back_addr":"172.21.15.60:6807/563003638","heartbeat_front_addr":"172.21.15.60:6805/563003638","state":["exists","up"]},{"osd":2,"uuid":"e58f96dc-3486-452e-85a1-847a0e2c523a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6801","nonce":2524540447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6803","nonce":2524540447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6807","nonce":2524540447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6805","nonce":2524540447}]},"public_addr":"172.21.15.160:6801/2524540447","cluster_addr":"172.21.15.160:6803/2524540447","heartbeat_back_addr":"172.21.15.160:6807/2524540447","heartbeat_front_addr":"172.21.15.160:6805/2524540447","state":["exists","up"]},{"osd":3,"uuid":"75c56c3b-5807-4646-885c-1ef16541ff72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6811","nonce":3298926279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6813","nonce":3298926279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6817","nonce":3298926279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6815","nonce":3298926279}]},"public_addr":"172.21.15.44:6811/3298926279","cluster_addr":"172.21.15.44:6813/3298926279","heartbeat_back_addr":"172.21.15.44:6817/3298926279","heartbeat_front_addr":"172.21.15.44:6815/3298926279","state":["exists","up"]},{"osd":4,"uuid":"a8a322e4-6ca1-4727-8b41-5ff523acc591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6809","nonce":3794821539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6811","nonce":3794821539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6815","nonce":3794821539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6813","nonce":3794821539}]},"public_addr":"172.21.15.60:6809/3794821539","cluster_addr":"172.21.15.60:6811/3794821539","heartbeat_back_addr":"172.21.15.60:6815/3794821539","heartbeat_front_addr":"172.21.15.60:6813/3794821539","state":["exists","up"]},{"osd":5,"uuid":"bc718527-bacd-4d1b-90c6-758cbd859e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6809","nonce":429142335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6811","nonce":429142335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6815","nonce":429142335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6813","nonce":429142335}]},"public_addr":"172.21.15.160:6809/429142335","cluster_addr":"172.21.15.160:6811/429142335","heartbeat_back_addr":"172.21.15.160:6815/429142335","heartbeat_front_addr":"172.21.15.160:6813/429142335","state":["exists","up"]},{"osd":6,"uuid":"f95a1d05-a958-4e5c-a90a-6b0c3d9fad43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6819","nonce":2805326764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6821","nonce":2805326764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6825","nonce":2805326764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6823","nonce":2805326764}]},"public_addr":"172.21.15.44:6819/2805326764","cluster_addr":"172.21.15.44:6821/2805326764","heartbeat_back_addr":"172.21.15.44:6825/2805326764","heartbeat_front_addr":"172.21.15.44:6823/2805326764","state":["exists","up"]},{"osd":7,"uuid":"a515e4be-c607-4f4a-96bb-c3d395d7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6817","nonce":693512829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6819","nonce":693512829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6823","nonce":693512829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6821","nonce":693512829}]},"public_addr":"172.21.15.60:6817/693512829","cluster_addr":"172.21.15.60:6819/693512829","heartbeat_back_addr":"172.21.15.60:6823/693512829","heartbeat_front_addr":"172.21.15.60:6821/693512829","state":["exists","up"]},{"osd":8,"uuid":"717aeffb-6c51-4e4e-8344-fba70ac2c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6817","nonce":2920554498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6819","nonce":2920554498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6823","nonce":2920554498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6821","nonce":2920554498}]},"public_addr":"172.21.15.160:6817/2920554498","cluster_addr":"172.21.15.160:6819/2920554498","heartbeat_back_addr":"172.21.15.160:6823/2920554498","heartbeat_front_addr":"172.21.15.160:6821/2920554498","state":["exists","up"]},{"osd":9,"uuid":"ade31284-1246-42c8-9cee-e60dacc58a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6827","nonce":414763386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6829","nonce":414763386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6833","nonce":414763386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6831","nonce":414763386}]},"public_addr":"172.21.15.44:6827/414763386","cluster_addr":"172.21.15.44:6829/414763386","heartbeat_back_addr":"172.21.15.44:6833/414763386","heartbeat_front_addr":"172.21.15.44:6831/414763386","state":["exists","up"]},{"osd":10,"uuid":"e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6825","nonce":2396062554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6827","nonce":2396062554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6831","nonce":2396062554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6829","nonce":2396062554}]},"public_addr":"172.21.15.60:6825/2396062554","cluster_addr":"172.21.15.60:6827/2396062554","heartbeat_back_addr":"172.21.15.60:6831/2396062554","heartbeat_front_addr":"172.21.15.60:6829/2396062554","state":["exists","up"]},{"osd":11,"uuid":"b6951585-9337-4b5a-a691-e765deb4b825","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6825","nonce":1397967755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6827","nonce":1397967755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6831","nonce":1397967755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6829","nonce":1397967755}]},"public_addr":"172.21.15.160:6825/1397967755","cluster_addr":"172.21.15.160:6827/1397967755","heartbeat_back_addr":"172.21.15.160:6831/1397967755","heartbeat_front_addr":"172.21.15.160:6829/1397967755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:15.012060+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:48.390669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:21.227227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:56.388453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:34:31.079377+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:04.912058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:40.941904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:16.757849+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:51.591794+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:37:29.022917+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:05.506391+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:39.793901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2661810503":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3426728285":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/4246410673":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2328074241":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/1738155460":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3461866265":"2024-05-04T22:30:08.766919+0000","172.21.15.44:6800/950841500":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/950841500":"2024-05-04T22:29:32.846592+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:42:41.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.734+0000 7f70c4200700 1 -- 172.21.15.44:0/1766403669 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f70a40b2910 msgr2=0x7f70a40b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:41.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.734+0000 7f70c4200700 1 --2- 172.21.15.44:0/1766403669 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f70a40b2910 0x7f70a40b4dd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f70b000abd0 tx=0x7f70b000a380 comp rx=0 tx=0).stop 2024-05-03T22:42:41.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.734+0000 7f70c4200700 1 -- 172.21.15.44:0/1766403669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70bc108410 msgr2=0x7f70bc104d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:41.735 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.734+0000 7f70c4200700 1 --2- 172.21.15.44:0/1766403669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70bc108410 0x7f70bc104d90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f70b4007ee0 tx=0x7f70b400d3b0 comp rx=0 tx=0).stop 2024-05-03T22:42:41.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.734+0000 7f70c4200700 1 -- 172.21.15.44:0/1766403669 shutdown_connections 2024-05-03T22:42:41.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.734+0000 7f70c4200700 1 --2- 172.21.15.44:0/1766403669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f70bc108410 0x7f70bc104d90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:41.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.734+0000 7f70c4200700 1 --2- 172.21.15.44:0/1766403669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70bc1023a0 0x7f70bc104310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:41.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.734+0000 7f70c4200700 1 --2- 172.21.15.44:0/1766403669 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f70a40b2910 0x7f70a40b4dd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:41.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.734+0000 7f70c4200700 1 --2- 172.21.15.44:0/1766403669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70bc102d60 0x7f70bc104850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:41.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.734+0000 7f70c4200700 1 -- 172.21.15.44:0/1766403669 >> 172.21.15.44:0/1766403669 conn(0x7f70bc079350 msgr2=0x7f70bc1064f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:41.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.734+0000 7f70c4200700 1 -- 172.21.15.44:0/1766403669 shutdown_connections 2024-05-03T22:42:41.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:41.735+0000 7f70c4200700 1 -- 172.21.15.44:0/1766403669 wait complete. 2024-05-03T22:42:42.499 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:42 smithi044 ceph-mon[28604]: pgmap v455: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:42:42.499 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:42 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1766403669' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:42:42.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:42 smithi060 ceph-mon[31721]: pgmap v455: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:42:42.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:42 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1766403669' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:42:42.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:42 smithi160 ceph-mon[32531]: pgmap v455: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:42:42.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:42 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1766403669' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:42:42.558 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-03T22:42:42.559 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-03T22:42:42.559 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-03T22:42:42.559 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-03T22:42:42.560 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-03T22:42:42.560 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-03T22:42:42.560 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-03T22:42:42.561 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-03T22:42:42.561 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-03T22:42:42.562 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-03T22:42:42.562 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-03T22:42:42.562 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-03T22:42:43.611 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:43.615 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:43.629 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:43.629 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:43.652 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:44.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:44 smithi044 ceph-mon[28604]: pgmap v456: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:42:44.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:44 smithi060 ceph-mon[31721]: pgmap v456: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:42:44.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:44 smithi160 ceph-mon[32531]: pgmap v456: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:42:45.443 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:45.578 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:45.581 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:45.692 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:45.698 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:45.698 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:45.699 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:42:46.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:46 smithi044 ceph-mon[28604]: pgmap v457: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:42:46.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:46 smithi060 ceph-mon[31721]: pgmap v457: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:42:46.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:46 smithi160 ceph-mon[32531]: pgmap v457: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:42:48.391 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:48 smithi044 ceph-mon[28604]: pgmap v458: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:42:48.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:48 smithi060 ceph-mon[31721]: pgmap v458: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:42:48.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:48 smithi160 ceph-mon[32531]: pgmap v458: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:42:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.464+0000 7f7983e00700 1 -- 172.21.15.44:0/1478819396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f797c109530 msgr2=0x7f797c109910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.464+0000 7f7983e00700 1 --2- 172.21.15.44:0/1478819396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f797c109530 0x7f797c109910 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7970009990 tx=0x7f7970009ca0 comp rx=0 tx=0).stop 2024-05-03T22:42:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.464+0000 7f7983e00700 1 -- 172.21.15.44:0/1478819396 shutdown_connections 2024-05-03T22:42:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.464+0000 7f7983e00700 1 --2- 172.21.15.44:0/1478819396 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f797c103ee0 0x7f797c110370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.464+0000 7f7983e00700 1 --2- 172.21.15.44:0/1478819396 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f797c109530 0x7f797c109910 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.464+0000 7f7983e00700 1 --2- 172.21.15.44:0/1478819396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797c103520 0x7f797c1039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:49.522 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.464+0000 7f7983e00700 1 -- 172.21.15.44:0/1478819396 >> 172.21.15.44:0/1478819396 conn(0x7f797c07a570 msgr2=0x7f797c07a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.465+0000 7f7983e00700 1 -- 172.21.15.44:0/1478819396 shutdown_connections 2024-05-03T22:42:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.465+0000 7f7983e00700 1 -- 172.21.15.44:0/1478819396 wait complete. 2024-05-03T22:42:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.466+0000 7f7983e00700 1 Processor -- start 2024-05-03T22:42:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.466+0000 7f7983e00700 1 -- start start 2024-05-03T22:42:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.466+0000 7f7983e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f797c103520 0x7f797c19bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.466+0000 7f7983e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797c103ee0 0x7f797c19c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.466+0000 7f7983e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f797c109530 0x7f797c1a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.466+0000 7f7983e00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f797c1137f0 con 0x7f797c103520 2024-05-03T22:42:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.466+0000 7f7983e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f797c113670 con 0x7f797c103ee0 2024-05-03T22:42:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.466+0000 7f7983e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f797c113970 con 0x7f797c109530 2024-05-03T22:42:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.466+0000 7f7981400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f797c103520 0x7f797c19bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.467+0000 7f7981400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f797c103520 0x7f797c19bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38246/0 (socket says 172.21.15.44:38246) 2024-05-03T22:42:49.523 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.467+0000 7f7981400700 1 -- 172.21.15.44:0/1870857448 learned_addr learned my addr 172.21.15.44:0/1870857448 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:42:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.467+0000 7f7981e00700 1 --2- 172.21.15.44:0/1870857448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f797c109530 0x7f797c1a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.467+0000 7f7981400700 1 -- 172.21.15.44:0/1870857448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f797c109530 msgr2=0x7f797c1a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.467+0000 7f7981400700 1 --2- 172.21.15.44:0/1870857448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f797c109530 0x7f797c1a0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.467+0000 7f7981400700 1 -- 172.21.15.44:0/1870857448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797c103ee0 msgr2=0x7f797c19c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.467+0000 7f7981400700 1 --2- 172.21.15.44:0/1870857448 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797c103ee0 0x7f797c19c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.467+0000 7f7981400700 1 -- 172.21.15.44:0/1870857448 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797c1a0d90 con 0x7f797c103520 2024-05-03T22:42:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.467+0000 7f7981400700 1 --2- 172.21.15.44:0/1870857448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f797c103520 0x7f797c19bd80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7970005910 tx=0x7f7970009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.468+0000 7f797a000700 1 -- 172.21.15.44:0/1870857448 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7970027070 con 0x7f797c103520 2024-05-03T22:42:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.468+0000 7f797a000700 1 -- 172.21.15.44:0/1870857448 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f7970003f70 con 0x7f797c103520 2024-05-03T22:42:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.468+0000 7f7983e00700 1 -- 172.21.15.44:0/1870857448 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797c1a1020 con 0x7f797c103520 2024-05-03T22:42:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.468+0000 7f797a000700 1 -- 172.21.15.44:0/1870857448 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7970022e00 con 0x7f797c103520 2024-05-03T22:42:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.468+0000 7f7983e00700 1 -- 172.21.15.44:0/1870857448 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f797c1a8900 con 0x7f797c103520 2024-05-03T22:42:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.469+0000 7f7983e00700 1 -- 172.21.15.44:0/1870857448 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f797c110070 con 0x7f797c103520 2024-05-03T22:42:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.471+0000 7f797a000700 1 -- 172.21.15.44:0/1870857448 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f797002a070 con 0x7f797c103520 2024-05-03T22:42:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.473+0000 7f797a000700 1 --2- 172.21.15.44:0/1870857448 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f79640b2910 0x7f79640b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:49.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.473+0000 7f797a000700 1 -- 172.21.15.44:0/1870857448 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f79700e3ff0 con 0x7f797c103520 2024-05-03T22:42:49.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.473+0000 7f7980a00700 1 --2- 172.21.15.44:0/1870857448 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f79640b2910 0x7f79640b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:49.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.473+0000 7f797a000700 1 --2- 172.21.15.44:0/1870857448 >> [v2:172.21.15.160:6800/2524540447,v1:172.21.15.160:6801/2524540447] conn(0x7f79640bdd70 0x7f79640c0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:49.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.473+0000 7f797a000700 1 -- 172.21.15.44:0/1870857448 --> [v2:172.21.15.160:6800/2524540447,v1:172.21.15.160:6801/2524540447] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7970015ec0 con 0x7f79640bdd70 2024-05-03T22:42:49.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.473+0000 7f797a000700 1 -- 172.21.15.44:0/1870857448 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f79700e4420 con 0x7f797c103520 2024-05-03T22:42:49.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.474+0000 7f7980a00700 1 --2- 172.21.15.44:0/1870857448 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f79640b2910 0x7f79640b4dd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7968005fd0 tx=0x7f7968005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:49.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.474+0000 7f7981e00700 1 --2- 172.21.15.44:0/1870857448 >> [v2:172.21.15.160:6800/2524540447,v1:172.21.15.160:6801/2524540447] conn(0x7f79640bdd70 0x7f79640c0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:49.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.475+0000 7f7981e00700 1 --2- 172.21.15.44:0/1870857448 >> [v2:172.21.15.160:6800/2524540447,v1:172.21.15.160:6801/2524540447] conn(0x7f79640bdd70 0x7f79640c0210 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:49.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.477+0000 7f797a000700 1 -- 172.21.15.44:0/1870857448 <== osd.2 v2:172.21.15.160:6800/2524540447 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7970015ec0 con 0x7f79640bdd70 2024-05-03T22:42:49.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.496+0000 7f7983e00700 1 -- 172.21.15.44:0/1870857448 --> [v2:172.21.15.160:6800/2524540447,v1:172.21.15.160:6801/2524540447] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f797c104c10 con 0x7f79640bdd70 2024-05-03T22:42:49.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.497+0000 7f797a000700 1 -- 172.21.15.44:0/1870857448 <== osd.2 v2:172.21.15.160:6800/2524540447 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f797c104c10 con 0x7f79640bdd70 2024-05-03T22:42:49.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.497+0000 7f7983e00700 1 -- 172.21.15.44:0/1870857448 >> [v2:172.21.15.160:6800/2524540447,v1:172.21.15.160:6801/2524540447] conn(0x7f79640bdd70 msgr2=0x7f79640c0210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:49.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.497+0000 7f7983e00700 1 --2- 172.21.15.44:0/1870857448 >> [v2:172.21.15.160:6800/2524540447,v1:172.21.15.160:6801/2524540447] conn(0x7f79640bdd70 0x7f79640c0210 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:49.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.497+0000 7f7983e00700 1 -- 172.21.15.44:0/1870857448 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f79640b2910 msgr2=0x7f79640b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:49.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.497+0000 7f7983e00700 1 --2- 172.21.15.44:0/1870857448 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f79640b2910 0x7f79640b4dd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7968005fd0 tx=0x7f7968005d00 comp rx=0 tx=0).stop 2024-05-03T22:42:49.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.497+0000 7f7983e00700 1 -- 172.21.15.44:0/1870857448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f797c103520 msgr2=0x7f797c19bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:49.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.497+0000 7f7983e00700 1 --2- 172.21.15.44:0/1870857448 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f797c103520 0x7f797c19bd80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7970005910 tx=0x7f7970009f90 comp rx=0 tx=0).stop 2024-05-03T22:42:49.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.498+0000 7f7981e00700 1 -- 172.21.15.44:0/1870857448 reap_dead start 2024-05-03T22:42:49.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.498+0000 7f7983e00700 1 -- 172.21.15.44:0/1870857448 shutdown_connections 2024-05-03T22:42:49.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.498+0000 7f7983e00700 1 -- 172.21.15.44:0/1870857448 >> 172.21.15.44:0/1870857448 conn(0x7f797c07a570 msgr2=0x7f797c10e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:49.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.498+0000 7f7983e00700 1 -- 172.21.15.44:0/1870857448 shutdown_connections 2024-05-03T22:42:49.526 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:48.498+0000 7f7983e00700 1 -- 172.21.15.44:0/1870857448 wait complete. 2024-05-03T22:42:50.456 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:50 smithi044 ceph-mon[28604]: pgmap v459: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:42:50.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:50 smithi060 ceph-mon[31721]: pgmap v459: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:42:50.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:50 smithi160 ceph-mon[32531]: pgmap v459: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:42:52.431 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:52 smithi044 ceph-mon[28604]: pgmap v460: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:42:52.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:52 smithi060 ceph-mon[31721]: pgmap v460: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:42:52.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:52 smithi160 ceph-mon[32531]: pgmap v460: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:42:54.487 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:54 smithi044 ceph-mon[28604]: pgmap v461: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:42:54.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:54 smithi060 ceph-mon[31721]: pgmap v461: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:42:54.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:54 smithi160 ceph-mon[32531]: pgmap v461: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:42:54.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.847+0000 7f331e000700 1 -- 172.21.15.44:0/739650554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33180782f0 msgr2=0x7f3318113d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:54.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.847+0000 7f331e000700 1 --2- 172.21.15.44:0/739650554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33180782f0 0x7f3318113d10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3300009990 tx=0x7f3300009ca0 comp rx=0 tx=0).stop 2024-05-03T22:42:54.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.847+0000 7f331e000700 1 -- 172.21.15.44:0/739650554 shutdown_connections 2024-05-03T22:42:54.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.847+0000 7f331e000700 1 --2- 172.21.15.44:0/739650554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3318114250 0x7f3318116640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:54.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.847+0000 7f331e000700 1 --2- 172.21.15.44:0/739650554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33180779d0 0x7f3318077db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:54.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.847+0000 7f331e000700 1 --2- 172.21.15.44:0/739650554 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33180782f0 0x7f3318113d10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:54.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.847+0000 7f331e000700 1 -- 172.21.15.44:0/739650554 >> 172.21.15.44:0/739650554 conn(0x7f3318101080 msgr2=0x7f33181034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:54.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.847+0000 7f331e000700 1 -- 172.21.15.44:0/739650554 shutdown_connections 2024-05-03T22:42:54.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.847+0000 7f331e000700 1 -- 172.21.15.44:0/739650554 wait complete. 2024-05-03T22:42:54.938 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.848+0000 7f331e000700 1 Processor -- start 2024-05-03T22:42:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.848+0000 7f331e000700 1 -- start start 2024-05-03T22:42:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.849+0000 7f331e000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33180779d0 0x7f33181a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.849+0000 7f331e000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33180782f0 0x7f33181a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.849+0000 7f331e000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3318114250 0x7f33181a4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.849+0000 7f331e000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3318119d70 con 0x7f33180782f0 2024-05-03T22:42:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.849+0000 7f331e000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3318119bf0 con 0x7f33180779d0 2024-05-03T22:42:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.849+0000 7f331e000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3318119ef0 con 0x7f3318114250 2024-05-03T22:42:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.849+0000 7f330fe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33180782f0 0x7f33181a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.849+0000 7f330fe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33180782f0 0x7f33181a06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41364/0 (socket says 172.21.15.44:41364) 2024-05-03T22:42:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.849+0000 7f330fe00700 1 -- 172.21.15.44:0/2886294552 learned_addr learned my addr 172.21.15.44:0/2886294552 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:42:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.849+0000 7f331cc00700 1 --2- 172.21.15.44:0/2886294552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33180779d0 0x7f33181a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.849+0000 7f331d600700 1 --2- 172.21.15.44:0/2886294552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3318114250 0x7f33181a4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.850+0000 7f330fe00700 1 -- 172.21.15.44:0/2886294552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3318114250 msgr2=0x7f33181a4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.850+0000 7f330fe00700 1 --2- 172.21.15.44:0/2886294552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3318114250 0x7f33181a4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:54.939 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.850+0000 7f330fe00700 1 -- 172.21.15.44:0/2886294552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33180779d0 msgr2=0x7f33181a0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.850+0000 7f330fe00700 1 --2- 172.21.15.44:0/2886294552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33180779d0 0x7f33181a0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.850+0000 7f330fe00700 1 -- 172.21.15.44:0/2886294552 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33181a5190 con 0x7f33180782f0 2024-05-03T22:42:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.850+0000 7f331cc00700 1 --2- 172.21.15.44:0/2886294552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33180779d0 0x7f33181a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:42:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.850+0000 7f330fe00700 1 --2- 172.21.15.44:0/2886294552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33180782f0 0x7f33181a06c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3300005910 tx=0x7f3300009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.850+0000 7f3316000700 1 -- 172.21.15.44:0/2886294552 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300027070 con 0x7f33180782f0 2024-05-03T22:42:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.850+0000 7f3316000700 1 -- 172.21.15.44:0/2886294552 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f3300003f70 con 0x7f33180782f0 2024-05-03T22:42:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.850+0000 7f331e000700 1 -- 172.21.15.44:0/2886294552 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33181a5420 con 0x7f33180782f0 2024-05-03T22:42:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.850+0000 7f3316000700 1 -- 172.21.15.44:0/2886294552 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300022e00 con 0x7f33180782f0 2024-05-03T22:42:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.850+0000 7f331e000700 1 -- 172.21.15.44:0/2886294552 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33181acd00 con 0x7f33180782f0 2024-05-03T22:42:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.851+0000 7f331e000700 1 -- 172.21.15.44:0/2886294552 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3318116680 con 0x7f33180782f0 2024-05-03T22:42:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.854+0000 7f3316000700 1 -- 172.21.15.44:0/2886294552 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f330002a070 con 0x7f33180782f0 2024-05-03T22:42:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.855+0000 7f3316000700 1 --2- 172.21.15.44:0/2886294552 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f32fc0b2990 0x7f32fc0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.855+0000 7f3316000700 1 -- 172.21.15.44:0/2886294552 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f33000e3fa0 con 0x7f33180782f0 2024-05-03T22:42:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.856+0000 7f331cc00700 1 --2- 172.21.15.44:0/2886294552 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f32fc0b2990 0x7f32fc0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.856+0000 7f3316000700 1 --2- 172.21.15.44:0/2886294552 >> [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386] conn(0x7f32fc0bdcc0 0x7f32fc0c0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:54.940 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.856+0000 7f3316000700 1 -- 172.21.15.44:0/2886294552 --> [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3300015ec0 con 0x7f32fc0bdcc0 2024-05-03T22:42:54.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.856+0000 7f3316000700 1 -- 172.21.15.44:0/2886294552 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f33000e4350 con 0x7f33180782f0 2024-05-03T22:42:54.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.856+0000 7f331d600700 1 --2- 172.21.15.44:0/2886294552 >> [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386] conn(0x7f32fc0bdcc0 0x7f32fc0c0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:54.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.856+0000 7f331cc00700 1 --2- 172.21.15.44:0/2886294552 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f32fc0b2990 0x7f32fc0b4e50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f330800bcf0 tx=0x7f330800b2c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:54.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.857+0000 7f331d600700 1 --2- 172.21.15.44:0/2886294552 >> [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386] conn(0x7f32fc0bdcc0 0x7f32fc0c0160 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:54.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.858+0000 7f3316000700 1 -- 172.21.15.44:0/2886294552 <== osd.9 v2:172.21.15.44:6826/414763386 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3300015ec0 con 0x7f32fc0bdcc0 2024-05-03T22:42:54.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.877+0000 7f331e000700 1 -- 172.21.15.44:0/2886294552 --> [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3318079110 con 0x7f32fc0bdcc0 2024-05-03T22:42:54.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.878+0000 7f3316000700 1 -- 172.21.15.44:0/2886294552 <== osd.9 v2:172.21.15.44:6826/414763386 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3318079110 con 0x7f32fc0bdcc0 2024-05-03T22:42:54.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.878+0000 7f331e000700 1 -- 172.21.15.44:0/2886294552 >> [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386] conn(0x7f32fc0bdcc0 msgr2=0x7f32fc0c0160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:54.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.878+0000 7f331e000700 1 --2- 172.21.15.44:0/2886294552 >> [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386] conn(0x7f32fc0bdcc0 0x7f32fc0c0160 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:54.941 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.879+0000 7f331e000700 1 -- 172.21.15.44:0/2886294552 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f32fc0b2990 msgr2=0x7f32fc0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:54.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.879+0000 7f331e000700 1 --2- 172.21.15.44:0/2886294552 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f32fc0b2990 0x7f32fc0b4e50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f330800bcf0 tx=0x7f330800b2c0 comp rx=0 tx=0).stop 2024-05-03T22:42:54.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.879+0000 7f331e000700 1 -- 172.21.15.44:0/2886294552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33180782f0 msgr2=0x7f33181a06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:54.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.879+0000 7f331e000700 1 --2- 172.21.15.44:0/2886294552 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f33180782f0 0x7f33181a06c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3300005910 tx=0x7f3300009f90 comp rx=0 tx=0).stop 2024-05-03T22:42:54.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.879+0000 7f331d600700 1 -- 172.21.15.44:0/2886294552 reap_dead start 2024-05-03T22:42:54.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.879+0000 7f331e000700 1 -- 172.21.15.44:0/2886294552 shutdown_connections 2024-05-03T22:42:54.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.879+0000 7f331e000700 1 -- 172.21.15.44:0/2886294552 >> 172.21.15.44:0/2886294552 conn(0x7f3318101080 msgr2=0x7f3318103470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:54.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.879+0000 7f331e000700 1 -- 172.21.15.44:0/2886294552 shutdown_connections 2024-05-03T22:42:54.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:53.879+0000 7f331e000700 1 -- 172.21.15.44:0/2886294552 wait complete. 2024-05-03T22:42:55.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.985+0000 7f08d2800700 1 -- 172.21.15.44:0/2250116907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08cc075840 msgr2=0x7f08cc075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:55.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.985+0000 7f08d2800700 1 --2- 172.21.15.44:0/2250116907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08cc075840 0x7f08cc075c20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f08c000b0a0 tx=0x7f08c000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:42:55.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.985+0000 7f08d2800700 1 -- 172.21.15.44:0/2250116907 shutdown_connections 2024-05-03T22:42:55.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.985+0000 7f08d2800700 1 --2- 172.21.15.44:0/2250116907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08cc1143d0 0x7f08cc1167c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:55.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.985+0000 7f08d2800700 1 --2- 172.21.15.44:0/2250116907 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08cc075840 0x7f08cc075c20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:55.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.985+0000 7f08d2800700 1 --2- 172.21.15.44:0/2250116907 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08cc076160 0x7f08cc113e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:55.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.985+0000 7f08d2800700 1 -- 172.21.15.44:0/2250116907 >> 172.21.15.44:0/2250116907 conn(0x7f08cc0feeb0 msgr2=0x7f08cc1012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:55.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.985+0000 7f08d2800700 1 -- 172.21.15.44:0/2250116907 shutdown_connections 2024-05-03T22:42:55.890 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.985+0000 7f08d2800700 1 -- 172.21.15.44:0/2250116907 wait complete. 2024-05-03T22:42:55.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.986+0000 7f08d2800700 1 Processor -- start 2024-05-03T22:42:55.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.987+0000 7f08d2800700 1 -- start start 2024-05-03T22:42:55.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.987+0000 7f08d2800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08cc075840 0x7f08cc1a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:55.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.987+0000 7f08d2800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08cc076160 0x7f08cc1a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:55.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.987+0000 7f08d2800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08cc1143d0 0x7f08cc1a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:55.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.987+0000 7f08d2800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc119d50 con 0x7f08cc076160 2024-05-03T22:42:55.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.987+0000 7f08d2800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc119bd0 con 0x7f08cc075840 2024-05-03T22:42:55.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.987+0000 7f08d2800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f08cc119ed0 con 0x7f08cc1143d0 2024-05-03T22:42:55.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.987+0000 7f08d0a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08cc076160 0x7f08cc1a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:55.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.987+0000 7f08d0a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08cc076160 0x7f08cc1a0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41382/0 (socket says 172.21.15.44:41382) 2024-05-03T22:42:55.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.987+0000 7f08d0a00700 1 -- 172.21.15.44:0/2530955671 learned_addr learned my addr 172.21.15.44:0/2530955671 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:42:55.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.988+0000 7f08d1400700 1 --2- 172.21.15.44:0/2530955671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08cc075840 0x7f08cc1a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:55.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.988+0000 7f08d1e00700 1 --2- 172.21.15.44:0/2530955671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08cc1143d0 0x7f08cc1a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:55.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.988+0000 7f08d0a00700 1 -- 172.21.15.44:0/2530955671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08cc1143d0 msgr2=0x7f08cc1a4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:55.891 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.988+0000 7f08d0a00700 1 --2- 172.21.15.44:0/2530955671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08cc1143d0 0x7f08cc1a4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:55.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.988+0000 7f08d0a00700 1 -- 172.21.15.44:0/2530955671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08cc075840 msgr2=0x7f08cc1a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:55.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.988+0000 7f08d0a00700 1 --2- 172.21.15.44:0/2530955671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08cc075840 0x7f08cc1a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:55.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.988+0000 7f08d0a00700 1 -- 172.21.15.44:0/2530955671 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08cc1a51e0 con 0x7f08cc076160 2024-05-03T22:42:55.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.988+0000 7f08d1e00700 1 --2- 172.21.15.44:0/2530955671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08cc1143d0 0x7f08cc1a4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:42:55.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.988+0000 7f08d0a00700 1 --2- 172.21.15.44:0/2530955671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08cc076160 0x7f08cc1a0760 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f08b800d980 tx=0x7f08b800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:55.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.989+0000 7f08ca000700 1 -- 172.21.15.44:0/2530955671 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8017070 con 0x7f08cc076160 2024-05-03T22:42:55.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.989+0000 7f08ca000700 1 -- 172.21.15.44:0/2530955671 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f08b8004d00 con 0x7f08cc076160 2024-05-03T22:42:55.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.989+0000 7f08d2800700 1 -- 172.21.15.44:0/2530955671 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08cc1a54d0 con 0x7f08cc076160 2024-05-03T22:42:55.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.989+0000 7f08ca000700 1 -- 172.21.15.44:0/2530955671 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8005540 con 0x7f08cc076160 2024-05-03T22:42:55.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.989+0000 7f08d2800700 1 -- 172.21.15.44:0/2530955671 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08cc1acd50 con 0x7f08cc076160 2024-05-03T22:42:55.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.990+0000 7f08d2800700 1 -- 172.21.15.44:0/2530955671 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f08cc101000 con 0x7f08cc076160 2024-05-03T22:42:55.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.992+0000 7f08ca000700 1 -- 172.21.15.44:0/2530955671 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f08b8004750 con 0x7f08cc076160 2024-05-03T22:42:55.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.994+0000 7f08ca000700 1 --2- 172.21.15.44:0/2530955671 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f08b40b2990 0x7f08b40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:55.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.994+0000 7f08ca000700 1 -- 172.21.15.44:0/2530955671 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f08b80e2ca0 con 0x7f08cc076160 2024-05-03T22:42:55.892 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.994+0000 7f08d1400700 1 --2- 172.21.15.44:0/2530955671 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f08b40b2990 0x7f08b40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:55.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.994+0000 7f08ca000700 1 --2- 172.21.15.44:0/2530955671 >> [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560] conn(0x7f08b40bddf0 0x7f08b40c0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:55.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.994+0000 7f08ca000700 1 -- 172.21.15.44:0/2530955671 --> [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f08b40c0960 con 0x7f08b40bddf0 2024-05-03T22:42:55.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.994+0000 7f08ca000700 1 -- 172.21.15.44:0/2530955671 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f08b80e30f0 con 0x7f08cc076160 2024-05-03T22:42:55.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.995+0000 7f08d1e00700 1 --2- 172.21.15.44:0/2530955671 >> [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560] conn(0x7f08b40bddf0 0x7f08b40c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:55.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.995+0000 7f08d1400700 1 --2- 172.21.15.44:0/2530955671 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f08b40b2990 0x7f08b40b4e50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f08c00062a0 tx=0x7f08c00061f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:55.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.995+0000 7f08d1e00700 1 --2- 172.21.15.44:0/2530955671 >> [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560] conn(0x7f08b40bddf0 0x7f08b40c0290 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:55.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:54.996+0000 7f08ca000700 1 -- 172.21.15.44:0/2530955671 <== osd.0 v2:172.21.15.44:6802/4219032560 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f08b40c0960 con 0x7f08b40bddf0 2024-05-03T22:42:55.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:55.015+0000 7f08d2800700 1 -- 172.21.15.44:0/2530955671 --> [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f08cc076f80 con 0x7f08b40bddf0 2024-05-03T22:42:55.893 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:55.015+0000 7f08ca000700 1 -- 172.21.15.44:0/2530955671 <== osd.0 v2:172.21.15.44:6802/4219032560 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f08cc076f80 con 0x7f08b40bddf0 2024-05-03T22:42:55.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:55.016+0000 7f08d2800700 1 -- 172.21.15.44:0/2530955671 >> [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560] conn(0x7f08b40bddf0 msgr2=0x7f08b40c0290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:55.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:55.016+0000 7f08d2800700 1 --2- 172.21.15.44:0/2530955671 >> [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560] conn(0x7f08b40bddf0 0x7f08b40c0290 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:55.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:55.016+0000 7f08d2800700 1 -- 172.21.15.44:0/2530955671 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f08b40b2990 msgr2=0x7f08b40b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:55.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:55.016+0000 7f08d2800700 1 --2- 172.21.15.44:0/2530955671 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f08b40b2990 0x7f08b40b4e50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f08c00062a0 tx=0x7f08c00061f0 comp rx=0 tx=0).stop 2024-05-03T22:42:55.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:55.016+0000 7f08d2800700 1 -- 172.21.15.44:0/2530955671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08cc076160 msgr2=0x7f08cc1a0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:55.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:55.016+0000 7f08d2800700 1 --2- 172.21.15.44:0/2530955671 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f08cc076160 0x7f08cc1a0760 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f08b800d980 tx=0x7f08b800dd40 comp rx=0 tx=0).stop 2024-05-03T22:42:55.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:55.016+0000 7f08d1e00700 1 -- 172.21.15.44:0/2530955671 reap_dead start 2024-05-03T22:42:55.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:55.017+0000 7f08d2800700 1 -- 172.21.15.44:0/2530955671 shutdown_connections 2024-05-03T22:42:55.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:55.017+0000 7f08d2800700 1 -- 172.21.15.44:0/2530955671 >> 172.21.15.44:0/2530955671 conn(0x7f08cc0feeb0 msgr2=0x7f08cc1005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:55.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:55.017+0000 7f08d2800700 1 -- 172.21.15.44:0/2530955671 shutdown_connections 2024-05-03T22:42:55.894 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:55.017+0000 7f08d2800700 1 -- 172.21.15.44:0/2530955671 wait complete. 2024-05-03T22:42:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:56 smithi044 ceph-mon[28604]: pgmap v462: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-05-03T22:42:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:56 smithi060 ceph-mon[31721]: pgmap v462: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-05-03T22:42:56.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:56 smithi160 ceph-mon[32531]: pgmap v462: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 op/s 2024-05-03T22:42:56.672 INFO:teuthology.orchestra.run.smithi044.stdout:77309411444 2024-05-03T22:42:56.672 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-03T22:42:57.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.382+0000 7fb8ffc00700 1 -- 172.21.15.44:0/3856060157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8f8106070 msgr2=0x7fb8f8112580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:57.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.382+0000 7fb8ffc00700 1 --2- 172.21.15.44:0/3856060157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8f8106070 0x7fb8f8112580 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb8f000b0a0 tx=0x7fb8f000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:42:57.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.382+0000 7fb8ffc00700 1 -- 172.21.15.44:0/3856060157 shutdown_connections 2024-05-03T22:42:57.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.382+0000 7fb8ffc00700 1 --2- 172.21.15.44:0/3856060157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8f8106070 0x7fb8f8112580 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:57.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.382+0000 7fb8ffc00700 1 --2- 172.21.15.44:0/3856060157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f810b6b0 0x7fb8f810ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:57.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.382+0000 7fb8ffc00700 1 --2- 172.21.15.44:0/3856060157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8f81056b0 0x7fb8f8105b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:57.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.382+0000 7fb8ffc00700 1 -- 172.21.15.44:0/3856060157 >> 172.21.15.44:0/3856060157 conn(0x7fb8f81011a0 msgr2=0x7fb8f81035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:57.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.382+0000 7fb8ffc00700 1 -- 172.21.15.44:0/3856060157 shutdown_connections 2024-05-03T22:42:57.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.382+0000 7fb8ffc00700 1 -- 172.21.15.44:0/3856060157 wait complete. 2024-05-03T22:42:57.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.384+0000 7fb8ffc00700 1 Processor -- start 2024-05-03T22:42:57.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.384+0000 7fb8ffc00700 1 -- start start 2024-05-03T22:42:57.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.385+0000 7fb8ffc00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8f81056b0 0x7fb8f819be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:57.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.385+0000 7fb8ffc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f8106070 0x7fb8f819c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:57.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.385+0000 7fb8ffc00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8f810b6b0 0x7fb8f81a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:57.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.385+0000 7fb8ffc00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f8115a20 con 0x7fb8f810b6b0 2024-05-03T22:42:57.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.385+0000 7fb8ffc00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f81158a0 con 0x7fb8f8106070 2024-05-03T22:42:57.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.385+0000 7fb8ffc00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f8115ba0 con 0x7fb8f81056b0 2024-05-03T22:42:57.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.385+0000 7fb8fdc00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8f810b6b0 0x7fb8f81a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:57.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.385+0000 7fb8fdc00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8f810b6b0 0x7fb8f81a0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41392/0 (socket says 172.21.15.44:41392) 2024-05-03T22:42:57.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.385+0000 7fb8fdc00700 1 -- 172.21.15.44:0/4032732968 learned_addr learned my addr 172.21.15.44:0/4032732968 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:42:57.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.385+0000 7fb8fd200700 1 --2- 172.21.15.44:0/4032732968 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8f81056b0 0x7fb8f819be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:57.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.385+0000 7fb8f7e00700 1 --2- 172.21.15.44:0/4032732968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f8106070 0x7fb8f819c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:57.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.386+0000 7fb8fdc00700 1 -- 172.21.15.44:0/4032732968 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8f81056b0 msgr2=0x7fb8f819be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:57.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.386+0000 7fb8fdc00700 1 --2- 172.21.15.44:0/4032732968 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8f81056b0 0x7fb8f819be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:57.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.386+0000 7fb8fdc00700 1 -- 172.21.15.44:0/4032732968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f8106070 msgr2=0x7fb8f819c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:57.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.386+0000 7fb8fdc00700 1 --2- 172.21.15.44:0/4032732968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8f8106070 0x7fb8f819c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:57.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.386+0000 7fb8fdc00700 1 -- 172.21.15.44:0/4032732968 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f81a0e60 con 0x7fb8f810b6b0 2024-05-03T22:42:57.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.386+0000 7fb8fdc00700 1 --2- 172.21.15.44:0/4032732968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8f810b6b0 0x7fb8f81a0720 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0006070 tx=0x7fb8f0004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:57.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.386+0000 7fb8f5600700 1 -- 172.21.15.44:0/4032732968 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0021070 con 0x7fb8f810b6b0 2024-05-03T22:42:57.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.387+0000 7fb8f5600700 1 -- 172.21.15.44:0/4032732968 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fb8f0007e50 con 0x7fb8f810b6b0 2024-05-03T22:42:57.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.387+0000 7fb8ffc00700 1 -- 172.21.15.44:0/4032732968 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f81a10f0 con 0x7fb8f810b6b0 2024-05-03T22:42:57.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.387+0000 7fb8f5600700 1 -- 172.21.15.44:0/4032732968 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f00046f0 con 0x7fb8f810b6b0 2024-05-03T22:42:57.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.387+0000 7fb8ffc00700 1 -- 172.21.15.44:0/4032732968 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f81a89d0 con 0x7fb8f810b6b0 2024-05-03T22:42:57.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.389+0000 7fb8ffc00700 1 -- 172.21.15.44:0/4032732968 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb8f8063c30 con 0x7fb8f810b6b0 2024-05-03T22:42:57.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.391+0000 7fb8f5600700 1 -- 172.21.15.44:0/4032732968 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb8f0007980 con 0x7fb8f810b6b0 2024-05-03T22:42:57.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.392+0000 7fb8f5600700 1 --2- 172.21.15.44:0/4032732968 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb8e00b2990 0x7fb8e00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:57.395 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.393+0000 7fb8f5600700 1 -- 172.21.15.44:0/4032732968 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fb8f000f020 con 0x7fb8f810b6b0 2024-05-03T22:42:57.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.393+0000 7fb8fd200700 1 --2- 172.21.15.44:0/4032732968 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb8e00b2990 0x7fb8e00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:57.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.393+0000 7fb8f5600700 1 --2- 172.21.15.44:0/4032732968 >> [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764] conn(0x7fb8e00bddf0 0x7fb8e00c0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:57.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.393+0000 7fb8f5600700 1 -- 172.21.15.44:0/4032732968 --> [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb8f001ce50 con 0x7fb8e00bddf0 2024-05-03T22:42:57.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.393+0000 7fb8f5600700 1 -- 172.21.15.44:0/4032732968 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fb8f00e82a0 con 0x7fb8f810b6b0 2024-05-03T22:42:57.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.394+0000 7fb8f7e00700 1 --2- 172.21.15.44:0/4032732968 >> [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764] conn(0x7fb8e00bddf0 0x7fb8e00c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:57.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.394+0000 7fb8fd200700 1 --2- 172.21.15.44:0/4032732968 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb8e00b2990 0x7fb8e00b4e50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009be0 tx=0x7fb8ec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:57.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.394+0000 7fb8f7e00700 1 --2- 172.21.15.44:0/4032732968 >> [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764] conn(0x7fb8e00bddf0 0x7fb8e00c0290 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:57.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.395+0000 7fb8f5600700 1 -- 172.21.15.44:0/4032732968 <== osd.6 v2:172.21.15.44:6818/2805326764 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb8f001ce50 con 0x7fb8e00bddf0 2024-05-03T22:42:57.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.414+0000 7fb8ffc00700 1 -- 172.21.15.44:0/4032732968 --> [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb8f8064030 con 0x7fb8e00bddf0 2024-05-03T22:42:57.417 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.415+0000 7fb8f5600700 1 -- 172.21.15.44:0/4032732968 <== osd.6 v2:172.21.15.44:6818/2805326764 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb8f8064030 con 0x7fb8e00bddf0 2024-05-03T22:42:57.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.415+0000 7fb8ffc00700 1 -- 172.21.15.44:0/4032732968 >> [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764] conn(0x7fb8e00bddf0 msgr2=0x7fb8e00c0290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:57.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.415+0000 7fb8ffc00700 1 --2- 172.21.15.44:0/4032732968 >> [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764] conn(0x7fb8e00bddf0 0x7fb8e00c0290 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:57.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.416+0000 7fb8ffc00700 1 -- 172.21.15.44:0/4032732968 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb8e00b2990 msgr2=0x7fb8e00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:57.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.416+0000 7fb8ffc00700 1 --2- 172.21.15.44:0/4032732968 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb8e00b2990 0x7fb8e00b4e50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec009be0 tx=0x7fb8ec009260 comp rx=0 tx=0).stop 2024-05-03T22:42:57.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.416+0000 7fb8ffc00700 1 -- 172.21.15.44:0/4032732968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8f810b6b0 msgr2=0x7fb8f81a0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:57.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.416+0000 7fb8ffc00700 1 --2- 172.21.15.44:0/4032732968 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb8f810b6b0 0x7fb8f81a0720 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0006070 tx=0x7fb8f0004c80 comp rx=0 tx=0).stop 2024-05-03T22:42:57.418 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.416+0000 7fb8fdc00700 1 -- 172.21.15.44:0/4032732968 reap_dead start 2024-05-03T22:42:57.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.416+0000 7fb8ffc00700 1 -- 172.21.15.44:0/4032732968 shutdown_connections 2024-05-03T22:42:57.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.416+0000 7fb8ffc00700 1 -- 172.21.15.44:0/4032732968 >> 172.21.15.44:0/4032732968 conn(0x7fb8f81011a0 msgr2=0x7fb8f81016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:57.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.416+0000 7fb8ffc00700 1 -- 172.21.15.44:0/4032732968 shutdown_connections 2024-05-03T22:42:57.419 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:57.416+0000 7fb8ffc00700 1 -- 172.21.15.44:0/4032732968 wait complete. 2024-05-03T22:42:58.197 INFO:teuthology.orchestra.run.smithi044.stdout:34359738497 2024-05-03T22:42:58.197 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-03T22:42:58.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:42:58 smithi044 ceph-mon[28604]: pgmap v463: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:42:58.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:42:58 smithi060 ceph-mon[31721]: pgmap v463: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:42:58.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:42:58 smithi160 ceph-mon[32531]: pgmap v463: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:42:59.340 INFO:teuthology.orchestra.run.smithi044.stdout:253403070532 2024-05-03T22:42:59.340 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-03T22:42:59.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.358+0000 7f9e58400700 1 -- 172.21.15.44:0/4109255603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e5006b6f0 msgr2=0x7f9e5006bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:59.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.358+0000 7f9e58400700 1 --2- 172.21.15.44:0/4109255603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e5006b6f0 0x7f9e5006bb50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c009990 tx=0x7f9e3c009ca0 comp rx=0 tx=0).stop 2024-05-03T22:42:59.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.358+0000 7f9e58400700 1 -- 172.21.15.44:0/4109255603 shutdown_connections 2024-05-03T22:42:59.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.358+0000 7f9e58400700 1 --2- 172.21.15.44:0/4109255603 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e50105ee0 0x7f9e50106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:59.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.358+0000 7f9e58400700 1 --2- 172.21.15.44:0/4109255603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e501083d0 0x7f9e5006b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:59.380 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.358+0000 7f9e58400700 1 --2- 172.21.15.44:0/4109255603 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e5006b6f0 0x7f9e5006bb50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.358+0000 7f9e58400700 1 -- 172.21.15.44:0/4109255603 >> 172.21.15.44:0/4109255603 conn(0x7f9e50079350 msgr2=0x7f9e50079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.358+0000 7f9e58400700 1 -- 172.21.15.44:0/4109255603 shutdown_connections 2024-05-03T22:42:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.358+0000 7f9e58400700 1 -- 172.21.15.44:0/4109255603 wait complete. 2024-05-03T22:42:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.359+0000 7f9e58400700 1 Processor -- start 2024-05-03T22:42:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.359+0000 7f9e58400700 1 -- start start 2024-05-03T22:42:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.360+0000 7f9e58400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e5006b6f0 0x7f9e501a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.360+0000 7f9e58400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e50105ee0 0x7f9e501a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.360+0000 7f9e58400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e501083d0 0x7f9e501a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.360+0000 7f9e58400700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9e50119dd0 con 0x7f9e50105ee0 2024-05-03T22:42:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.360+0000 7f9e58400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9e50119c50 con 0x7f9e501083d0 2024-05-03T22:42:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.360+0000 7f9e58400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9e50119f50 con 0x7f9e5006b6f0 2024-05-03T22:42:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.360+0000 7f9e55000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e50105ee0 0x7f9e501a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.360+0000 7f9e55000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e50105ee0 0x7f9e501a0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:41414/0 (socket says 172.21.15.44:41414) 2024-05-03T22:42:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.360+0000 7f9e55000700 1 -- 172.21.15.44:0/1855724930 learned_addr learned my addr 172.21.15.44:0/1855724930 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:42:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.361+0000 7f9e55a00700 1 --2- 172.21.15.44:0/1855724930 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e5006b6f0 0x7f9e501a02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:59.381 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.361+0000 7f9e56400700 1 --2- 172.21.15.44:0/1855724930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e501083d0 0x7f9e501a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.361+0000 7f9e55000700 1 -- 172.21.15.44:0/1855724930 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e5006b6f0 msgr2=0x7f9e501a02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.361+0000 7f9e55000700 1 --2- 172.21.15.44:0/1855724930 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e5006b6f0 0x7f9e501a02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.361+0000 7f9e55000700 1 -- 172.21.15.44:0/1855724930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e501083d0 msgr2=0x7f9e501a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.361+0000 7f9e55000700 1 --2- 172.21.15.44:0/1855724930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e501083d0 0x7f9e501a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.361+0000 7f9e55000700 1 -- 172.21.15.44:0/1855724930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e501a52f0 con 0x7f9e50105ee0 2024-05-03T22:42:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.361+0000 7f9e55000700 1 --2- 172.21.15.44:0/1855724930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e50105ee0 0x7f9e501a0820 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0057c0 tx=0x7f9e3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.361+0000 7f9e4e000700 1 -- 172.21.15.44:0/1855724930 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c027070 con 0x7f9e50105ee0 2024-05-03T22:42:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.362+0000 7f9e58400700 1 -- 172.21.15.44:0/1855724930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e501a5580 con 0x7f9e50105ee0 2024-05-03T22:42:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.362+0000 7f9e4e000700 1 -- 172.21.15.44:0/1855724930 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f9e3c004070 con 0x7f9e50105ee0 2024-05-03T22:42:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.362+0000 7f9e4e000700 1 -- 172.21.15.44:0/1855724930 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c022d40 con 0x7f9e50105ee0 2024-05-03T22:42:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.362+0000 7f9e58400700 1 -- 172.21.15.44:0/1855724930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e501ace60 con 0x7f9e50105ee0 2024-05-03T22:42:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.363+0000 7f9e58400700 1 -- 172.21.15.44:0/1855724930 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e501058a0 con 0x7f9e50105ee0 2024-05-03T22:42:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.367+0000 7f9e4e000700 1 -- 172.21.15.44:0/1855724930 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9e3c02a070 con 0x7f9e50105ee0 2024-05-03T22:42:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.369+0000 7f9e4e000700 1 --2- 172.21.15.44:0/1855724930 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9e380b2910 0x7f9e380b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:59.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.369+0000 7f9e4e000700 1 -- 172.21.15.44:0/1855724930 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f9e3c0e3e40 con 0x7f9e50105ee0 2024-05-03T22:42:59.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.369+0000 7f9e55a00700 1 --2- 172.21.15.44:0/1855724930 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9e380b2910 0x7f9e380b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:59.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.369+0000 7f9e4e000700 1 --2- 172.21.15.44:0/1855724930 >> [v2:172.21.15.60:6816/693512829,v1:172.21.15.60:6817/693512829] conn(0x7f9e380bdd70 0x7f9e380c0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:42:59.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.369+0000 7f9e4e000700 1 -- 172.21.15.44:0/1855724930 --> [v2:172.21.15.60:6816/693512829,v1:172.21.15.60:6817/693512829] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e3c01fec0 con 0x7f9e380bdd70 2024-05-03T22:42:59.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.369+0000 7f9e4e000700 1 -- 172.21.15.44:0/1855724930 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f9e3c0e41f0 con 0x7f9e50105ee0 2024-05-03T22:42:59.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.370+0000 7f9e55a00700 1 --2- 172.21.15.44:0/1855724930 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9e380b2910 0x7f9e380b4dd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9e44005950 tx=0x7f9e440058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:59.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.370+0000 7f9e56400700 1 --2- 172.21.15.44:0/1855724930 >> [v2:172.21.15.60:6816/693512829,v1:172.21.15.60:6817/693512829] conn(0x7f9e380bdd70 0x7f9e380c0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:42:59.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.371+0000 7f9e56400700 1 --2- 172.21.15.44:0/1855724930 >> [v2:172.21.15.60:6816/693512829,v1:172.21.15.60:6817/693512829] conn(0x7f9e380bdd70 0x7f9e380c0210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:42:59.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.374+0000 7f9e4e000700 1 -- 172.21.15.44:0/1855724930 <== osd.7 v2:172.21.15.60:6816/693512829 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e3c01fec0 con 0x7f9e380bdd70 2024-05-03T22:42:59.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.393+0000 7f9e58400700 1 -- 172.21.15.44:0/1855724930 --> [v2:172.21.15.60:6816/693512829,v1:172.21.15.60:6817/693512829] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9e501029c0 con 0x7f9e380bdd70 2024-05-03T22:42:59.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.394+0000 7f9e4e000700 1 -- 172.21.15.44:0/1855724930 <== osd.7 v2:172.21.15.60:6816/693512829 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9e501029c0 con 0x7f9e380bdd70 2024-05-03T22:42:59.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.395+0000 7f9e58400700 1 -- 172.21.15.44:0/1855724930 >> [v2:172.21.15.60:6816/693512829,v1:172.21.15.60:6817/693512829] conn(0x7f9e380bdd70 msgr2=0x7f9e380c0210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:59.397 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.395+0000 7f9e58400700 1 --2- 172.21.15.44:0/1855724930 >> [v2:172.21.15.60:6816/693512829,v1:172.21.15.60:6817/693512829] conn(0x7f9e380bdd70 0x7f9e380c0210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:42:59.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.395+0000 7f9e58400700 1 -- 172.21.15.44:0/1855724930 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9e380b2910 msgr2=0x7f9e380b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:59.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.395+0000 7f9e58400700 1 --2- 172.21.15.44:0/1855724930 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9e380b2910 0x7f9e380b4dd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9e44005950 tx=0x7f9e440058e0 comp rx=0 tx=0).stop 2024-05-03T22:42:59.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.395+0000 7f9e58400700 1 -- 172.21.15.44:0/1855724930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e50105ee0 msgr2=0x7f9e501a0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:42:59.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.395+0000 7f9e58400700 1 --2- 172.21.15.44:0/1855724930 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9e50105ee0 0x7f9e501a0820 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0057c0 tx=0x7f9e3c0057f0 comp rx=0 tx=0).stop 2024-05-03T22:42:59.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.395+0000 7f9e56400700 1 -- 172.21.15.44:0/1855724930 reap_dead start 2024-05-03T22:42:59.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.395+0000 7f9e58400700 1 -- 172.21.15.44:0/1855724930 shutdown_connections 2024-05-03T22:42:59.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.395+0000 7f9e58400700 1 -- 172.21.15.44:0/1855724930 >> 172.21.15.44:0/1855724930 conn(0x7f9e50079350 msgr2=0x7f9e50104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:42:59.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.395+0000 7f9e58400700 1 -- 172.21.15.44:0/1855724930 shutdown_connections 2024-05-03T22:42:59.398 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:42:59.395+0000 7f9e58400700 1 -- 172.21.15.44:0/1855724930 wait complete. 2024-05-03T22:43:00.402 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:00 smithi044 ceph-mon[28604]: pgmap v464: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:43:00.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:00 smithi060 ceph-mon[31721]: pgmap v464: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:43:00.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:00 smithi160 ceph-mon[32531]: pgmap v464: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:43:00.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.399+0000 7f88b7e00700 1 -- 172.21.15.44:0/2038047886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88b806ba10 msgr2=0x7f88b806be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:00.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.399+0000 7f88b7e00700 1 --2- 172.21.15.44:0/2038047886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88b806ba10 0x7f88b806be90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009990 tx=0x7f88a0009ca0 comp rx=0 tx=0).stop 2024-05-03T22:43:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.399+0000 7f88b7e00700 1 -- 172.21.15.44:0/2038047886 shutdown_connections 2024-05-03T22:43:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.399+0000 7f88b7e00700 1 --2- 172.21.15.44:0/2038047886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88b806c3d0 0x7f88b81102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.399+0000 7f88b7e00700 1 --2- 172.21.15.44:0/2038047886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88b8109510 0x7f88b81098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.399+0000 7f88b7e00700 1 --2- 172.21.15.44:0/2038047886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88b806ba10 0x7f88b806be90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.399+0000 7f88b7e00700 1 -- 172.21.15.44:0/2038047886 >> 172.21.15.44:0/2038047886 conn(0x7f88b80791e0 msgr2=0x7f88b80795f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.399+0000 7f88b7e00700 1 -- 172.21.15.44:0/2038047886 shutdown_connections 2024-05-03T22:43:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.399+0000 7f88b7e00700 1 -- 172.21.15.44:0/2038047886 wait complete. 2024-05-03T22:43:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.401+0000 7f88b7e00700 1 Processor -- start 2024-05-03T22:43:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.401+0000 7f88b7e00700 1 -- start start 2024-05-03T22:43:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.402+0000 7f88b7e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88b806ba10 0x7f88b819f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.402+0000 7f88b7e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88b806c3d0 0x7f88b819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:00.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.402+0000 7f88b7e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88b8109510 0x7f88b81999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.402+0000 7f88b7e00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f88b81136a0 con 0x7f88b806ba10 2024-05-03T22:43:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.402+0000 7f88b7e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f88b8113520 con 0x7f88b8109510 2024-05-03T22:43:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.402+0000 7f88b7e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f88b8113820 con 0x7f88b806c3d0 2024-05-03T22:43:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.402+0000 7f88b6a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88b806ba10 0x7f88b819f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.402+0000 7f88b6a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88b806ba10 0x7f88b819f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36308/0 (socket says 172.21.15.44:36308) 2024-05-03T22:43:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.402+0000 7f88b6a00700 1 -- 172.21.15.44:0/2707330693 learned_addr learned my addr 172.21.15.44:0/2707330693 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.402+0000 7f88ae000700 1 --2- 172.21.15.44:0/2707330693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88b806c3d0 0x7f88b819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.402+0000 7f88b7400700 1 --2- 172.21.15.44:0/2707330693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88b8109510 0x7f88b81999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.403+0000 7f88b6a00700 1 -- 172.21.15.44:0/2707330693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88b806c3d0 msgr2=0x7f88b819fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.403+0000 7f88b6a00700 1 --2- 172.21.15.44:0/2707330693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88b806c3d0 0x7f88b819fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.403+0000 7f88b6a00700 1 -- 172.21.15.44:0/2707330693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88b8109510 msgr2=0x7f88b81999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.403+0000 7f88b6a00700 1 --2- 172.21.15.44:0/2707330693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88b8109510 0x7f88b81999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.403+0000 7f88b6a00700 1 -- 172.21.15.44:0/2707330693 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88b819a100 con 0x7f88b806ba10 2024-05-03T22:43:00.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.403+0000 7f88b6a00700 1 --2- 172.21.15.44:0/2707330693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88b806ba10 0x7f88b819f7e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f88a80060b0 tx=0x7f88a8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:00.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.403+0000 7f88afe00700 1 -- 172.21.15.44:0/2707330693 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a801a070 con 0x7f88b806ba10 2024-05-03T22:43:00.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.403+0000 7f88afe00700 1 -- 172.21.15.44:0/2707330693 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f88a800de20 con 0x7f88b806ba10 2024-05-03T22:43:00.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.403+0000 7f88afe00700 1 -- 172.21.15.44:0/2707330693 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a80147c0 con 0x7f88b806ba10 2024-05-03T22:43:00.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.403+0000 7f88b7e00700 1 -- 172.21.15.44:0/2707330693 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88b819a3f0 con 0x7f88b806ba10 2024-05-03T22:43:00.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.403+0000 7f88b7e00700 1 -- 172.21.15.44:0/2707330693 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88b81a66b0 con 0x7f88b806ba10 2024-05-03T22:43:00.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.404+0000 7f88b7e00700 1 -- 172.21.15.44:0/2707330693 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f88b8063c30 con 0x7f88b806ba10 2024-05-03T22:43:00.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.407+0000 7f88afe00700 1 -- 172.21.15.44:0/2707330693 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f88a801d070 con 0x7f88b806ba10 2024-05-03T22:43:00.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.409+0000 7f88afe00700 1 --2- 172.21.15.44:0/2707330693 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f889c0b2990 0x7f889c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:00.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.409+0000 7f88afe00700 1 -- 172.21.15.44:0/2707330693 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f88a80e27f0 con 0x7f88b806ba10 2024-05-03T22:43:00.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.409+0000 7f88afe00700 1 --2- 172.21.15.44:0/2707330693 >> [v2:172.21.15.160:6816/2920554498,v1:172.21.15.160:6817/2920554498] conn(0x7f889c0bddf0 0x7f889c0c0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:00.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.409+0000 7f88ae000700 1 --2- 172.21.15.44:0/2707330693 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f889c0b2990 0x7f889c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:00.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.409+0000 7f88afe00700 1 -- 172.21.15.44:0/2707330693 --> [v2:172.21.15.160:6816/2920554498,v1:172.21.15.160:6817/2920554498] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f889c0c0960 con 0x7f889c0bddf0 2024-05-03T22:43:00.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.409+0000 7f88afe00700 1 -- 172.21.15.44:0/2707330693 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f88a80e2ba0 con 0x7f88b806ba10 2024-05-03T22:43:00.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.410+0000 7f88ae000700 1 --2- 172.21.15.44:0/2707330693 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f889c0b2990 0x7f889c0b4e50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f88a0006010 tx=0x7f88a000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:00.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.418+0000 7f88b7400700 1 --2- 172.21.15.44:0/2707330693 >> [v2:172.21.15.160:6816/2920554498,v1:172.21.15.160:6817/2920554498] conn(0x7f889c0bddf0 0x7f889c0c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:00.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.420+0000 7f88b7400700 1 --2- 172.21.15.44:0/2707330693 >> [v2:172.21.15.160:6816/2920554498,v1:172.21.15.160:6817/2920554498] conn(0x7f889c0bddf0 0x7f889c0c0290 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:00.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.422+0000 7f88afe00700 1 -- 172.21.15.44:0/2707330693 <== osd.8 v2:172.21.15.160:6816/2920554498 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f889c0c0960 con 0x7f889c0bddf0 2024-05-03T22:43:00.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.441+0000 7f88b7e00700 1 -- 172.21.15.44:0/2707330693 --> [v2:172.21.15.160:6816/2920554498,v1:172.21.15.160:6817/2920554498] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f88b8064030 con 0x7f889c0bddf0 2024-05-03T22:43:00.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.442+0000 7f88afe00700 1 -- 172.21.15.44:0/2707330693 <== osd.8 v2:172.21.15.160:6816/2920554498 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f88b8064030 con 0x7f889c0bddf0 2024-05-03T22:43:00.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.442+0000 7f88b7e00700 1 -- 172.21.15.44:0/2707330693 >> [v2:172.21.15.160:6816/2920554498,v1:172.21.15.160:6817/2920554498] conn(0x7f889c0bddf0 msgr2=0x7f889c0c0290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:00.697 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.442+0000 7f88b7e00700 1 --2- 172.21.15.44:0/2707330693 >> [v2:172.21.15.160:6816/2920554498,v1:172.21.15.160:6817/2920554498] conn(0x7f889c0bddf0 0x7f889c0c0290 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.443+0000 7f88b7e00700 1 -- 172.21.15.44:0/2707330693 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f889c0b2990 msgr2=0x7f889c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.443+0000 7f88b7e00700 1 --2- 172.21.15.44:0/2707330693 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f889c0b2990 0x7f889c0b4e50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f88a0006010 tx=0x7f88a000b540 comp rx=0 tx=0).stop 2024-05-03T22:43:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.443+0000 7f88b7e00700 1 -- 172.21.15.44:0/2707330693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88b806ba10 msgr2=0x7f88b819f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.443+0000 7f88b7e00700 1 --2- 172.21.15.44:0/2707330693 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f88b806ba10 0x7f88b819f7e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f88a80060b0 tx=0x7f88a8007f90 comp rx=0 tx=0).stop 2024-05-03T22:43:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.443+0000 7f88b7400700 1 -- 172.21.15.44:0/2707330693 reap_dead start 2024-05-03T22:43:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.443+0000 7f88b7e00700 1 -- 172.21.15.44:0/2707330693 shutdown_connections 2024-05-03T22:43:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.443+0000 7f88b7e00700 1 -- 172.21.15.44:0/2707330693 >> 172.21.15.44:0/2707330693 conn(0x7f88b80791e0 msgr2=0x7f88b81005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.443+0000 7f88b7e00700 1 -- 172.21.15.44:0/2707330693 shutdown_connections 2024-05-03T22:43:00.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:00.443+0000 7f88b7e00700 1 -- 172.21.15.44:0/2707330693 wait complete. 2024-05-03T22:43:02.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:02 smithi044 ceph-mon[28604]: pgmap v465: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:43:02.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:02 smithi060 ceph-mon[31721]: pgmap v465: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:43:02.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:02 smithi160 ceph-mon[32531]: pgmap v465: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:43:03.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.063+0000 7f1bd3000700 1 -- 172.21.15.44:0/1615052224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bcc10fb60 msgr2=0x7f1bcc10ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:03.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.063+0000 7f1bd3000700 1 --2- 172.21.15.44:0/1615052224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bcc10fb60 0x7f1bcc10ff40 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc009990 tx=0x7f1bbc009ca0 comp rx=0 tx=0).stop 2024-05-03T22:43:03.246 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.063+0000 7f1bd3000700 1 -- 172.21.15.44:0/1615052224 shutdown_connections 2024-05-03T22:43:03.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.063+0000 7f1bd3000700 1 --2- 172.21.15.44:0/1615052224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bcc10a490 0x7f1bcc1169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:03.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.063+0000 7f1bd3000700 1 --2- 172.21.15.44:0/1615052224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bcc10fb60 0x7f1bcc10ff40 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:03.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.063+0000 7f1bd3000700 1 --2- 172.21.15.44:0/1615052224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bcc109ad0 0x7f1bcc109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:03.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.063+0000 7f1bd3000700 1 -- 172.21.15.44:0/1615052224 >> 172.21.15.44:0/1615052224 conn(0x7f1bcc076c70 msgr2=0x7f1bcc1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:03.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.063+0000 7f1bd3000700 1 -- 172.21.15.44:0/1615052224 shutdown_connections 2024-05-03T22:43:03.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.063+0000 7f1bd3000700 1 -- 172.21.15.44:0/1615052224 wait complete. 2024-05-03T22:43:03.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.064+0000 7f1bd3000700 1 Processor -- start 2024-05-03T22:43:03.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.065+0000 7f1bd3000700 1 -- start start 2024-05-03T22:43:03.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.065+0000 7f1bd3000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bcc109ad0 0x7f1bcc1a01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:03.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.065+0000 7f1bd3000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bcc10a490 0x7f1bcc1a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:03.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.065+0000 7f1bd3000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bcc10fb60 0x7f1bcc1a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:03.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.065+0000 7f1bd3000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc119df0 con 0x7f1bcc109ad0 2024-05-03T22:43:03.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.065+0000 7f1bd3000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc119c70 con 0x7f1bcc10fb60 2024-05-03T22:43:03.247 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.065+0000 7f1bd3000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc119f70 con 0x7f1bcc10a490 2024-05-03T22:43:03.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.065+0000 7f1bcbe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bcc109ad0 0x7f1bcc1a01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:03.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.066+0000 7f1bcbe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bcc109ad0 0x7f1bcc1a01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36332/0 (socket says 172.21.15.44:36332) 2024-05-03T22:43:03.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.066+0000 7f1bcbe00700 1 -- 172.21.15.44:0/3315055575 learned_addr learned my addr 172.21.15.44:0/3315055575 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:03.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.066+0000 7f1bcb400700 1 --2- 172.21.15.44:0/3315055575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bcc10a490 0x7f1bcc1a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:03.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.066+0000 7f1bcbe00700 1 -- 172.21.15.44:0/3315055575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bcc10a490 msgr2=0x7f1bcc1a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:03.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.066+0000 7f1bcbe00700 1 --2- 172.21.15.44:0/3315055575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1bcc10a490 0x7f1bcc1a0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:03.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.066+0000 7f1bcbe00700 1 -- 172.21.15.44:0/3315055575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bcc10fb60 msgr2=0x7f1bcc1a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:03.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.066+0000 7f1bd1000700 1 --2- 172.21.15.44:0/3315055575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bcc10fb60 0x7f1bcc1a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:03.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.066+0000 7f1bcbe00700 1 --2- 172.21.15.44:0/3315055575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bcc10fb60 0x7f1bcc1a4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:03.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.066+0000 7f1bcbe00700 1 -- 172.21.15.44:0/3315055575 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bcc1a5180 con 0x7f1bcc109ad0 2024-05-03T22:43:03.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.066+0000 7f1bcbe00700 1 --2- 172.21.15.44:0/3315055575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bcc109ad0 0x7f1bcc1a01c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc000c00 tx=0x7f1bbc0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:03.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.067+0000 7f1bc8c00700 1 -- 172.21.15.44:0/3315055575 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc027070 con 0x7f1bcc109ad0 2024-05-03T22:43:03.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.067+0000 7f1bc8c00700 1 -- 172.21.15.44:0/3315055575 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f1bbc003ff0 con 0x7f1bcc109ad0 2024-05-03T22:43:03.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.067+0000 7f1bd3000700 1 -- 172.21.15.44:0/3315055575 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bcc1a5410 con 0x7f1bcc109ad0 2024-05-03T22:43:03.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.067+0000 7f1bc8c00700 1 -- 172.21.15.44:0/3315055575 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc022e50 con 0x7f1bcc109ad0 2024-05-03T22:43:03.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.067+0000 7f1bd3000700 1 -- 172.21.15.44:0/3315055575 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bcc1accf0 con 0x7f1bcc109ad0 2024-05-03T22:43:03.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.068+0000 7f1bd3000700 1 -- 172.21.15.44:0/3315055575 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1bcc063c30 con 0x7f1bcc109ad0 2024-05-03T22:43:03.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.070+0000 7f1bc8c00700 1 -- 172.21.15.44:0/3315055575 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f1bbc02a070 con 0x7f1bcc109ad0 2024-05-03T22:43:03.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.072+0000 7f1bc8c00700 1 --2- 172.21.15.44:0/3315055575 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1bb00b2ab0 0x7f1bb00b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:03.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.072+0000 7f1bc8c00700 1 -- 172.21.15.44:0/3315055575 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f1bbc0e3950 con 0x7f1bcc109ad0 2024-05-03T22:43:03.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.072+0000 7f1bcb400700 1 --2- 172.21.15.44:0/3315055575 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1bb00b2ab0 0x7f1bb00b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:03.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.073+0000 7f1bc8c00700 1 --2- 172.21.15.44:0/3315055575 >> [v2:172.21.15.160:6808/429142335,v1:172.21.15.160:6809/429142335] conn(0x7f1bb00bdf10 0x7f1bb00c03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:03.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.073+0000 7f1bc8c00700 1 -- 172.21.15.44:0/3315055575 --> [v2:172.21.15.160:6808/429142335,v1:172.21.15.160:6809/429142335] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1bbc01fec0 con 0x7f1bb00bdf10 2024-05-03T22:43:03.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.073+0000 7f1bc8c00700 1 -- 172.21.15.44:0/3315055575 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f1bbc0e3d00 con 0x7f1bcc109ad0 2024-05-03T22:43:03.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.073+0000 7f1bcb400700 1 --2- 172.21.15.44:0/3315055575 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1bb00b2ab0 0x7f1bb00b4f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc078a30 tx=0x7f1bb8005d50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:03.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.079+0000 7f1bd1000700 1 --2- 172.21.15.44:0/3315055575 >> [v2:172.21.15.160:6808/429142335,v1:172.21.15.160:6809/429142335] conn(0x7f1bb00bdf10 0x7f1bb00c03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:03.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.081+0000 7f1bd1000700 1 --2- 172.21.15.44:0/3315055575 >> [v2:172.21.15.160:6808/429142335,v1:172.21.15.160:6809/429142335] conn(0x7f1bb00bdf10 0x7f1bb00c03b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:03.250 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.083+0000 7f1bc8c00700 1 -- 172.21.15.44:0/3315055575 <== osd.5 v2:172.21.15.160:6808/429142335 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1bbc01fec0 con 0x7f1bb00bdf10 2024-05-03T22:43:03.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.101+0000 7f1bd3000700 1 -- 172.21.15.44:0/3315055575 --> [v2:172.21.15.160:6808/429142335,v1:172.21.15.160:6809/429142335] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1bcc0640b0 con 0x7f1bb00bdf10 2024-05-03T22:43:03.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.102+0000 7f1bc8c00700 1 -- 172.21.15.44:0/3315055575 <== osd.5 v2:172.21.15.160:6808/429142335 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1bcc0640b0 con 0x7f1bb00bdf10 2024-05-03T22:43:03.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.102+0000 7f1bd3000700 1 -- 172.21.15.44:0/3315055575 >> [v2:172.21.15.160:6808/429142335,v1:172.21.15.160:6809/429142335] conn(0x7f1bb00bdf10 msgr2=0x7f1bb00c03b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:03.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.102+0000 7f1bd3000700 1 --2- 172.21.15.44:0/3315055575 >> [v2:172.21.15.160:6808/429142335,v1:172.21.15.160:6809/429142335] conn(0x7f1bb00bdf10 0x7f1bb00c03b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:03.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.103+0000 7f1bd3000700 1 -- 172.21.15.44:0/3315055575 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1bb00b2ab0 msgr2=0x7f1bb00b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:03.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.103+0000 7f1bd3000700 1 --2- 172.21.15.44:0/3315055575 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1bb00b2ab0 0x7f1bb00b4f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc078a30 tx=0x7f1bb8005d50 comp rx=0 tx=0).stop 2024-05-03T22:43:03.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.103+0000 7f1bd3000700 1 -- 172.21.15.44:0/3315055575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bcc109ad0 msgr2=0x7f1bcc1a01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:03.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.103+0000 7f1bd3000700 1 --2- 172.21.15.44:0/3315055575 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1bcc109ad0 0x7f1bcc1a01c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc000c00 tx=0x7f1bbc0047b0 comp rx=0 tx=0).stop 2024-05-03T22:43:03.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.103+0000 7f1bd1000700 1 -- 172.21.15.44:0/3315055575 reap_dead start 2024-05-03T22:43:03.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.103+0000 7f1bd3000700 1 -- 172.21.15.44:0/3315055575 shutdown_connections 2024-05-03T22:43:03.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.103+0000 7f1bd3000700 1 -- 172.21.15.44:0/3315055575 >> 172.21.15.44:0/3315055575 conn(0x7f1bcc076c70 msgr2=0x7f1bcc077190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:03.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.103+0000 7f1bd3000700 1 -- 172.21.15.44:0/3315055575 shutdown_connections 2024-05-03T22:43:03.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:03.103+0000 7f1bd3000700 1 -- 172.21.15.44:0/3315055575 wait complete. 2024-05-03T22:43:04.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:04 smithi044 ceph-mon[28604]: pgmap v466: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:04.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:04 smithi060 ceph-mon[31721]: pgmap v466: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:04.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:04 smithi160 ceph-mon[32531]: pgmap v466: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:04.847 INFO:teuthology.orchestra.run.smithi044.stdout:201863462994 2024-05-03T22:43:04.847 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-03T22:43:05.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.201+0000 7fa488c00700 1 -- 172.21.15.44:0/3235013040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa484102180 msgr2=0x7fa484102560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:05.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.201+0000 7fa488c00700 1 --2- 172.21.15.44:0/3235013040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa484102180 0x7fa484102560 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa474009990 tx=0x7fa474009ca0 comp rx=0 tx=0).stop 2024-05-03T22:43:05.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.201+0000 7fa488c00700 1 -- 172.21.15.44:0/3235013040 shutdown_connections 2024-05-03T22:43:05.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.201+0000 7fa488c00700 1 --2- 172.21.15.44:0/3235013040 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa48410fd30 0x7fa484112120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:05.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.202+0000 7fa488c00700 1 --2- 172.21.15.44:0/3235013040 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa484102180 0x7fa484102560 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:05.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.202+0000 7fa488c00700 1 --2- 172.21.15.44:0/3235013040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa484102b30 0x7fa48410f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:05.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.202+0000 7fa488c00700 1 -- 172.21.15.44:0/3235013040 >> 172.21.15.44:0/3235013040 conn(0x7fa4840fddc0 msgr2=0x7fa4841001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:05.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.202+0000 7fa488c00700 1 -- 172.21.15.44:0/3235013040 shutdown_connections 2024-05-03T22:43:05.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.202+0000 7fa488c00700 1 -- 172.21.15.44:0/3235013040 wait complete. 2024-05-03T22:43:05.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.203+0000 7fa488c00700 1 Processor -- start 2024-05-03T22:43:05.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.203+0000 7fa488c00700 1 -- start start 2024-05-03T22:43:05.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.204+0000 7fa488c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa484102180 0x7fa4841a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:05.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.204+0000 7fa488c00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa484102b30 0x7fa4841a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:05.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.204+0000 7fa488c00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa48410fd30 0x7fa48419bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:05.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.204+0000 7fa488c00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa484115920 con 0x7fa484102180 2024-05-03T22:43:05.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.204+0000 7fa488c00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa4841157a0 con 0x7fa484102b30 2024-05-03T22:43:05.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.204+0000 7fa488c00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa484115aa0 con 0x7fa48410fd30 2024-05-03T22:43:05.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.204+0000 7fa483400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa484102180 0x7fa4841a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:05.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.204+0000 7fa483400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa484102180 0x7fa4841a18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36348/0 (socket says 172.21.15.44:36348) 2024-05-03T22:43:05.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.204+0000 7fa483400700 1 -- 172.21.15.44:0/273842707 learned_addr learned my addr 172.21.15.44:0/273842707 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:05.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.204+0000 7fa482a00700 1 --2- 172.21.15.44:0/273842707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa484102b30 0x7fa4841a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:05.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.204+0000 7fa483e00700 1 --2- 172.21.15.44:0/273842707 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa48410fd30 0x7fa48419bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:05.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.205+0000 7fa483400700 1 -- 172.21.15.44:0/273842707 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa48410fd30 msgr2=0x7fa48419bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:05.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.205+0000 7fa483400700 1 --2- 172.21.15.44:0/273842707 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa48410fd30 0x7fa48419bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:05.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.205+0000 7fa483400700 1 -- 172.21.15.44:0/273842707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa484102b30 msgr2=0x7fa4841a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:05.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.205+0000 7fa483400700 1 --2- 172.21.15.44:0/273842707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa484102b30 0x7fa4841a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:05.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.205+0000 7fa483400700 1 -- 172.21.15.44:0/273842707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48419c220 con 0x7fa484102180 2024-05-03T22:43:05.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.205+0000 7fa483e00700 1 --2- 172.21.15.44:0/273842707 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa48410fd30 0x7fa48419bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:43:05.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.205+0000 7fa483400700 1 --2- 172.21.15.44:0/273842707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa484102180 0x7fa4841a18b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa4740057a0 tx=0x7fa4740057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:05.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.206+0000 7fa47be00700 1 -- 172.21.15.44:0/273842707 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa474027070 con 0x7fa484102180 2024-05-03T22:43:05.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.206+0000 7fa47be00700 1 -- 172.21.15.44:0/273842707 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fa474003f70 con 0x7fa484102180 2024-05-03T22:43:05.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.206+0000 7fa47be00700 1 -- 172.21.15.44:0/273842707 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa474022d90 con 0x7fa484102180 2024-05-03T22:43:05.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.206+0000 7fa488c00700 1 -- 172.21.15.44:0/273842707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa48419c4b0 con 0x7fa484102180 2024-05-03T22:43:05.392 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.206+0000 7fa488c00700 1 -- 172.21.15.44:0/273842707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4841a8780 con 0x7fa484102180 2024-05-03T22:43:05.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.207+0000 7fa488c00700 1 -- 172.21.15.44:0/273842707 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa484111100 con 0x7fa484102180 2024-05-03T22:43:05.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.210+0000 7fa47be00700 1 -- 172.21.15.44:0/273842707 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa47402a070 con 0x7fa484102180 2024-05-03T22:43:05.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.211+0000 7fa47be00700 1 --2- 172.21.15.44:0/273842707 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa4680b2910 0x7fa4680b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:05.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.211+0000 7fa47be00700 1 -- 172.21.15.44:0/273842707 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fa4740e4100 con 0x7fa484102180 2024-05-03T22:43:05.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.212+0000 7fa482a00700 1 --2- 172.21.15.44:0/273842707 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa4680b2910 0x7fa4680b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:05.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.212+0000 7fa47be00700 1 --2- 172.21.15.44:0/273842707 >> [v2:172.21.15.60:6808/3794821539,v1:172.21.15.60:6809/3794821539] conn(0x7fa4680bdd70 0x7fa4680c0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:05.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.212+0000 7fa47be00700 1 -- 172.21.15.44:0/273842707 --> [v2:172.21.15.60:6808/3794821539,v1:172.21.15.60:6809/3794821539] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa47402ce50 con 0x7fa4680bdd70 2024-05-03T22:43:05.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.212+0000 7fa47be00700 1 -- 172.21.15.44:0/273842707 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fa4740e44b0 con 0x7fa484102180 2024-05-03T22:43:05.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.212+0000 7fa482a00700 1 --2- 172.21.15.44:0/273842707 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa4680b2910 0x7fa4680b4dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa484112050 tx=0x7fa47000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:05.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.225+0000 7fa483e00700 1 --2- 172.21.15.44:0/273842707 >> [v2:172.21.15.60:6808/3794821539,v1:172.21.15.60:6809/3794821539] conn(0x7fa4680bdd70 0x7fa4680c0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:05.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.226+0000 7fa483e00700 1 --2- 172.21.15.44:0/273842707 >> [v2:172.21.15.60:6808/3794821539,v1:172.21.15.60:6809/3794821539] conn(0x7fa4680bdd70 0x7fa4680c0210 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:05.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.229+0000 7fa47be00700 1 -- 172.21.15.44:0/273842707 <== osd.4 v2:172.21.15.60:6808/3794821539 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa47402ce50 con 0x7fa4680bdd70 2024-05-03T22:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.247+0000 7fa488c00700 1 -- 172.21.15.44:0/273842707 --> [v2:172.21.15.60:6808/3794821539,v1:172.21.15.60:6809/3794821539] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa48406ba00 con 0x7fa4680bdd70 2024-05-03T22:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.248+0000 7fa47be00700 1 -- 172.21.15.44:0/273842707 <== osd.4 v2:172.21.15.60:6808/3794821539 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa48406ba00 con 0x7fa4680bdd70 2024-05-03T22:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.249+0000 7fa488c00700 1 -- 172.21.15.44:0/273842707 >> [v2:172.21.15.60:6808/3794821539,v1:172.21.15.60:6809/3794821539] conn(0x7fa4680bdd70 msgr2=0x7fa4680c0210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.249+0000 7fa488c00700 1 --2- 172.21.15.44:0/273842707 >> [v2:172.21.15.60:6808/3794821539,v1:172.21.15.60:6809/3794821539] conn(0x7fa4680bdd70 0x7fa4680c0210 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.249+0000 7fa488c00700 1 -- 172.21.15.44:0/273842707 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa4680b2910 msgr2=0x7fa4680b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.249+0000 7fa488c00700 1 --2- 172.21.15.44:0/273842707 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa4680b2910 0x7fa4680b4dd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa484112050 tx=0x7fa47000a380 comp rx=0 tx=0).stop 2024-05-03T22:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.249+0000 7fa488c00700 1 -- 172.21.15.44:0/273842707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa484102180 msgr2=0x7fa4841a18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.249+0000 7fa488c00700 1 --2- 172.21.15.44:0/273842707 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa484102180 0x7fa4841a18b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa4740057a0 tx=0x7fa4740057d0 comp rx=0 tx=0).stop 2024-05-03T22:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.249+0000 7fa483e00700 1 -- 172.21.15.44:0/273842707 reap_dead start 2024-05-03T22:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.249+0000 7fa488c00700 1 -- 172.21.15.44:0/273842707 shutdown_connections 2024-05-03T22:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.249+0000 7fa488c00700 1 -- 172.21.15.44:0/273842707 >> 172.21.15.44:0/273842707 conn(0x7fa4840fddc0 msgr2=0x7fa4841106a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.250+0000 7fa488c00700 1 -- 172.21.15.44:0/273842707 shutdown_connections 2024-05-03T22:43:05.394 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:05.250+0000 7fa488c00700 1 -- 172.21.15.44:0/273842707 wait complete. 2024-05-03T22:43:05.805 INFO:teuthology.orchestra.run.smithi044.stdout:180388626520 2024-05-03T22:43:05.805 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-03T22:43:06.305 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:06 smithi044 ceph-mon[28604]: pgmap v467: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:43:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.482+0000 7f749ce00700 1 -- 172.21.15.44:0/3781524373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7498104eb0 msgr2=0x7f749810d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.482+0000 7f749ce00700 1 --2- 172.21.15.44:0/3781524373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7498104eb0 0x7f749810d3a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7484009990 tx=0x7f7484009ca0 comp rx=0 tx=0).stop 2024-05-03T22:43:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.482+0000 7f749ce00700 1 -- 172.21.15.44:0/3781524373 shutdown_connections 2024-05-03T22:43:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.482+0000 7f749ce00700 1 --2- 172.21.15.44:0/3781524373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f749810d9c0 0x7f749810fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.482+0000 7f749ce00700 1 --2- 172.21.15.44:0/3781524373 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7498104590 0x7f7498104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.482+0000 7f749ce00700 1 --2- 172.21.15.44:0/3781524373 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7498104eb0 0x7f749810d3a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.482+0000 7f749ce00700 1 -- 172.21.15.44:0/3781524373 >> 172.21.15.44:0/3781524373 conn(0x7f74980fddc0 msgr2=0x7f74981001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.482+0000 7f749ce00700 1 -- 172.21.15.44:0/3781524373 shutdown_connections 2024-05-03T22:43:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.482+0000 7f749ce00700 1 -- 172.21.15.44:0/3781524373 wait complete. 2024-05-03T22:43:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.483+0000 7f749ce00700 1 Processor -- start 2024-05-03T22:43:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.484+0000 7f749ce00700 1 -- start start 2024-05-03T22:43:06.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.484+0000 7f749ce00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7498104590 0x7f749819be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:06.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.484+0000 7f749ce00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7498104eb0 0x7f749819c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:06.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.484+0000 7f749ce00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f749810d9c0 0x7f74981a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:06.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.484+0000 7f749ce00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7498113750 con 0x7f749810d9c0 2024-05-03T22:43:06.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.484+0000 7f749ce00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f74981135d0 con 0x7f7498104eb0 2024-05-03T22:43:06.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.484+0000 7f749ce00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f74981138d0 con 0x7f7498104590 2024-05-03T22:43:06.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.484+0000 7f7497e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f749810d9c0 0x7f74981a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:06.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.485+0000 7f7497e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f749810d9c0 0x7f74981a06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36366/0 (socket says 172.21.15.44:36366) 2024-05-03T22:43:06.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.485+0000 7f7497e00700 1 -- 172.21.15.44:0/3587503504 learned_addr learned my addr 172.21.15.44:0/3587503504 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:06.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.485+0000 7f7497400700 1 --2- 172.21.15.44:0/3587503504 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7498104590 0x7f749819be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:06.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.485+0000 7f7496a00700 1 --2- 172.21.15.44:0/3587503504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7498104eb0 0x7f749819c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:06.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.485+0000 7f7497e00700 1 -- 172.21.15.44:0/3587503504 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7498104590 msgr2=0x7f749819be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:06.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.485+0000 7f7497e00700 1 --2- 172.21.15.44:0/3587503504 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7498104590 0x7f749819be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:06.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.485+0000 7f7497e00700 1 -- 172.21.15.44:0/3587503504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7498104eb0 msgr2=0x7f749819c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:06.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.485+0000 7f7497e00700 1 --2- 172.21.15.44:0/3587503504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7498104eb0 0x7f749819c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:06.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.485+0000 7f7497e00700 1 -- 172.21.15.44:0/3587503504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74981a0e30 con 0x7f749810d9c0 2024-05-03T22:43:06.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.485+0000 7f7497e00700 1 --2- 172.21.15.44:0/3587503504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f749810d9c0 0x7f74981a06f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7490007d70 tx=0x7f749000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:06.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.486+0000 7f748fe00700 1 -- 172.21.15.44:0/3587503504 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7490016020 con 0x7f749810d9c0 2024-05-03T22:43:06.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.486+0000 7f748fe00700 1 -- 172.21.15.44:0/3587503504 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f749000ad40 con 0x7f749810d9c0 2024-05-03T22:43:06.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.486+0000 7f749ce00700 1 -- 172.21.15.44:0/3587503504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74981a1120 con 0x7f749810d9c0 2024-05-03T22:43:06.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.486+0000 7f748fe00700 1 -- 172.21.15.44:0/3587503504 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7490011600 con 0x7f749810d9c0 2024-05-03T22:43:06.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.486+0000 7f749ce00700 1 -- 172.21.15.44:0/3587503504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74981a89a0 con 0x7f749810d9c0 2024-05-03T22:43:06.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.487+0000 7f749ce00700 1 -- 172.21.15.44:0/3587503504 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7498103c70 con 0x7f749810d9c0 2024-05-03T22:43:06.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.490+0000 7f748fe00700 1 -- 172.21.15.44:0/3587503504 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f7490019020 con 0x7f749810d9c0 2024-05-03T22:43:06.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.491+0000 7f748fe00700 1 --2- 172.21.15.44:0/3587503504 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f747c0b2990 0x7f747c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:06.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.491+0000 7f748fe00700 1 -- 172.21.15.44:0/3587503504 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f74900e2b70 con 0x7f749810d9c0 2024-05-03T22:43:06.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.491+0000 7f7497400700 1 --2- 172.21.15.44:0/3587503504 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f747c0b2990 0x7f747c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:06.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.492+0000 7f748fe00700 1 --2- 172.21.15.44:0/3587503504 >> [v2:172.21.15.160:6824/1397967755,v1:172.21.15.160:6825/1397967755] conn(0x7f747c0bddf0 0x7f747c0c0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:06.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.492+0000 7f748fe00700 1 -- 172.21.15.44:0/3587503504 --> [v2:172.21.15.160:6824/1397967755,v1:172.21.15.160:6825/1397967755] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f749001be50 con 0x7f747c0bddf0 2024-05-03T22:43:06.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.492+0000 7f748fe00700 1 -- 172.21.15.44:0/3587503504 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f74900e2fc0 con 0x7f749810d9c0 2024-05-03T22:43:06.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.492+0000 7f7497400700 1 --2- 172.21.15.44:0/3587503504 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f747c0b2990 0x7f747c0b4e50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7488009a10 tx=0x7f7488009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:06.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.492+0000 7f7496a00700 1 --2- 172.21.15.44:0/3587503504 >> [v2:172.21.15.160:6824/1397967755,v1:172.21.15.160:6825/1397967755] conn(0x7f747c0bddf0 0x7f747c0c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:06.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.493+0000 7f7496a00700 1 --2- 172.21.15.44:0/3587503504 >> [v2:172.21.15.160:6824/1397967755,v1:172.21.15.160:6825/1397967755] conn(0x7f747c0bddf0 0x7f747c0c0290 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:06.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.496+0000 7f748fe00700 1 -- 172.21.15.44:0/3587503504 <== osd.11 v2:172.21.15.160:6824/1397967755 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f749001be50 con 0x7f747c0bddf0 2024-05-03T22:43:06.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:06 smithi060 ceph-mon[31721]: pgmap v467: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:43:06.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:06 smithi160 ceph-mon[32531]: pgmap v467: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:43:06.516 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.514+0000 7f749ce00700 1 -- 172.21.15.44:0/3587503504 --> [v2:172.21.15.160:6824/1397967755,v1:172.21.15.160:6825/1397967755] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f749806ba60 con 0x7f747c0bddf0 2024-05-03T22:43:06.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.515+0000 7f748fe00700 1 -- 172.21.15.44:0/3587503504 <== osd.11 v2:172.21.15.160:6824/1397967755 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f749806ba60 con 0x7f747c0bddf0 2024-05-03T22:43:06.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.516+0000 7f749ce00700 1 -- 172.21.15.44:0/3587503504 >> [v2:172.21.15.160:6824/1397967755,v1:172.21.15.160:6825/1397967755] conn(0x7f747c0bddf0 msgr2=0x7f747c0c0290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:06.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.516+0000 7f749ce00700 1 --2- 172.21.15.44:0/3587503504 >> [v2:172.21.15.160:6824/1397967755,v1:172.21.15.160:6825/1397967755] conn(0x7f747c0bddf0 0x7f747c0c0290 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:06.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.516+0000 7f749ce00700 1 -- 172.21.15.44:0/3587503504 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f747c0b2990 msgr2=0x7f747c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:06.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.516+0000 7f749ce00700 1 --2- 172.21.15.44:0/3587503504 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f747c0b2990 0x7f747c0b4e50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7488009a10 tx=0x7f7488009190 comp rx=0 tx=0).stop 2024-05-03T22:43:06.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.516+0000 7f749ce00700 1 -- 172.21.15.44:0/3587503504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f749810d9c0 msgr2=0x7f74981a06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:06.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.516+0000 7f749ce00700 1 --2- 172.21.15.44:0/3587503504 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f749810d9c0 0x7f74981a06f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7490007d70 tx=0x7f749000a340 comp rx=0 tx=0).stop 2024-05-03T22:43:06.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.516+0000 7f7497e00700 1 -- 172.21.15.44:0/3587503504 reap_dead start 2024-05-03T22:43:06.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.516+0000 7f749ce00700 1 -- 172.21.15.44:0/3587503504 shutdown_connections 2024-05-03T22:43:06.519 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.517+0000 7f749ce00700 1 -- 172.21.15.44:0/3587503504 >> 172.21.15.44:0/3587503504 conn(0x7f74980fddc0 msgr2=0x7f749810fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:06.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.517+0000 7f749ce00700 1 -- 172.21.15.44:0/3587503504 shutdown_connections 2024-05-03T22:43:06.520 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:06.517+0000 7f749ce00700 1 -- 172.21.15.44:0/3587503504 wait complete. 2024-05-03T22:43:08.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.169+0000 7f462ea00700 1 -- 172.21.15.44:0/4056021050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46280756d0 msgr2=0x7f4628075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:08.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.169+0000 7f462ea00700 1 --2- 172.21.15.44:0/4056021050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46280756d0 0x7f4628075ab0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4618009990 tx=0x7f4618009ca0 comp rx=0 tx=0).stop 2024-05-03T22:43:08.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.169+0000 7f462ea00700 1 -- 172.21.15.44:0/4056021050 shutdown_connections 2024-05-03T22:43:08.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.169+0000 7f462ea00700 1 --2- 172.21.15.44:0/4056021050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f462810fea0 0x7f4628112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:08.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.169+0000 7f462ea00700 1 --2- 172.21.15.44:0/4056021050 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f46280756d0 0x7f4628075ab0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:08.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.169+0000 7f462ea00700 1 --2- 172.21.15.44:0/4056021050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4628075ff0 0x7f462810f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:08.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.169+0000 7f462ea00700 1 -- 172.21.15.44:0/4056021050 >> 172.21.15.44:0/4056021050 conn(0x7f462807a600 msgr2=0x7f462807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:08.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.169+0000 7f462ea00700 1 -- 172.21.15.44:0/4056021050 shutdown_connections 2024-05-03T22:43:08.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.170+0000 7f462ea00700 1 -- 172.21.15.44:0/4056021050 wait complete. 2024-05-03T22:43:08.174 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.171+0000 7f462ea00700 1 Processor -- start 2024-05-03T22:43:08.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.171+0000 7f462ea00700 1 -- start start 2024-05-03T22:43:08.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.171+0000 7f462ea00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46280756d0 0x7f462819bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:08.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.171+0000 7f462ea00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4628075ff0 0x7f462819c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:08.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.171+0000 7f462ea00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f462810fea0 0x7f46281a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:08.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.171+0000 7f462ea00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4628115a20 con 0x7f4628075ff0 2024-05-03T22:43:08.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.171+0000 7f462ea00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f46281158a0 con 0x7f462810fea0 2024-05-03T22:43:08.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.171+0000 7f462ea00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4628115ba0 con 0x7f46280756d0 2024-05-03T22:43:08.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.172+0000 7f4627400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4628075ff0 0x7f462819c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:08.175 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.172+0000 7f4627400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4628075ff0 0x7f462819c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36386/0 (socket says 172.21.15.44:36386) 2024-05-03T22:43:08.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.172+0000 7f4627400700 1 -- 172.21.15.44:0/2727829086 learned_addr learned my addr 172.21.15.44:0/2727829086 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:08.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.172+0000 7f4627e00700 1 --2- 172.21.15.44:0/2727829086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46280756d0 0x7f462819bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:08.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.172+0000 7f462ca00700 1 --2- 172.21.15.44:0/2727829086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f462810fea0 0x7f46281a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:08.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.172+0000 7f4627400700 1 -- 172.21.15.44:0/2727829086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46280756d0 msgr2=0x7f462819bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:08.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.172+0000 7f4627400700 1 --2- 172.21.15.44:0/2727829086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46280756d0 0x7f462819bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:08.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.172+0000 7f4627400700 1 -- 172.21.15.44:0/2727829086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f462810fea0 msgr2=0x7f46281a07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:08.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.172+0000 7f4627400700 1 --2- 172.21.15.44:0/2727829086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f462810fea0 0x7f46281a07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:08.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.172+0000 7f4627400700 1 -- 172.21.15.44:0/2727829086 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46281a0ef0 con 0x7f4628075ff0 2024-05-03T22:43:08.176 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.173+0000 7f4627400700 1 --2- 172.21.15.44:0/2727829086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4628075ff0 0x7f462819c470 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f461400d980 tx=0x7f461400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:08.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.173+0000 7f4624c00700 1 -- 172.21.15.44:0/2727829086 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614017030 con 0x7f4628075ff0 2024-05-03T22:43:08.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.173+0000 7f462ea00700 1 -- 172.21.15.44:0/2727829086 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46281a11e0 con 0x7f4628075ff0 2024-05-03T22:43:08.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.173+0000 7f4624c00700 1 -- 172.21.15.44:0/2727829086 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f46140044f0 con 0x7f4628075ff0 2024-05-03T22:43:08.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.173+0000 7f4624c00700 1 -- 172.21.15.44:0/2727829086 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4614003b40 con 0x7f4628075ff0 2024-05-03T22:43:08.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.173+0000 7f462ea00700 1 -- 172.21.15.44:0/2727829086 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46281a8a60 con 0x7f4628075ff0 2024-05-03T22:43:08.177 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.174+0000 7f462ea00700 1 -- 172.21.15.44:0/2727829086 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f46281023b0 con 0x7f4628075ff0 2024-05-03T22:43:08.179 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.177+0000 7f4624c00700 1 -- 172.21.15.44:0/2727829086 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f461401a070 con 0x7f4628075ff0 2024-05-03T22:43:08.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.179+0000 7f4624c00700 1 --2- 172.21.15.44:0/2727829086 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f460c0b2910 0x7f460c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:08.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.179+0000 7f4624c00700 1 -- 172.21.15.44:0/2727829086 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f46140e21e0 con 0x7f4628075ff0 2024-05-03T22:43:08.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.179+0000 7f4627e00700 1 --2- 172.21.15.44:0/2727829086 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f460c0b2910 0x7f460c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:08.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.179+0000 7f4624c00700 1 --2- 172.21.15.44:0/2727829086 >> [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279] conn(0x7f460c0bdd70 0x7f460c0c0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:08.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.180+0000 7f4624c00700 1 -- 172.21.15.44:0/2727829086 --> [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f460c0c08e0 con 0x7f460c0bdd70 2024-05-03T22:43:08.182 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.180+0000 7f4624c00700 1 -- 172.21.15.44:0/2727829086 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f46140e9050 con 0x7f4628075ff0 2024-05-03T22:43:08.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.180+0000 7f462ca00700 1 --2- 172.21.15.44:0/2727829086 >> [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279] conn(0x7f460c0bdd70 0x7f460c0c0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:08.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.180+0000 7f4627e00700 1 --2- 172.21.15.44:0/2727829086 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f460c0b2910 0x7f460c0b4dd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f461800b5c0 tx=0x7f4618005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:08.183 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.181+0000 7f462ca00700 1 --2- 172.21.15.44:0/2727829086 >> [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279] conn(0x7f460c0bdd70 0x7f460c0c0210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:08.184 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.182+0000 7f4624c00700 1 -- 172.21.15.44:0/2727829086 <== osd.3 v2:172.21.15.44:6810/3298926279 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f460c0c08e0 con 0x7f460c0bdd70 2024-05-03T22:43:08.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.201+0000 7f462ea00700 1 -- 172.21.15.44:0/2727829086 --> [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4628076dc0 con 0x7f460c0bdd70 2024-05-03T22:43:08.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.201+0000 7f4624c00700 1 -- 172.21.15.44:0/2727829086 <== osd.3 v2:172.21.15.44:6810/3298926279 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4628076dc0 con 0x7f460c0bdd70 2024-05-03T22:43:08.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.202+0000 7f462ea00700 1 -- 172.21.15.44:0/2727829086 >> [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279] conn(0x7f460c0bdd70 msgr2=0x7f460c0c0210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:08.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.202+0000 7f462ea00700 1 --2- 172.21.15.44:0/2727829086 >> [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279] conn(0x7f460c0bdd70 0x7f460c0c0210 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:08.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.202+0000 7f462ea00700 1 -- 172.21.15.44:0/2727829086 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f460c0b2910 msgr2=0x7f460c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:08.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.202+0000 7f462ea00700 1 --2- 172.21.15.44:0/2727829086 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f460c0b2910 0x7f460c0b4dd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f461800b5c0 tx=0x7f4618005fd0 comp rx=0 tx=0).stop 2024-05-03T22:43:08.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.202+0000 7f462ea00700 1 -- 172.21.15.44:0/2727829086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4628075ff0 msgr2=0x7f462819c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:08.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.202+0000 7f462ea00700 1 --2- 172.21.15.44:0/2727829086 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f4628075ff0 0x7f462819c470 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f461400d980 tx=0x7f461400dd40 comp rx=0 tx=0).stop 2024-05-03T22:43:08.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.202+0000 7f462ca00700 1 -- 172.21.15.44:0/2727829086 reap_dead start 2024-05-03T22:43:08.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.202+0000 7f462ea00700 1 -- 172.21.15.44:0/2727829086 shutdown_connections 2024-05-03T22:43:08.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.202+0000 7f462ea00700 1 -- 172.21.15.44:0/2727829086 >> 172.21.15.44:0/2727829086 conn(0x7f462807a600 msgr2=0x7f4628101950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:08.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.202+0000 7f462ea00700 1 -- 172.21.15.44:0/2727829086 shutdown_connections 2024-05-03T22:43:08.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:08.203+0000 7f462ea00700 1 -- 172.21.15.44:0/2727829086 wait complete. 2024-05-03T22:43:08.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:08 smithi044 ceph-mon[28604]: pgmap v468: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-05-03T22:43:08.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:08 smithi060 ceph-mon[31721]: pgmap v468: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-05-03T22:43:08.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:08 smithi160 ceph-mon[32531]: pgmap v468: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-05-03T22:43:08.566 INFO:teuthology.orchestra.run.smithi044.stdout:227633266764 2024-05-03T22:43:08.566 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-03T22:43:10.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:10 smithi044 ceph-mon[28604]: pgmap v469: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:43:10.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:10 smithi060 ceph-mon[31721]: pgmap v469: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:43:10.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:10 smithi160 ceph-mon[32531]: pgmap v469: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:43:10.869 INFO:teuthology.orchestra.run.smithi044.stdout:300647710775 2024-05-03T22:43:10.870 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-03T22:43:10.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.895+0000 7f7b1c200700 1 -- 172.21.15.44:0/2536863703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b1406bb40 msgr2=0x7f7b14110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:10.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.895+0000 7f7b1c200700 1 --2- 172.21.15.44:0/2536863703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b1406bb40 0x7f7b14110330 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c00b0a0 tx=0x7f7b0c00b3b0 comp rx=0 tx=0).stop 2024-05-03T22:43:10.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.895+0000 7f7b1c200700 1 -- 172.21.15.44:0/2536863703 shutdown_connections 2024-05-03T22:43:10.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.895+0000 7f7b1c200700 1 --2- 172.21.15.44:0/2536863703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b1406bb40 0x7f7b14110330 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:10.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.895+0000 7f7b1c200700 1 --2- 172.21.15.44:0/2536863703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b14109510 0x7f7b141098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:10.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.895+0000 7f7b1c200700 1 --2- 172.21.15.44:0/2536863703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b1406b180 0x7f7b1406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:10.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.895+0000 7f7b1c200700 1 -- 172.21.15.44:0/2536863703 >> 172.21.15.44:0/2536863703 conn(0x7f7b14079350 msgr2=0x7f7b14079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:10.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.895+0000 7f7b1c200700 1 -- 172.21.15.44:0/2536863703 shutdown_connections 2024-05-03T22:43:10.898 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.895+0000 7f7b1c200700 1 -- 172.21.15.44:0/2536863703 wait complete. 2024-05-03T22:43:10.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.896+0000 7f7b1c200700 1 Processor -- start 2024-05-03T22:43:10.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.897+0000 7f7b1c200700 1 -- start start 2024-05-03T22:43:10.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.897+0000 7f7b1c200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b1406b180 0x7f7b1419f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:10.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.897+0000 7f7b1c200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b1406bb40 0x7f7b1419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:10.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.897+0000 7f7b1c200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b14109510 0x7f7b14199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:10.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.897+0000 7f7b1c200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7b14113780 con 0x7f7b14109510 2024-05-03T22:43:10.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.897+0000 7f7b1c200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7b14113600 con 0x7f7b1406b180 2024-05-03T22:43:10.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.897+0000 7f7b1c200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7b14113900 con 0x7f7b1406bb40 2024-05-03T22:43:10.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.898+0000 7f7b19800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b1406b180 0x7f7b1419f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:10.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.898+0000 7f7b1a200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b14109510 0x7f7b14199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:10.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.898+0000 7f7b18e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b1406bb40 0x7f7b1419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:10.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.898+0000 7f7b1a200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b14109510 0x7f7b14199a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52584/0 (socket says 172.21.15.44:52584) 2024-05-03T22:43:10.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.898+0000 7f7b1a200700 1 -- 172.21.15.44:0/2488910869 learned_addr learned my addr 172.21.15.44:0/2488910869 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:10.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.898+0000 7f7b19800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b1406b180 0x7f7b1419f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.44:51022/0 (socket says 172.21.15.44:51022) 2024-05-03T22:43:10.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.898+0000 7f7b18e00700 1 -- 172.21.15.44:0/2488910869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b1406b180 msgr2=0x7f7b1419f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:10.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.898+0000 7f7b18e00700 1 --2- 172.21.15.44:0/2488910869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b1406b180 0x7f7b1419f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:10.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.898+0000 7f7b18e00700 1 -- 172.21.15.44:0/2488910869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b14109510 msgr2=0x7f7b14199a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:10.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.898+0000 7f7b18e00700 1 --2- 172.21.15.44:0/2488910869 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b14109510 0x7f7b14199a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:10.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.899+0000 7f7b18e00700 1 -- 172.21.15.44:0/2488910869 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1419a180 con 0x7f7b1406bb40 2024-05-03T22:43:10.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.899+0000 7f7b19800700 1 --2- 172.21.15.44:0/2488910869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b1406b180 0x7f7b1419f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-03T22:43:10.902 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.899+0000 7f7b18e00700 1 --2- 172.21.15.44:0/2488910869 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b1406bb40 0x7f7b1419fda0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000e9f0 tx=0x7f7b0000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:10.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.900+0000 7f7b12000700 1 -- 172.21.15.44:0/2488910869 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000cbd0 con 0x7f7b1406bb40 2024-05-03T22:43:10.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.900+0000 7f7b1c200700 1 -- 172.21.15.44:0/2488910869 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1419a470 con 0x7f7b1406bb40 2024-05-03T22:43:10.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.900+0000 7f7b1c200700 1 -- 172.21.15.44:0/2488910869 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b141a6730 con 0x7f7b1406bb40 2024-05-03T22:43:10.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.900+0000 7f7b12000700 1 -- 172.21.15.44:0/2488910869 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f7b0000cd70 con 0x7f7b1406bb40 2024-05-03T22:43:10.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.900+0000 7f7b12000700 1 -- 172.21.15.44:0/2488910869 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00018710 con 0x7f7b1406bb40 2024-05-03T22:43:10.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.901+0000 7f7b1c200700 1 -- 172.21.15.44:0/2488910869 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7af4001030 con 0x7f7b1406bb40 2024-05-03T22:43:10.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.905+0000 7f7b12000700 1 -- 172.21.15.44:0/2488910869 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f7b000188b0 con 0x7f7b1406bb40 2024-05-03T22:43:10.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.907+0000 7f7b12000700 1 --2- 172.21.15.44:0/2488910869 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7afc0b2990 0x7f7afc0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:10.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.907+0000 7f7b12000700 1 -- 172.21.15.44:0/2488910869 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f7b000e33e0 con 0x7f7b1406bb40 2024-05-03T22:43:10.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.907+0000 7f7b19800700 1 --2- 172.21.15.44:0/2488910869 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7afc0b2990 0x7f7afc0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:10.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.908+0000 7f7b12000700 1 --2- 172.21.15.44:0/2488910869 >> [v2:172.21.15.60:6824/2396062554,v1:172.21.15.60:6825/2396062554] conn(0x7f7afc0bddf0 0x7f7afc0c0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:10.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.908+0000 7f7b12000700 1 -- 172.21.15.44:0/2488910869 --> [v2:172.21.15.60:6824/2396062554,v1:172.21.15.60:6825/2396062554] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b00011e50 con 0x7f7afc0bddf0 2024-05-03T22:43:10.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.908+0000 7f7b12000700 1 -- 172.21.15.44:0/2488910869 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f7b000e3790 con 0x7f7b1406bb40 2024-05-03T22:43:10.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.908+0000 7f7b19800700 1 --2- 172.21.15.44:0/2488910869 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7afc0b2990 0x7f7afc0b4e50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7b1419ab60 tx=0x7f7b0800b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:10.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.908+0000 7f7b1a200700 1 --2- 172.21.15.44:0/2488910869 >> [v2:172.21.15.60:6824/2396062554,v1:172.21.15.60:6825/2396062554] conn(0x7f7afc0bddf0 0x7f7afc0c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:10.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.909+0000 7f7b1a200700 1 --2- 172.21.15.44:0/2488910869 >> [v2:172.21.15.60:6824/2396062554,v1:172.21.15.60:6825/2396062554] conn(0x7f7afc0bddf0 0x7f7afc0c0290 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:10.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.912+0000 7f7b12000700 1 -- 172.21.15.44:0/2488910869 <== osd.10 v2:172.21.15.60:6824/2396062554 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7b00011e50 con 0x7f7afc0bddf0 2024-05-03T22:43:10.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.930+0000 7f7b1c200700 1 -- 172.21.15.44:0/2488910869 --> [v2:172.21.15.60:6824/2396062554,v1:172.21.15.60:6825/2396062554] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7af4002e60 con 0x7f7afc0bddf0 2024-05-03T22:43:10.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.932+0000 7f7b12000700 1 -- 172.21.15.44:0/2488910869 <== osd.10 v2:172.21.15.60:6824/2396062554 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7af4002e60 con 0x7f7afc0bddf0 2024-05-03T22:43:10.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.932+0000 7f7b1c200700 1 -- 172.21.15.44:0/2488910869 >> [v2:172.21.15.60:6824/2396062554,v1:172.21.15.60:6825/2396062554] conn(0x7f7afc0bddf0 msgr2=0x7f7afc0c0290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:10.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.932+0000 7f7b1c200700 1 --2- 172.21.15.44:0/2488910869 >> [v2:172.21.15.60:6824/2396062554,v1:172.21.15.60:6825/2396062554] conn(0x7f7afc0bddf0 0x7f7afc0c0290 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:10.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.932+0000 7f7b1c200700 1 -- 172.21.15.44:0/2488910869 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7afc0b2990 msgr2=0x7f7afc0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:10.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.932+0000 7f7b1c200700 1 --2- 172.21.15.44:0/2488910869 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7afc0b2990 0x7f7afc0b4e50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7b1419ab60 tx=0x7f7b0800b3c0 comp rx=0 tx=0).stop 2024-05-03T22:43:10.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.932+0000 7f7b1c200700 1 -- 172.21.15.44:0/2488910869 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b1406bb40 msgr2=0x7f7b1419fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:10.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.932+0000 7f7b1c200700 1 --2- 172.21.15.44:0/2488910869 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b1406bb40 0x7f7b1419fda0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000e9f0 tx=0x7f7b0000ed00 comp rx=0 tx=0).stop 2024-05-03T22:43:10.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.932+0000 7f7b1a200700 1 -- 172.21.15.44:0/2488910869 reap_dead start 2024-05-03T22:43:10.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.932+0000 7f7b1c200700 1 -- 172.21.15.44:0/2488910869 shutdown_connections 2024-05-03T22:43:10.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.932+0000 7f7b1c200700 1 -- 172.21.15.44:0/2488910869 >> 172.21.15.44:0/2488910869 conn(0x7f7b14079350 msgr2=0x7f7b14100fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:10.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.933+0000 7f7b1c200700 1 -- 172.21.15.44:0/2488910869 shutdown_connections 2024-05-03T22:43:10.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:10.933+0000 7f7b1c200700 1 -- 172.21.15.44:0/2488910869 wait complete. 2024-05-03T22:43:11.028 INFO:teuthology.orchestra.run.smithi044.stdout:133143986281 2024-05-03T22:43:11.029 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-03T22:43:11.848 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.662+0000 7f3d8be00700 1 -- 172.21.15.44:0/1877569762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d8c104590 msgr2=0x7f3d8c104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.662+0000 7f3d8be00700 1 --2- 172.21.15.44:0/1877569762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d8c104590 0x7f3d8c104970 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c009990 tx=0x7f3d7c009ca0 comp rx=0 tx=0).stop 2024-05-03T22:43:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.662+0000 7f3d8be00700 1 -- 172.21.15.44:0/1877569762 shutdown_connections 2024-05-03T22:43:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.662+0000 7f3d8be00700 1 --2- 172.21.15.44:0/1877569762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d8c10d9c0 0x7f3d8c10fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.662+0000 7f3d8be00700 1 --2- 172.21.15.44:0/1877569762 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d8c104590 0x7f3d8c104970 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.662+0000 7f3d8be00700 1 --2- 172.21.15.44:0/1877569762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d8c104eb0 0x7f3d8c10d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.662+0000 7f3d8be00700 1 -- 172.21.15.44:0/1877569762 >> 172.21.15.44:0/1877569762 conn(0x7f3d8c0fddc0 msgr2=0x7f3d8c1001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.662+0000 7f3d8be00700 1 -- 172.21.15.44:0/1877569762 shutdown_connections 2024-05-03T22:43:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.662+0000 7f3d8be00700 1 -- 172.21.15.44:0/1877569762 wait complete. 2024-05-03T22:43:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.663+0000 7f3d8be00700 1 Processor -- start 2024-05-03T22:43:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.664+0000 7f3d8be00700 1 -- start start 2024-05-03T22:43:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.664+0000 7f3d8be00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d8c104590 0x7f3d8c19f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.664+0000 7f3d8be00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d8c104eb0 0x7f3d8c19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:11.849 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.664+0000 7f3d8be00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d8c10d9c0 0x7f3d8c199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.664+0000 7f3d8be00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c113710 con 0x7f3d8c104590 2024-05-03T22:43:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.664+0000 7f3d8be00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c113590 con 0x7f3d8c104eb0 2024-05-03T22:43:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.664+0000 7f3d8be00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c113890 con 0x7f3d8c10d9c0 2024-05-03T22:43:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.665+0000 7f3d8aa00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d8c104590 0x7f3d8c19f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.665+0000 7f3d8aa00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d8c104590 0x7f3d8c19f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:52604/0 (socket says 172.21.15.44:52604) 2024-05-03T22:43:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.665+0000 7f3d8aa00700 1 -- 172.21.15.44:0/914892302 learned_addr learned my addr 172.21.15.44:0/914892302 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.665+0000 7f3d8b400700 1 --2- 172.21.15.44:0/914892302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d8c10d9c0 0x7f3d8c199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.665+0000 7f3d8a000700 1 --2- 172.21.15.44:0/914892302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d8c104eb0 0x7f3d8c19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.665+0000 7f3d8aa00700 1 -- 172.21.15.44:0/914892302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d8c10d9c0 msgr2=0x7f3d8c199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.665+0000 7f3d8aa00700 1 --2- 172.21.15.44:0/914892302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d8c10d9c0 0x7f3d8c199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.665+0000 7f3d8aa00700 1 -- 172.21.15.44:0/914892302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d8c104eb0 msgr2=0x7f3d8c19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.665+0000 7f3d8aa00700 1 --2- 172.21.15.44:0/914892302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d8c104eb0 0x7f3d8c19fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.665+0000 7f3d8aa00700 1 -- 172.21.15.44:0/914892302 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8c19a070 con 0x7f3d8c104590 2024-05-03T22:43:11.850 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.665+0000 7f3d8aa00700 1 --2- 172.21.15.44:0/914892302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d8c104590 0x7f3d8c19f750 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c000c00 tx=0x7f3d7c0037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.666+0000 7f3d90a00700 1 -- 172.21.15.44:0/914892302 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c027070 con 0x7f3d8c104590 2024-05-03T22:43:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.666+0000 7f3d90a00700 1 -- 172.21.15.44:0/914892302 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f3d7c0041a0 con 0x7f3d8c104590 2024-05-03T22:43:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.666+0000 7f3d90a00700 1 -- 172.21.15.44:0/914892302 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c00f460 con 0x7f3d8c104590 2024-05-03T22:43:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.666+0000 7f3d8be00700 1 -- 172.21.15.44:0/914892302 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d8c19a300 con 0x7f3d8c104590 2024-05-03T22:43:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.666+0000 7f3d8be00700 1 -- 172.21.15.44:0/914892302 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d8c1a6620 con 0x7f3d8c104590 2024-05-03T22:43:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.667+0000 7f3d8be00700 1 -- 172.21.15.44:0/914892302 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d8c0ffd90 con 0x7f3d8c104590 2024-05-03T22:43:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.670+0000 7f3d90a00700 1 -- 172.21.15.44:0/914892302 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3d7c02a070 con 0x7f3d8c104590 2024-05-03T22:43:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.671+0000 7f3d90a00700 1 --2- 172.21.15.44:0/914892302 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f3d700b2990 0x7f3d700b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.671+0000 7f3d90a00700 1 -- 172.21.15.44:0/914892302 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f3d7c0e3bd0 con 0x7f3d8c104590 2024-05-03T22:43:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.671+0000 7f3d8a000700 1 --2- 172.21.15.44:0/914892302 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f3d700b2990 0x7f3d700b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.671+0000 7f3d90a00700 1 --2- 172.21.15.44:0/914892302 >> [v2:172.21.15.60:6800/563003638,v1:172.21.15.60:6801/563003638] conn(0x7f3d700bddf0 0x7f3d700c0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.671+0000 7f3d90a00700 1 -- 172.21.15.44:0/914892302 --> [v2:172.21.15.60:6800/563003638,v1:172.21.15.60:6801/563003638] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d7c012ec0 con 0x7f3d700bddf0 2024-05-03T22:43:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.671+0000 7f3d90a00700 1 -- 172.21.15.44:0/914892302 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f3d7c0e3f80 con 0x7f3d8c104590 2024-05-03T22:43:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.672+0000 7f3d8a000700 1 --2- 172.21.15.44:0/914892302 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f3d700b2990 0x7f3d700b4e50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3d78005ea0 tx=0x7f3d78005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.672+0000 7f3d8b400700 1 --2- 172.21.15.44:0/914892302 >> [v2:172.21.15.60:6800/563003638,v1:172.21.15.60:6801/563003638] conn(0x7f3d700bddf0 0x7f3d700c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:11.851 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.673+0000 7f3d8b400700 1 --2- 172.21.15.44:0/914892302 >> [v2:172.21.15.60:6800/563003638,v1:172.21.15.60:6801/563003638] conn(0x7f3d700bddf0 0x7f3d700c0290 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:11.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.677+0000 7f3d90a00700 1 -- 172.21.15.44:0/914892302 <== osd.1 v2:172.21.15.60:6800/563003638 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d7c012ec0 con 0x7f3d700bddf0 2024-05-03T22:43:11.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.695+0000 7f3d8be00700 1 -- 172.21.15.44:0/914892302 --> [v2:172.21.15.60:6800/563003638,v1:172.21.15.60:6801/563003638] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3d8c06ba60 con 0x7f3d700bddf0 2024-05-03T22:43:11.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.696+0000 7f3d90a00700 1 -- 172.21.15.44:0/914892302 <== osd.1 v2:172.21.15.60:6800/563003638 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3d8c06ba60 con 0x7f3d700bddf0 2024-05-03T22:43:11.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.696+0000 7f3d8be00700 1 -- 172.21.15.44:0/914892302 >> [v2:172.21.15.60:6800/563003638,v1:172.21.15.60:6801/563003638] conn(0x7f3d700bddf0 msgr2=0x7f3d700c0290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:11.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.696+0000 7f3d8be00700 1 --2- 172.21.15.44:0/914892302 >> [v2:172.21.15.60:6800/563003638,v1:172.21.15.60:6801/563003638] conn(0x7f3d700bddf0 0x7f3d700c0290 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:11.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.697+0000 7f3d8be00700 1 -- 172.21.15.44:0/914892302 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f3d700b2990 msgr2=0x7f3d700b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:11.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.697+0000 7f3d8be00700 1 --2- 172.21.15.44:0/914892302 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f3d700b2990 0x7f3d700b4e50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3d78005ea0 tx=0x7f3d78005e30 comp rx=0 tx=0).stop 2024-05-03T22:43:11.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.697+0000 7f3d8be00700 1 -- 172.21.15.44:0/914892302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d8c104590 msgr2=0x7f3d8c19f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:11.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.697+0000 7f3d8be00700 1 --2- 172.21.15.44:0/914892302 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3d8c104590 0x7f3d8c19f750 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c000c00 tx=0x7f3d7c0037a0 comp rx=0 tx=0).stop 2024-05-03T22:43:11.852 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.697+0000 7f3d8b400700 1 -- 172.21.15.44:0/914892302 reap_dead start 2024-05-03T22:43:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.697+0000 7f3d8be00700 1 -- 172.21.15.44:0/914892302 shutdown_connections 2024-05-03T22:43:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.697+0000 7f3d8be00700 1 -- 172.21.15.44:0/914892302 >> 172.21.15.44:0/914892302 conn(0x7f3d8c0fddc0 msgr2=0x7f3d8c10fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.697+0000 7f3d8be00700 1 -- 172.21.15.44:0/914892302 shutdown_connections 2024-05-03T22:43:11.853 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:11.697+0000 7f3d8be00700 1 -- 172.21.15.44:0/914892302 wait complete. 2024-05-03T22:43:12.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:12 smithi044 ceph-mon[28604]: pgmap v470: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-05-03T22:43:12.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:12 smithi060 ceph-mon[31721]: pgmap v470: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-05-03T22:43:12.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:12 smithi160 ceph-mon[32531]: pgmap v470: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 10 op/s 2024-05-03T22:43:12.787 INFO:teuthology.orchestra.run.smithi044.stdout:154618822754 2024-05-03T22:43:12.787 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-03T22:43:12.904 INFO:teuthology.orchestra.run.smithi044.stdout:107374182513 2024-05-03T22:43:12.904 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-03T22:43:13.089 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:43:13.110 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:43:13.111 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:43:13.140 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:43:13.154 INFO:teuthology.orchestra.run.smithi044.stdout:274877907008 2024-05-03T22:43:13.154 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-03T22:43:13.717 INFO:teuthology.orchestra.run.smithi044.stdout:55834574976 2024-05-03T22:43:13.718 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-03T22:43:14.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:14 smithi044 ceph-mon[28604]: pgmap v471: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T22:43:14.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:14 smithi060 ceph-mon[31721]: pgmap v471: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T22:43:14.514 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:43:14.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:14 smithi160 ceph-mon[32531]: pgmap v471: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T22:43:14.519 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:43:16.291 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:16 smithi044 ceph-mon[28604]: pgmap v472: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-05-03T22:43:16.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:16 smithi160 ceph-mon[32531]: pgmap v472: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-05-03T22:43:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:16 smithi060 ceph-mon[31721]: pgmap v472: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 11 op/s 2024-05-03T22:43:18.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:18 smithi160 ceph-mon[32531]: pgmap v473: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T22:43:18.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:18 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:43:18.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:18 smithi044 ceph-mon[28604]: pgmap v473: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T22:43:18.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:18 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:43:18.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:18 smithi060 ceph-mon[31721]: pgmap v473: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T22:43:18.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:18 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:43:19.031 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:43:20.457 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:20 smithi044 ceph-mon[28604]: pgmap v474: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T22:43:20.457 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:20 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:43:20.457 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:20 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:43:20.457 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:20 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:43:20.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:20 smithi060 ceph-mon[31721]: pgmap v474: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T22:43:20.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:20 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:43:20.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:20 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:43:20.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:20 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:43:20.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:20 smithi160 ceph-mon[32531]: pgmap v474: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-03T22:43:20.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:20 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:43:20.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:20 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:43:20.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:20 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:43:22.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.634+0000 7f342d400700 1 -- 172.21.15.44:0/1831385679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34281099e0 msgr2=0x7f3428109e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:22.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.634+0000 7f342d400700 1 --2- 172.21.15.44:0/1831385679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34281099e0 0x7f3428109e60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3410009990 tx=0x7f3410009ca0 comp rx=0 tx=0).stop 2024-05-03T22:43:22.203 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.634+0000 7f342d400700 1 -- 172.21.15.44:0/1831385679 shutdown_connections 2024-05-03T22:43:22.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.634+0000 7f342d400700 1 --2- 172.21.15.44:0/1831385679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f342810a3a0 0x7f3428116840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:22.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.635+0000 7f342d400700 1 --2- 172.21.15.44:0/1831385679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f342810e8b0 0x7f342810ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:22.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.635+0000 7f342d400700 1 --2- 172.21.15.44:0/1831385679 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34281099e0 0x7f3428109e60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:22.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.635+0000 7f342d400700 1 -- 172.21.15.44:0/1831385679 >> 172.21.15.44:0/1831385679 conn(0x7f3428079230 msgr2=0x7f34281082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:22.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.635+0000 7f342d400700 1 -- 172.21.15.44:0/1831385679 shutdown_connections 2024-05-03T22:43:22.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.635+0000 7f342d400700 1 -- 172.21.15.44:0/1831385679 wait complete. 2024-05-03T22:43:22.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.636+0000 7f342d400700 1 Processor -- start 2024-05-03T22:43:22.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.636+0000 7f342d400700 1 -- start start 2024-05-03T22:43:22.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.637+0000 7f342d400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34281099e0 0x7f34281a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:22.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.637+0000 7f342d400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f342810a3a0 0x7f34281a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:22.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.637+0000 7f342d400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f342810e8b0 0x7f34281a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:22.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.637+0000 7f342d400700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3428119d20 con 0x7f34281099e0 2024-05-03T22:43:22.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.637+0000 7f342d400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3428119ba0 con 0x7f342810e8b0 2024-05-03T22:43:22.204 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.637+0000 7f342d400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3428119ea0 con 0x7f342810a3a0 2024-05-03T22:43:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.637+0000 7f3427e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34281099e0 0x7f34281a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.637+0000 7f3427e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34281099e0 0x7f34281a0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51652/0 (socket says 172.21.15.44:51652) 2024-05-03T22:43:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.637+0000 7f3427e00700 1 -- 172.21.15.44:0/1096360775 learned_addr learned my addr 172.21.15.44:0/1096360775 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.638+0000 7f341fe00700 1 --2- 172.21.15.44:0/1096360775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f342810a3a0 0x7f34281a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.638+0000 7f342ca00700 1 --2- 172.21.15.44:0/1096360775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f342810e8b0 0x7f34281a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.638+0000 7f3427e00700 1 -- 172.21.15.44:0/1096360775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f342810a3a0 msgr2=0x7f34281a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.638+0000 7f3427e00700 1 --2- 172.21.15.44:0/1096360775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f342810a3a0 0x7f34281a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.638+0000 7f3427e00700 1 -- 172.21.15.44:0/1096360775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f342810e8b0 msgr2=0x7f34281a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.638+0000 7f3427e00700 1 --2- 172.21.15.44:0/1096360775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f342810e8b0 0x7f34281a4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.638+0000 7f3427e00700 1 -- 172.21.15.44:0/1096360775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34281a5150 con 0x7f34281099e0 2024-05-03T22:43:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.638+0000 7f3427e00700 1 --2- 172.21.15.44:0/1096360775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34281099e0 0x7f34281a0190 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f341800d950 tx=0x7f341800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:22.205 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.639+0000 7f3425600700 1 -- 172.21.15.44:0/1096360775 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3418016070 con 0x7f34281099e0 2024-05-03T22:43:22.206 INFO:teuthology.orchestra.run.smithi044.stdout:253403070537 2024-05-03T22:43:22.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.639+0000 7f3425600700 1 -- 172.21.15.44:0/1096360775 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f3418009b40 con 0x7f34281099e0 2024-05-03T22:43:22.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.639+0000 7f342d400700 1 -- 172.21.15.44:0/1096360775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34281a5440 con 0x7f34281099e0 2024-05-03T22:43:22.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.639+0000 7f3425600700 1 -- 172.21.15.44:0/1096360775 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f341800f620 con 0x7f34281099e0 2024-05-03T22:43:22.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.639+0000 7f342d400700 1 -- 172.21.15.44:0/1096360775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34281accc0 con 0x7f34281099e0 2024-05-03T22:43:22.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.640+0000 7f342d400700 1 -- 172.21.15.44:0/1096360775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f342806a190 con 0x7f34281099e0 2024-05-03T22:43:22.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.642+0000 7f3425600700 1 -- 172.21.15.44:0/1096360775 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3418019070 con 0x7f34281099e0 2024-05-03T22:43:22.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.644+0000 7f3425600700 1 --2- 172.21.15.44:0/1096360775 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f340c0b2910 0x7f340c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:22.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.644+0000 7f3425600700 1 -- 172.21.15.44:0/1096360775 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f34180e2780 con 0x7f34281099e0 2024-05-03T22:43:22.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.644+0000 7f341fe00700 1 --2- 172.21.15.44:0/1096360775 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f340c0b2910 0x7f340c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:22.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.645+0000 7f341fe00700 1 --2- 172.21.15.44:0/1096360775 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f340c0b2910 0x7f340c0b4dd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f341000b5c0 tx=0x7f3410005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:22.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.649+0000 7f3425600700 1 -- 172.21.15.44:0/1096360775 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f34180a9ed0 con 0x7f34281099e0 2024-05-03T22:43:22.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.900+0000 7f342d400700 1 -- 172.21.15.44:0/1096360775 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f342802e510 con 0x7f34281099e0 2024-05-03T22:43:22.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.901+0000 7f3425600700 1 -- 172.21.15.44:0/1096360775 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f34180a97d0 con 0x7f34281099e0 2024-05-03T22:43:22.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.904+0000 7f342d400700 1 -- 172.21.15.44:0/1096360775 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f340c0b2910 msgr2=0x7f340c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:22.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.904+0000 7f342d400700 1 --2- 172.21.15.44:0/1096360775 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f340c0b2910 0x7f340c0b4dd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f341000b5c0 tx=0x7f3410005fd0 comp rx=0 tx=0).stop 2024-05-03T22:43:22.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.904+0000 7f342d400700 1 -- 172.21.15.44:0/1096360775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34281099e0 msgr2=0x7f34281a0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:22.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.904+0000 7f342d400700 1 --2- 172.21.15.44:0/1096360775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34281099e0 0x7f34281a0190 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f341800d950 tx=0x7f341800dd10 comp rx=0 tx=0).stop 2024-05-03T22:43:22.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.905+0000 7f342d400700 1 -- 172.21.15.44:0/1096360775 shutdown_connections 2024-05-03T22:43:22.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.905+0000 7f342d400700 1 --2- 172.21.15.44:0/1096360775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f342810e8b0 0x7f34281a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:22.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.905+0000 7f342d400700 1 --2- 172.21.15.44:0/1096360775 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34281099e0 0x7f34281a0190 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:22.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.905+0000 7f342d400700 1 --2- 172.21.15.44:0/1096360775 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f340c0b2910 0x7f340c0b4dd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:22.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.905+0000 7f342d400700 1 --2- 172.21.15.44:0/1096360775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f342810a3a0 0x7f34281a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:22.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.905+0000 7f342d400700 1 -- 172.21.15.44:0/1096360775 >> 172.21.15.44:0/1096360775 conn(0x7f3428079230 msgr2=0x7f3428079890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:22.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.905+0000 7f342d400700 1 -- 172.21.15.44:0/1096360775 shutdown_connections 2024-05-03T22:43:22.207 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:21.905+0000 7f342d400700 1 -- 172.21.15.44:0/1096360775 wait complete. 2024-05-03T22:43:22.437 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:43:22.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:22 smithi044 ceph-mon[28604]: pgmap v475: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T22:43:22.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:22 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1096360775' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-03T22:43:22.568 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:22 smithi160 ceph-mon[32531]: pgmap v475: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T22:43:22.568 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:22 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1096360775' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-03T22:43:22.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:22 smithi060 ceph-mon[31721]: pgmap v475: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-03T22:43:22.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:22 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1096360775' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-03T22:43:22.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.936+0000 7f37b6600700 1 -- 172.21.15.44:0/2321599041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37b0109510 msgr2=0x7f37b01098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:22.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.936+0000 7f37b6600700 1 --2- 172.21.15.44:0/2321599041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37b0109510 0x7f37b01098f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f37a0009990 tx=0x7f37a0009ca0 comp rx=0 tx=0).stop 2024-05-03T22:43:22.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.936+0000 7f37b6600700 1 -- 172.21.15.44:0/2321599041 shutdown_connections 2024-05-03T22:43:22.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.936+0000 7f37b6600700 1 --2- 172.21.15.44:0/2321599041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37b006bb40 0x7f37b0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:22.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.936+0000 7f37b6600700 1 --2- 172.21.15.44:0/2321599041 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37b0109510 0x7f37b01098f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:22.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.936+0000 7f37b6600700 1 --2- 172.21.15.44:0/2321599041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b006b180 0x7f37b006b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:22.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.936+0000 7f37b6600700 1 -- 172.21.15.44:0/2321599041 >> 172.21.15.44:0/2321599041 conn(0x7f37b0079350 msgr2=0x7f37b0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:22.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.937+0000 7f37b6600700 1 -- 172.21.15.44:0/2321599041 shutdown_connections 2024-05-03T22:43:22.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.937+0000 7f37b6600700 1 -- 172.21.15.44:0/2321599041 wait complete. 2024-05-03T22:43:22.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.938+0000 7f37b6600700 1 Processor -- start 2024-05-03T22:43:22.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.938+0000 7f37b6600700 1 -- start start 2024-05-03T22:43:22.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.938+0000 7f37b6600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b006b180 0x7f37b019be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:22.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.938+0000 7f37b6600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37b006bb40 0x7f37b019c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:22.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.938+0000 7f37b6600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37b0109510 0x7f37b01a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:22.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.938+0000 7f37b6600700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f37b0113780 con 0x7f37b0109510 2024-05-03T22:43:22.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.938+0000 7f37b6600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f37b0113600 con 0x7f37b006b180 2024-05-03T22:43:22.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.938+0000 7f37b6600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f37b0113900 con 0x7f37b006bb40 2024-05-03T22:43:22.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.939+0000 7f37afe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37b0109510 0x7f37b01a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:22.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.939+0000 7f37afe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37b0109510 0x7f37b01a0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51664/0 (socket says 172.21.15.44:51664) 2024-05-03T22:43:22.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.939+0000 7f37afe00700 1 -- 172.21.15.44:0/1271034960 learned_addr learned my addr 172.21.15.44:0/1271034960 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:22.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.939+0000 7f37af400700 1 --2- 172.21.15.44:0/1271034960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b006b180 0x7f37b019be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:22.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.939+0000 7f37a6a00700 1 --2- 172.21.15.44:0/1271034960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37b006bb40 0x7f37b019c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:22.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.939+0000 7f37afe00700 1 -- 172.21.15.44:0/1271034960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37b006bb40 msgr2=0x7f37b019c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:22.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.939+0000 7f37afe00700 1 --2- 172.21.15.44:0/1271034960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37b006bb40 0x7f37b019c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:22.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.939+0000 7f37afe00700 1 -- 172.21.15.44:0/1271034960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b006b180 msgr2=0x7f37b019be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:22.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.939+0000 7f37afe00700 1 --2- 172.21.15.44:0/1271034960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b006b180 0x7f37b019be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:22.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.939+0000 7f37afe00700 1 -- 172.21.15.44:0/1271034960 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b01a0e50 con 0x7f37b0109510 2024-05-03T22:43:22.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.939+0000 7f37af400700 1 --2- 172.21.15.44:0/1271034960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b006b180 0x7f37b019be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:43:22.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.940+0000 7f37afe00700 1 --2- 172.21.15.44:0/1271034960 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37b0109510 0x7f37b01a0710 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f37a8007ee0 tx=0x7f37a800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:22.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.940+0000 7f37acc00700 1 -- 172.21.15.44:0/1271034960 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a800dbd0 con 0x7f37b0109510 2024-05-03T22:43:22.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.940+0000 7f37acc00700 1 -- 172.21.15.44:0/1271034960 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f37a800dd70 con 0x7f37b0109510 2024-05-03T22:43:22.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.940+0000 7f37acc00700 1 -- 172.21.15.44:0/1271034960 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a80133f0 con 0x7f37b0109510 2024-05-03T22:43:22.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.940+0000 7f37b6600700 1 -- 172.21.15.44:0/1271034960 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b01a1140 con 0x7f37b0109510 2024-05-03T22:43:22.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.940+0000 7f37b6600700 1 -- 172.21.15.44:0/1271034960 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b01a89c0 con 0x7f37b0109510 2024-05-03T22:43:22.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.941+0000 7f37b6600700 1 -- 172.21.15.44:0/1271034960 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b006a190 con 0x7f37b0109510 2024-05-03T22:43:22.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.944+0000 7f37acc00700 1 -- 172.21.15.44:0/1271034960 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f37a801a020 con 0x7f37b0109510 2024-05-03T22:43:22.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.946+0000 7f37acc00700 1 --2- 172.21.15.44:0/1271034960 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f37940b2990 0x7f37940b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:22.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.946+0000 7f37acc00700 1 -- 172.21.15.44:0/1271034960 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f37a80e2480 con 0x7f37b0109510 2024-05-03T22:43:22.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.946+0000 7f37af400700 1 --2- 172.21.15.44:0/1271034960 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f37940b2990 0x7f37940b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:22.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.947+0000 7f37af400700 1 --2- 172.21.15.44:0/1271034960 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f37940b2990 0x7f37940b4e50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f37a0006010 tx=0x7f37a000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:22.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:22.948+0000 7f37acc00700 1 -- 172.21.15.44:0/1271034960 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f37a8010070 con 0x7f37b0109510 2024-05-03T22:43:23.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.209+0000 7f37b6600700 1 -- 172.21.15.44:0/1271034960 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f37b01a8c60 con 0x7f37b0109510 2024-05-03T22:43:23.211 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.210+0000 7f37acc00700 1 -- 172.21.15.44:0/1271034960 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f37a80a9c30 con 0x7f37b0109510 2024-05-03T22:43:23.212 INFO:teuthology.orchestra.run.smithi044.stdout:34359738502 2024-05-03T22:43:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.213+0000 7f37b6600700 1 -- 172.21.15.44:0/1271034960 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f37940b2990 msgr2=0x7f37940b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.213+0000 7f37b6600700 1 --2- 172.21.15.44:0/1271034960 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f37940b2990 0x7f37940b4e50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f37a0006010 tx=0x7f37a000b540 comp rx=0 tx=0).stop 2024-05-03T22:43:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.213+0000 7f37b6600700 1 -- 172.21.15.44:0/1271034960 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37b0109510 msgr2=0x7f37b01a0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.213+0000 7f37b6600700 1 --2- 172.21.15.44:0/1271034960 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37b0109510 0x7f37b01a0710 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f37a8007ee0 tx=0x7f37a800d3b0 comp rx=0 tx=0).stop 2024-05-03T22:43:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.213+0000 7f37b6600700 1 -- 172.21.15.44:0/1271034960 shutdown_connections 2024-05-03T22:43:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.213+0000 7f37b6600700 1 --2- 172.21.15.44:0/1271034960 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37b0109510 0x7f37b01a0710 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.213+0000 7f37b6600700 1 --2- 172.21.15.44:0/1271034960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37b006b180 0x7f37b019be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.213+0000 7f37b6600700 1 --2- 172.21.15.44:0/1271034960 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f37940b2990 0x7f37940b4e50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.213+0000 7f37b6600700 1 --2- 172.21.15.44:0/1271034960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37b006bb40 0x7f37b019c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.213+0000 7f37b6600700 1 -- 172.21.15.44:0/1271034960 >> 172.21.15.44:0/1271034960 conn(0x7f37b0079350 msgr2=0x7f37b0100d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:23.215 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.213+0000 7f37b6600700 1 -- 172.21.15.44:0/1271034960 shutdown_connections 2024-05-03T22:43:23.216 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.213+0000 7f37b6600700 1 -- 172.21.15.44:0/1271034960 wait complete. 2024-05-03T22:43:23.433 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:23 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1271034960' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-03T22:43:23.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:23 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1271034960' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-03T22:43:23.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:23 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1271034960' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-03T22:43:23.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.775+0000 7fe73e400700 1 -- 172.21.15.44:0/1739093510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe73810b6e0 msgr2=0x7fe73810bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:23.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.775+0000 7fe73e400700 1 --2- 172.21.15.44:0/1739093510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe73810b6e0 0x7fe73810bac0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe728009990 tx=0x7fe728009ca0 comp rx=0 tx=0).stop 2024-05-03T22:43:23.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.775+0000 7fe73e400700 1 -- 172.21.15.44:0/1739093510 shutdown_connections 2024-05-03T22:43:23.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.775+0000 7fe73e400700 1 --2- 172.21.15.44:0/1739093510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7381060a0 0x7fe7381125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:23.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.775+0000 7fe73e400700 1 --2- 172.21.15.44:0/1739093510 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe73810b6e0 0x7fe73810bac0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:23.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.775+0000 7fe73e400700 1 --2- 172.21.15.44:0/1739093510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7381056e0 0x7fe738105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:23.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.775+0000 7fe73e400700 1 -- 172.21.15.44:0/1739093510 >> 172.21.15.44:0/1739093510 conn(0x7fe7381011d0 msgr2=0x7fe7381035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:23.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.775+0000 7fe73e400700 1 -- 172.21.15.44:0/1739093510 shutdown_connections 2024-05-03T22:43:23.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.775+0000 7fe73e400700 1 -- 172.21.15.44:0/1739093510 wait complete. 2024-05-03T22:43:23.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.777+0000 7fe73e400700 1 Processor -- start 2024-05-03T22:43:23.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.777+0000 7fe73e400700 1 -- start start 2024-05-03T22:43:23.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.777+0000 7fe73e400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7381056e0 0x7fe7381109c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:23.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.777+0000 7fe73e400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7381060a0 0x7fe738110f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:23.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.777+0000 7fe73e400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73810b6e0 0x7fe738111440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:23.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.777+0000 7fe73e400700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fe738078690 con 0x7fe7381060a0 2024-05-03T22:43:23.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.777+0000 7fe73e400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe738078510 con 0x7fe73810b6e0 2024-05-03T22:43:23.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.777+0000 7fe73e400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe738078810 con 0x7fe7381056e0 2024-05-03T22:43:23.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.778+0000 7fe736a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7381060a0 0x7fe738110f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:23.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.778+0000 7fe736a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7381060a0 0x7fe738110f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51680/0 (socket says 172.21.15.44:51680) 2024-05-03T22:43:23.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.778+0000 7fe736a00700 1 -- 172.21.15.44:0/1468933093 learned_addr learned my addr 172.21.15.44:0/1468933093 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:23.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.778+0000 7fe737400700 1 --2- 172.21.15.44:0/1468933093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7381056e0 0x7fe7381109c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:23.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.778+0000 7fe737e00700 1 --2- 172.21.15.44:0/1468933093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73810b6e0 0x7fe738111440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:23.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.779+0000 7fe736a00700 1 -- 172.21.15.44:0/1468933093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7381056e0 msgr2=0x7fe7381109c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:23.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.779+0000 7fe736a00700 1 --2- 172.21.15.44:0/1468933093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7381056e0 0x7fe7381109c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:23.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.779+0000 7fe736a00700 1 -- 172.21.15.44:0/1468933093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73810b6e0 msgr2=0x7fe738111440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:23.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.779+0000 7fe736a00700 1 --2- 172.21.15.44:0/1468933093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73810b6e0 0x7fe738111440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:23.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.779+0000 7fe736a00700 1 -- 172.21.15.44:0/1468933093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7381ac5a0 con 0x7fe7381060a0 2024-05-03T22:43:23.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.779+0000 7fe737e00700 1 --2- 172.21.15.44:0/1468933093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73810b6e0 0x7fe738111440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:43:23.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.780+0000 7fe736a00700 1 --2- 172.21.15.44:0/1468933093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7381060a0 0x7fe738110f00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe72400d980 tx=0x7fe72400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:23.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.780+0000 7fe72fe00700 1 -- 172.21.15.44:0/1468933093 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe724017070 con 0x7fe7381060a0 2024-05-03T22:43:23.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.780+0000 7fe72fe00700 1 -- 172.21.15.44:0/1468933093 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fe724005020 con 0x7fe7381060a0 2024-05-03T22:43:23.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.780+0000 7fe72fe00700 1 -- 172.21.15.44:0/1468933093 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe724009bf0 con 0x7fe7381060a0 2024-05-03T22:43:23.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.780+0000 7fe73e400700 1 -- 172.21.15.44:0/1468933093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7381ac890 con 0x7fe7381060a0 2024-05-03T22:43:23.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.780+0000 7fe73e400700 1 -- 172.21.15.44:0/1468933093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7381acdd0 con 0x7fe7381060a0 2024-05-03T22:43:23.784 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.783+0000 7fe73e400700 1 -- 172.21.15.44:0/1468933093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe73806a190 con 0x7fe7381060a0 2024-05-03T22:43:23.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.787+0000 7fe72fe00700 1 -- 172.21.15.44:0/1468933093 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe7240051d0 con 0x7fe7381060a0 2024-05-03T22:43:23.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.789+0000 7fe72fe00700 1 --2- 172.21.15.44:0/1468933093 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fe71c0b2990 0x7fe71c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:23.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.790+0000 7fe72fe00700 1 -- 172.21.15.44:0/1468933093 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fe7240e2310 con 0x7fe7381060a0 2024-05-03T22:43:23.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.790+0000 7fe737400700 1 --2- 172.21.15.44:0/1468933093 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fe71c0b2990 0x7fe71c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:23.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.791+0000 7fe737400700 1 --2- 172.21.15.44:0/1468933093 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fe71c0b2990 0x7fe71c0b4e50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe728005b00 tx=0x7fe728005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:23.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:23.794+0000 7fe72fe00700 1 -- 172.21.15.44:0/1468933093 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fe724020020 con 0x7fe7381060a0 2024-05-03T22:43:24.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.047+0000 7fe73e400700 1 -- 172.21.15.44:0/1468933093 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fe7381ad090 con 0x7fe7381060a0 2024-05-03T22:43:24.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.047+0000 7fe72fe00700 1 -- 172.21.15.44:0/1468933093 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe7240a9a60 con 0x7fe7381060a0 2024-05-03T22:43:24.049 INFO:teuthology.orchestra.run.smithi044.stdout:201863462999 2024-05-03T22:43:24.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.050+0000 7fe73e400700 1 -- 172.21.15.44:0/1468933093 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fe71c0b2990 msgr2=0x7fe71c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:24.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.050+0000 7fe73e400700 1 --2- 172.21.15.44:0/1468933093 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fe71c0b2990 0x7fe71c0b4e50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe728005b00 tx=0x7fe728005a90 comp rx=0 tx=0).stop 2024-05-03T22:43:24.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.050+0000 7fe73e400700 1 -- 172.21.15.44:0/1468933093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7381060a0 msgr2=0x7fe738110f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:24.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.050+0000 7fe73e400700 1 --2- 172.21.15.44:0/1468933093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7381060a0 0x7fe738110f00 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe72400d980 tx=0x7fe72400dc90 comp rx=0 tx=0).stop 2024-05-03T22:43:24.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.050+0000 7fe73e400700 1 -- 172.21.15.44:0/1468933093 shutdown_connections 2024-05-03T22:43:24.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.050+0000 7fe73e400700 1 --2- 172.21.15.44:0/1468933093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe73810b6e0 0x7fe738111440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:24.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.050+0000 7fe73e400700 1 --2- 172.21.15.44:0/1468933093 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fe71c0b2990 0x7fe71c0b4e50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:24.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.050+0000 7fe73e400700 1 --2- 172.21.15.44:0/1468933093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7381056e0 0x7fe7381109c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:24.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.050+0000 7fe73e400700 1 --2- 172.21.15.44:0/1468933093 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fe7381060a0 0x7fe738110f00 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:24.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.050+0000 7fe73e400700 1 -- 172.21.15.44:0/1468933093 >> 172.21.15.44:0/1468933093 conn(0x7fe7381011d0 msgr2=0x7fe73807ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:24.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.051+0000 7fe73e400700 1 -- 172.21.15.44:0/1468933093 shutdown_connections 2024-05-03T22:43:24.053 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.051+0000 7fe73e400700 1 -- 172.21.15.44:0/1468933093 wait complete. 2024-05-03T22:43:24.559 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:24 smithi044 ceph-mon[28604]: pgmap v476: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-03T22:43:24.560 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:24 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1468933093' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-03T22:43:24.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.559+0000 7f1517000700 1 -- 172.21.15.44:0/3028450983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f151010b680 msgr2=0x7f151010ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:24.593 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.559+0000 7f1517000700 1 --2- 172.21.15.44:0/3028450983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f151010b680 0x7f151010ba60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f15040099c0 tx=0x7f1504009cd0 comp rx=0 tx=0).stop 2024-05-03T22:43:24.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.560+0000 7f1517000700 1 -- 172.21.15.44:0/3028450983 shutdown_connections 2024-05-03T22:43:24.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.560+0000 7f1517000700 1 --2- 172.21.15.44:0/3028450983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1510105f90 0x7f1510112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:24.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.560+0000 7f1517000700 1 --2- 172.21.15.44:0/3028450983 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f151010b680 0x7f151010ba60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:24.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.560+0000 7f1517000700 1 --2- 172.21.15.44:0/3028450983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15101055d0 0x7f1510105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:24.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.560+0000 7f1517000700 1 -- 172.21.15.44:0/3028450983 >> 172.21.15.44:0/3028450983 conn(0x7f15101010e0 msgr2=0x7f1510103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:24.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.560+0000 7f1517000700 1 -- 172.21.15.44:0/3028450983 shutdown_connections 2024-05-03T22:43:24.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.560+0000 7f1517000700 1 -- 172.21.15.44:0/3028450983 wait complete. 2024-05-03T22:43:24.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.561+0000 7f1517000700 1 Processor -- start 2024-05-03T22:43:24.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.561+0000 7f1517000700 1 -- start start 2024-05-03T22:43:24.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.562+0000 7f1517000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15101055d0 0x7f1510112150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:24.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.562+0000 7f1517000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1510105f90 0x7f151010f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:24.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.562+0000 7f1517000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f151010b680 0x7f151010f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:24.594 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.562+0000 7f1517000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1510115910 con 0x7f15101055d0 2024-05-03T22:43:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.562+0000 7f1517000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1510115790 con 0x7f151010b680 2024-05-03T22:43:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.562+0000 7f1517000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1510115a90 con 0x7f1510105f90 2024-05-03T22:43:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.562+0000 7f1515c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15101055d0 0x7f1510112150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.562+0000 7f1515c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15101055d0 0x7f1510112150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51702/0 (socket says 172.21.15.44:51702) 2024-05-03T22:43:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.562+0000 7f1515c00700 1 -- 172.21.15.44:0/3161832177 learned_addr learned my addr 172.21.15.44:0/3161832177 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.562+0000 7f1515200700 1 --2- 172.21.15.44:0/3161832177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1510105f90 0x7f151010f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.562+0000 7f1516600700 1 --2- 172.21.15.44:0/3161832177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f151010b680 0x7f151010f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.562+0000 7f1515c00700 1 -- 172.21.15.44:0/3161832177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1510105f90 msgr2=0x7f151010f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.562+0000 7f1515c00700 1 --2- 172.21.15.44:0/3161832177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1510105f90 0x7f151010f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.562+0000 7f1515c00700 1 -- 172.21.15.44:0/3161832177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f151010b680 msgr2=0x7f151010f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.562+0000 7f1515c00700 1 --2- 172.21.15.44:0/3161832177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f151010b680 0x7f151010f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.562+0000 7f1515c00700 1 -- 172.21.15.44:0/3161832177 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151010fed0 con 0x7f15101055d0 2024-05-03T22:43:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.562+0000 7f1516600700 1 --2- 172.21.15.44:0/3161832177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f151010b680 0x7f151010f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:43:24.595 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.563+0000 7f1515c00700 1 --2- 172.21.15.44:0/3161832177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15101055d0 0x7f1510112150 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1504005b40 tx=0x7f1504005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:24.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.563+0000 7f150e000700 1 -- 172.21.15.44:0/3161832177 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1504027070 con 0x7f15101055d0 2024-05-03T22:43:24.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.563+0000 7f150e000700 1 -- 172.21.15.44:0/3161832177 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f1504004020 con 0x7f15101055d0 2024-05-03T22:43:24.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.563+0000 7f150e000700 1 -- 172.21.15.44:0/3161832177 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1504022df0 con 0x7f15101055d0 2024-05-03T22:43:24.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.563+0000 7f1517000700 1 -- 172.21.15.44:0/3161832177 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15101ac650 con 0x7f15101055d0 2024-05-03T22:43:24.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.563+0000 7f1517000700 1 -- 172.21.15.44:0/3161832177 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15101ac9f0 con 0x7f15101055d0 2024-05-03T22:43:24.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.565+0000 7f1517000700 1 -- 172.21.15.44:0/3161832177 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1510106cf0 con 0x7f15101055d0 2024-05-03T22:43:24.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.567+0000 7f150e000700 1 -- 172.21.15.44:0/3161832177 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f150402a070 con 0x7f15101055d0 2024-05-03T22:43:24.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.568+0000 7f150e000700 1 --2- 172.21.15.44:0/3161832177 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f14f80b2990 0x7f14f80b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:24.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.569+0000 7f150e000700 1 -- 172.21.15.44:0/3161832177 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f15040e3d20 con 0x7f15101055d0 2024-05-03T22:43:24.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.569+0000 7f1515200700 1 --2- 172.21.15.44:0/3161832177 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f14f80b2990 0x7f14f80b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:24.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.570+0000 7f1515200700 1 --2- 172.21.15.44:0/3161832177 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f14f80b2990 0x7f14f80b4e50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f14fc005950 tx=0x7f14fc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:24.596 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.571+0000 7f150e000700 1 -- 172.21.15.44:0/3161832177 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f1504031020 con 0x7f15101055d0 2024-05-03T22:43:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:24 smithi060 ceph-mon[31721]: pgmap v476: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-03T22:43:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:24 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1468933093' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-03T22:43:24.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:24 smithi160 ceph-mon[32531]: pgmap v476: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 8 op/s 2024-05-03T22:43:24.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:24 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1468933093' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-03T22:43:24.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.830+0000 7f1517000700 1 -- 172.21.15.44:0/3161832177 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f15101acce0 con 0x7f15101055d0 2024-05-03T22:43:24.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.831+0000 7f150e000700 1 -- 172.21.15.44:0/3161832177 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1504013070 con 0x7f15101055d0 2024-05-03T22:43:24.833 INFO:teuthology.orchestra.run.smithi044.stdout:77309411451 2024-05-03T22:43:24.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.834+0000 7f1517000700 1 -- 172.21.15.44:0/3161832177 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f14f80b2990 msgr2=0x7f14f80b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:24.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.834+0000 7f1517000700 1 --2- 172.21.15.44:0/3161832177 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f14f80b2990 0x7f14f80b4e50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f14fc005950 tx=0x7f14fc0058e0 comp rx=0 tx=0).stop 2024-05-03T22:43:24.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.834+0000 7f1517000700 1 -- 172.21.15.44:0/3161832177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15101055d0 msgr2=0x7f1510112150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:24.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.834+0000 7f1517000700 1 --2- 172.21.15.44:0/3161832177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15101055d0 0x7f1510112150 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1504005b40 tx=0x7f1504005590 comp rx=0 tx=0).stop 2024-05-03T22:43:24.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.834+0000 7f1517000700 1 -- 172.21.15.44:0/3161832177 shutdown_connections 2024-05-03T22:43:24.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.834+0000 7f1517000700 1 --2- 172.21.15.44:0/3161832177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f151010b680 0x7f151010f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:24.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.834+0000 7f1517000700 1 --2- 172.21.15.44:0/3161832177 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f15101055d0 0x7f1510112150 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:24.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.834+0000 7f1517000700 1 --2- 172.21.15.44:0/3161832177 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f14f80b2990 0x7f14f80b4e50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:24.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.834+0000 7f1517000700 1 --2- 172.21.15.44:0/3161832177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1510105f90 0x7f151010f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:24.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.834+0000 7f1517000700 1 -- 172.21.15.44:0/3161832177 >> 172.21.15.44:0/3161832177 conn(0x7f15101010e0 msgr2=0x7f1510102530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:24.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.834+0000 7f1517000700 1 -- 172.21.15.44:0/3161832177 shutdown_connections 2024-05-03T22:43:24.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.834+0000 7f1517000700 1 -- 172.21.15.44:0/3161832177 wait complete. 2024-05-03T22:43:25.417 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070532 got 253403070537 for osd.9 2024-05-03T22:43:25.417 DEBUG:teuthology.parallel:result is None 2024-05-03T22:43:25.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.917+0000 7f54c6400700 1 -- 172.21.15.44:0/1099360290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c00756d0 msgr2=0x7f54c0075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:25.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.917+0000 7f54c6400700 1 --2- 172.21.15.44:0/1099360290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c00756d0 0x7f54c0075ab0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f54b0009990 tx=0x7f54b0009ca0 comp rx=0 tx=0).stop 2024-05-03T22:43:25.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.917+0000 7f54c6400700 1 -- 172.21.15.44:0/1099360290 shutdown_connections 2024-05-03T22:43:25.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.917+0000 7f54c6400700 1 --2- 172.21.15.44:0/1099360290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54c0114670 0x7f54c0116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:25.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.918+0000 7f54c6400700 1 --2- 172.21.15.44:0/1099360290 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c00756d0 0x7f54c0075ab0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:25.477 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.918+0000 7f54c6400700 1 --2- 172.21.15.44:0/1099360290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54c0075ff0 0x7f54c0114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:25.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.918+0000 7f54c6400700 1 -- 172.21.15.44:0/1099360290 >> 172.21.15.44:0/1099360290 conn(0x7f54c007a600 msgr2=0x7f54c007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:25.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.918+0000 7f54c6400700 1 -- 172.21.15.44:0/1099360290 shutdown_connections 2024-05-03T22:43:25.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.918+0000 7f54c6400700 1 -- 172.21.15.44:0/1099360290 wait complete. 2024-05-03T22:43:25.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.919+0000 7f54c6400700 1 Processor -- start 2024-05-03T22:43:25.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.919+0000 7f54c6400700 1 -- start start 2024-05-03T22:43:25.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.919+0000 7f54c6400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54c00756d0 0x7f54c01a02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:25.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.919+0000 7f54c6400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c0075ff0 0x7f54c01a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:25.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.919+0000 7f54c6400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54c0114670 0x7f54c01a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:25.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.919+0000 7f54c6400700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f54c0119de0 con 0x7f54c0075ff0 2024-05-03T22:43:25.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.919+0000 7f54c6400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f54c0119c60 con 0x7f54c00756d0 2024-05-03T22:43:25.478 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.919+0000 7f54c6400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f54c0119f60 con 0x7f54c0114670 2024-05-03T22:43:25.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.920+0000 7f54bea00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c0075ff0 0x7f54c01a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:25.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.920+0000 7f54bea00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c0075ff0 0x7f54c01a0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51718/0 (socket says 172.21.15.44:51718) 2024-05-03T22:43:25.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.920+0000 7f54bea00700 1 -- 172.21.15.44:0/667880258 learned_addr learned my addr 172.21.15.44:0/667880258 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:25.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.920+0000 7f54bf400700 1 --2- 172.21.15.44:0/667880258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54c00756d0 0x7f54c01a02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:25.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.920+0000 7f54bfe00700 1 --2- 172.21.15.44:0/667880258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54c0114670 0x7f54c01a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:25.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.920+0000 7f54bea00700 1 -- 172.21.15.44:0/667880258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54c0114670 msgr2=0x7f54c01a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:25.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.920+0000 7f54bea00700 1 --2- 172.21.15.44:0/667880258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54c0114670 0x7f54c01a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:25.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.920+0000 7f54bea00700 1 -- 172.21.15.44:0/667880258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54c00756d0 msgr2=0x7f54c01a02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:25.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.920+0000 7f54bea00700 1 --2- 172.21.15.44:0/667880258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54c00756d0 0x7f54c01a02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:25.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.920+0000 7f54bea00700 1 -- 172.21.15.44:0/667880258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c01a52e0 con 0x7f54c0075ff0 2024-05-03T22:43:25.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.920+0000 7f54bf400700 1 --2- 172.21.15.44:0/667880258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54c00756d0 0x7f54c01a02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:43:25.479 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.921+0000 7f54bea00700 1 --2- 172.21.15.44:0/667880258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c0075ff0 0x7f54c01a0810 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00c920 tx=0x7f54ac00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.921+0000 7f54b7e00700 1 -- 172.21.15.44:0/667880258 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac007b00 con 0x7f54c0075ff0 2024-05-03T22:43:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.921+0000 7f54b7e00700 1 -- 172.21.15.44:0/667880258 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f54ac004d00 con 0x7f54c0075ff0 2024-05-03T22:43:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.921+0000 7f54c6400700 1 -- 172.21.15.44:0/667880258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54c01a55d0 con 0x7f54c0075ff0 2024-05-03T22:43:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.921+0000 7f54c6400700 1 -- 172.21.15.44:0/667880258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54c01ace50 con 0x7f54c0075ff0 2024-05-03T22:43:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.922+0000 7f54b7e00700 1 -- 172.21.15.44:0/667880258 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ac00f450 con 0x7f54c0075ff0 2024-05-03T22:43:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.922+0000 7f54c6400700 1 -- 172.21.15.44:0/667880258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54c006a190 con 0x7f54c0075ff0 2024-05-03T22:43:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.926+0000 7f54b7e00700 1 -- 172.21.15.44:0/667880258 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f54ac004750 con 0x7f54c0075ff0 2024-05-03T22:43:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.927+0000 7f54b7e00700 1 --2- 172.21.15.44:0/667880258 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f54a40b2910 0x7f54a40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.928+0000 7f54b7e00700 1 -- 172.21.15.44:0/667880258 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f54ac0e29a0 con 0x7f54c0075ff0 2024-05-03T22:43:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.928+0000 7f54bf400700 1 --2- 172.21.15.44:0/667880258 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f54a40b2910 0x7f54a40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.929+0000 7f54bf400700 1 --2- 172.21.15.44:0/667880258 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f54a40b2910 0x7f54a40b4dd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f54b0006010 tx=0x7f54b000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:24.929+0000 7f54b7e00700 1 -- 172.21.15.44:0/667880258 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f54ac014030 con 0x7f54c0075ff0 2024-05-03T22:43:25.480 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:25.171+0000 7f54c6400700 1 -- 172.21.15.44:0/667880258 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f54c01ad0e0 con 0x7f54c0075ff0 2024-05-03T22:43:25.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:25.171+0000 7f54b7e00700 1 -- 172.21.15.44:0/667880258 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f54ac0aa0f0 con 0x7f54c0075ff0 2024-05-03T22:43:25.481 INFO:teuthology.orchestra.run.smithi044.stdout:180388626525 2024-05-03T22:43:25.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:25.175+0000 7f54c6400700 1 -- 172.21.15.44:0/667880258 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f54a40b2910 msgr2=0x7f54a40b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:25.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:25.175+0000 7f54c6400700 1 --2- 172.21.15.44:0/667880258 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f54a40b2910 0x7f54a40b4dd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f54b0006010 tx=0x7f54b000b540 comp rx=0 tx=0).stop 2024-05-03T22:43:25.481 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:25.175+0000 7f54c6400700 1 -- 172.21.15.44:0/667880258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c0075ff0 msgr2=0x7f54c01a0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:25.175+0000 7f54c6400700 1 --2- 172.21.15.44:0/667880258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c0075ff0 0x7f54c01a0810 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f54ac00c920 tx=0x7f54ac00cce0 comp rx=0 tx=0).stop 2024-05-03T22:43:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:25.175+0000 7f54c6400700 1 -- 172.21.15.44:0/667880258 shutdown_connections 2024-05-03T22:43:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:25.175+0000 7f54c6400700 1 --2- 172.21.15.44:0/667880258 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f54a40b2910 0x7f54a40b4dd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:25.175+0000 7f54c6400700 1 --2- 172.21.15.44:0/667880258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54c0114670 0x7f54c01a4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:25.175+0000 7f54c6400700 1 --2- 172.21.15.44:0/667880258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54c00756d0 0x7f54c01a02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:25.175+0000 7f54c6400700 1 --2- 172.21.15.44:0/667880258 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54c0075ff0 0x7f54c01a0810 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:25.175+0000 7f54c6400700 1 -- 172.21.15.44:0/667880258 >> 172.21.15.44:0/667880258 conn(0x7f54c007a600 msgr2=0x7f54c0113510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:25.175+0000 7f54c6400700 1 -- 172.21.15.44:0/667880258 shutdown_connections 2024-05-03T22:43:25.482 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:25.175+0000 7f54c6400700 1 -- 172.21.15.44:0/667880258 wait complete. 2024-05-03T22:43:25.482 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:25 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3161832177' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-03T22:43:25.482 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:25 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/667880258' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-03T22:43:25.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:25 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3161832177' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-03T22:43:25.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:25 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/667880258' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-03T22:43:25.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:25 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3161832177' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-03T22:43:25.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:25 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/667880258' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-03T22:43:26.432 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:26 smithi044 ceph-mon[28604]: pgmap v477: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-03T22:43:26.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:26 smithi060 ceph-mon[31721]: pgmap v477: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-03T22:43:26.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:26 smithi160 ceph-mon[32531]: pgmap v477: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 10 op/s 2024-05-03T22:43:27.395 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462994 got 201863462999 for osd.7 2024-05-03T22:43:27.395 DEBUG:teuthology.parallel:result is None 2024-05-03T22:43:28.366 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:43:28.371 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:43:28.590 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:28 smithi044 ceph-mon[28604]: pgmap v478: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:28.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:28 smithi060 ceph-mon[31721]: pgmap v478: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:28.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:28 smithi160 ceph-mon[32531]: pgmap v478: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:29.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.474+0000 7f201d400700 1 -- 172.21.15.44:0/3498404970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2018109510 msgr2=0x7f20181098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:29.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.474+0000 7f201d400700 1 --2- 172.21.15.44:0/3498404970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2018109510 0x7f20181098f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2008009990 tx=0x7f2008009ca0 comp rx=0 tx=0).stop 2024-05-03T22:43:29.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.474+0000 7f201d400700 1 -- 172.21.15.44:0/3498404970 shutdown_connections 2024-05-03T22:43:29.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.474+0000 7f201d400700 1 --2- 172.21.15.44:0/3498404970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f201806bb40 0x7f2018110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:29.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.474+0000 7f201d400700 1 --2- 172.21.15.44:0/3498404970 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f2018109510 0x7f20181098f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:29.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.474+0000 7f201d400700 1 --2- 172.21.15.44:0/3498404970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f201806b180 0x7f201806b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:29.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.474+0000 7f201d400700 1 -- 172.21.15.44:0/3498404970 >> 172.21.15.44:0/3498404970 conn(0x7f2018079350 msgr2=0x7f2018079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:29.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.474+0000 7f201d400700 1 -- 172.21.15.44:0/3498404970 shutdown_connections 2024-05-03T22:43:29.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.474+0000 7f201d400700 1 -- 172.21.15.44:0/3498404970 wait complete. 2024-05-03T22:43:29.510 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.475+0000 7f201d400700 1 Processor -- start 2024-05-03T22:43:29.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.476+0000 7f201d400700 1 -- start start 2024-05-03T22:43:29.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.476+0000 7f201d400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f201806b180 0x7f201819bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:29.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.476+0000 7f201d400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f201806bb40 0x7f201819c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:29.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.476+0000 7f201d400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2018109510 0x7f20181a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:29.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.476+0000 7f201d400700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f20181137b0 con 0x7f201806b180 2024-05-03T22:43:29.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.476+0000 7f201d400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2018113630 con 0x7f2018109510 2024-05-03T22:43:29.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.476+0000 7f201d400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2018113930 con 0x7f201806bb40 2024-05-03T22:43:29.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.476+0000 7f2016800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f201806b180 0x7f201819bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:29.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.476+0000 7f2016800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f201806b180 0x7f201819bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51742/0 (socket says 172.21.15.44:51742) 2024-05-03T22:43:29.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.476+0000 7f2016800700 1 -- 172.21.15.44:0/2130139756 learned_addr learned my addr 172.21.15.44:0/2130139756 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:29.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.477+0000 7f2016800700 1 -- 172.21.15.44:0/2130139756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f201806bb40 msgr2=0x7f201819c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:29.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.477+0000 7f2016800700 1 --2- 172.21.15.44:0/2130139756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f201806bb40 0x7f201819c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:29.511 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.477+0000 7f2016800700 1 -- 172.21.15.44:0/2130139756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2018109510 msgr2=0x7f20181a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:29.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.477+0000 7f2017200700 1 --2- 172.21.15.44:0/2130139756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2018109510 0x7f20181a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:29.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.477+0000 7f2016800700 1 --2- 172.21.15.44:0/2130139756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2018109510 0x7f20181a0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:29.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.477+0000 7f2016800700 1 -- 172.21.15.44:0/2130139756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20181a0ec0 con 0x7f201806b180 2024-05-03T22:43:29.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.477+0000 7f2016800700 1 --2- 172.21.15.44:0/2130139756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f201806b180 0x7f201819bf00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2008005910 tx=0x7f2008009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:29.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.477+0000 7f200f400700 1 -- 172.21.15.44:0/2130139756 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2008027070 con 0x7f201806b180 2024-05-03T22:43:29.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.478+0000 7f200f400700 1 -- 172.21.15.44:0/2130139756 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f2008003f70 con 0x7f201806b180 2024-05-03T22:43:29.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.478+0000 7f201d400700 1 -- 172.21.15.44:0/2130139756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20181a1150 con 0x7f201806b180 2024-05-03T22:43:29.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.478+0000 7f200f400700 1 -- 172.21.15.44:0/2130139756 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2008022e00 con 0x7f201806b180 2024-05-03T22:43:29.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.478+0000 7f201d400700 1 -- 172.21.15.44:0/2130139756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20181a8a30 con 0x7f201806b180 2024-05-03T22:43:29.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.479+0000 7f201d400700 1 -- 172.21.15.44:0/2130139756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f201806a190 con 0x7f201806b180 2024-05-03T22:43:29.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.481+0000 7f200f400700 1 -- 172.21.15.44:0/2130139756 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f200802a070 con 0x7f201806b180 2024-05-03T22:43:29.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.483+0000 7f200f400700 1 --2- 172.21.15.44:0/2130139756 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1ffc0b2990 0x7f1ffc0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:29.512 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.483+0000 7f200f400700 1 -- 172.21.15.44:0/2130139756 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f20080e3d80 con 0x7f201806b180 2024-05-03T22:43:29.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.483+0000 7f200fe00700 1 --2- 172.21.15.44:0/2130139756 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1ffc0b2990 0x7f1ffc0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:29.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.484+0000 7f200fe00700 1 --2- 172.21.15.44:0/2130139756 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1ffc0b2990 0x7f1ffc0b4e50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2000005950 tx=0x7f20000058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:29.513 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.486+0000 7f200f400700 1 -- 172.21.15.44:0/2130139756 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f2008031070 con 0x7f201806b180 2024-05-03T22:43:29.731 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.730+0000 7f201d400700 1 -- 172.21.15.44:0/2130139756 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f20181a8c00 con 0x7f201806b180 2024-05-03T22:43:29.732 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.731+0000 7f200f400700 1 -- 172.21.15.44:0/2130139756 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2008013070 con 0x7f201806b180 2024-05-03T22:43:29.732 INFO:teuthology.orchestra.run.smithi044.stdout:133143986285 2024-05-03T22:43:29.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.734+0000 7f201d400700 1 -- 172.21.15.44:0/2130139756 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1ffc0b2990 msgr2=0x7f1ffc0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:29.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.734+0000 7f201d400700 1 --2- 172.21.15.44:0/2130139756 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1ffc0b2990 0x7f1ffc0b4e50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2000005950 tx=0x7f20000058e0 comp rx=0 tx=0).stop 2024-05-03T22:43:29.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.734+0000 7f201d400700 1 -- 172.21.15.44:0/2130139756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f201806b180 msgr2=0x7f201819bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:29.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.734+0000 7f201d400700 1 --2- 172.21.15.44:0/2130139756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f201806b180 0x7f201819bf00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2008005910 tx=0x7f2008009f90 comp rx=0 tx=0).stop 2024-05-03T22:43:29.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.734+0000 7f201d400700 1 -- 172.21.15.44:0/2130139756 shutdown_connections 2024-05-03T22:43:29.736 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.734+0000 7f201d400700 1 --2- 172.21.15.44:0/2130139756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2018109510 0x7f20181a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:29.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.734+0000 7f201d400700 1 --2- 172.21.15.44:0/2130139756 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f201806b180 0x7f201819bf00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:29.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.734+0000 7f201d400700 1 --2- 172.21.15.44:0/2130139756 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1ffc0b2990 0x7f1ffc0b4e50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:29.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.734+0000 7f201d400700 1 --2- 172.21.15.44:0/2130139756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f201806bb40 0x7f201819c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:29.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.734+0000 7f201d400700 1 -- 172.21.15.44:0/2130139756 >> 172.21.15.44:0/2130139756 conn(0x7f2018079350 msgr2=0x7f2018100d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:29.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.735+0000 7f201d400700 1 -- 172.21.15.44:0/2130139756 shutdown_connections 2024-05-03T22:43:29.737 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:29.735+0000 7f201d400700 1 -- 172.21.15.44:0/2130139756 wait complete. 2024-05-03T22:43:30.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:30 smithi044 ceph-mon[28604]: pgmap v479: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:43:30.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:30 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2130139756' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-03T22:43:30.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:30 smithi060 ceph-mon[31721]: pgmap v479: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:43:30.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:30 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2130139756' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-03T22:43:30.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:30 smithi160 ceph-mon[32531]: pgmap v479: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:43:30.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:30 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2130139756' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-03T22:43:31.429 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626520 got 180388626525 for osd.6 2024-05-03T22:43:31.430 DEBUG:teuthology.parallel:result is None 2024-05-03T22:43:31.930 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411444 got 77309411451 for osd.2 2024-05-03T22:43:31.931 DEBUG:teuthology.parallel:result is None 2024-05-03T22:43:32.043 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738497 got 34359738502 for osd.0 2024-05-03T22:43:32.043 DEBUG:teuthology.parallel:result is None 2024-05-03T22:43:32.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.442+0000 7f6ae9e00700 1 -- 172.21.15.44:0/2863901001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4103750 msgr2=0x7f6ae4103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:32.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.442+0000 7f6ae9e00700 1 --2- 172.21.15.44:0/2863901001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4103750 0x7f6ae4103b30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40099c0 tx=0x7f6ad4009cd0 comp rx=0 tx=0).stop 2024-05-03T22:43:32.444 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.442+0000 7f6ae9e00700 1 -- 172.21.15.44:0/2863901001 shutdown_connections 2024-05-03T22:43:32.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.442+0000 7f6ae9e00700 1 --2- 172.21.15.44:0/2863901001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ae4108850 0x7f6ae41103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:32.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.442+0000 7f6ae9e00700 1 --2- 172.21.15.44:0/2863901001 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4103750 0x7f6ae4103b30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:32.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.442+0000 7f6ae9e00700 1 --2- 172.21.15.44:0/2863901001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ae4104100 0x7f6ae4108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:32.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.442+0000 7f6ae9e00700 1 -- 172.21.15.44:0/2863901001 >> 172.21.15.44:0/2863901001 conn(0x7f6ae407a600 msgr2=0x7f6ae407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:32.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.442+0000 7f6ae9e00700 1 -- 172.21.15.44:0/2863901001 shutdown_connections 2024-05-03T22:43:32.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.442+0000 7f6ae9e00700 1 -- 172.21.15.44:0/2863901001 wait complete. 2024-05-03T22:43:32.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.444+0000 7f6ae9e00700 1 Processor -- start 2024-05-03T22:43:32.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.444+0000 7f6ae9e00700 1 -- start start 2024-05-03T22:43:32.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.444+0000 7f6ae9e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ae4103750 0x7f6ae419bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:32.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.444+0000 7f6ae9e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4104100 0x7f6ae419c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:32.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.444+0000 7f6ae9e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ae4108850 0x7f6ae41a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:32.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.444+0000 7f6ae9e00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae4076f50 con 0x7f6ae4104100 2024-05-03T22:43:32.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.444+0000 7f6ae9e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae4076dd0 con 0x7f6ae4108850 2024-05-03T22:43:32.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.444+0000 7f6ae9e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae40770d0 con 0x7f6ae4103750 2024-05-03T22:43:32.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.445+0000 7f6adbe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4104100 0x7f6ae419c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:32.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.445+0000 7f6adbe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4104100 0x7f6ae419c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56964/0 (socket says 172.21.15.44:56964) 2024-05-03T22:43:32.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.445+0000 7f6adbe00700 1 -- 172.21.15.44:0/3281396492 learned_addr learned my addr 172.21.15.44:0/3281396492 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:32.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.445+0000 7f6ae3400700 1 --2- 172.21.15.44:0/3281396492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ae4108850 0x7f6ae41a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:32.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.445+0000 7f6ae2a00700 1 --2- 172.21.15.44:0/3281396492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ae4103750 0x7f6ae419bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:32.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.445+0000 7f6adbe00700 1 -- 172.21.15.44:0/3281396492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ae4103750 msgr2=0x7f6ae419bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:32.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.445+0000 7f6adbe00700 1 --2- 172.21.15.44:0/3281396492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ae4103750 0x7f6ae419bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:32.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.445+0000 7f6adbe00700 1 -- 172.21.15.44:0/3281396492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ae4108850 msgr2=0x7f6ae41a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:32.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.445+0000 7f6adbe00700 1 --2- 172.21.15.44:0/3281396492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ae4108850 0x7f6ae41a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:32.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.445+0000 7f6adbe00700 1 -- 172.21.15.44:0/3281396492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae41a0d20 con 0x7f6ae4104100 2024-05-03T22:43:32.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.445+0000 7f6ae3400700 1 --2- 172.21.15.44:0/3281396492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ae4108850 0x7f6ae41a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:43:32.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.446+0000 7f6adbe00700 1 --2- 172.21.15.44:0/3281396492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4104100 0x7f6ae419c250 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00c9b0 tx=0x7f6acc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:32.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.446+0000 7f6ae8a00700 1 -- 172.21.15.44:0/3281396492 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc007b00 con 0x7f6ae4104100 2024-05-03T22:43:32.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.446+0000 7f6ae8a00700 1 -- 172.21.15.44:0/3281396492 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f6acc007ca0 con 0x7f6ae4104100 2024-05-03T22:43:32.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.446+0000 7f6ae9e00700 1 -- 172.21.15.44:0/3281396492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae41a1010 con 0x7f6ae4104100 2024-05-03T22:43:32.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.446+0000 7f6ae8a00700 1 -- 172.21.15.44:0/3281396492 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0187c0 con 0x7f6ae4104100 2024-05-03T22:43:32.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.446+0000 7f6ae9e00700 1 -- 172.21.15.44:0/3281396492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae41a8890 con 0x7f6ae4104100 2024-05-03T22:43:32.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.447+0000 7f6ae9e00700 1 -- 172.21.15.44:0/3281396492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae406a190 con 0x7f6ae4104100 2024-05-03T22:43:32.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.450+0000 7f6ae8a00700 1 -- 172.21.15.44:0/3281396492 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f6acc00f450 con 0x7f6ae4104100 2024-05-03T22:43:32.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.452+0000 7f6ae8a00700 1 --2- 172.21.15.44:0/3281396492 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6ac80b2910 0x7f6ac80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:32.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.452+0000 7f6ae8a00700 1 -- 172.21.15.44:0/3281396492 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f6acc0e2930 con 0x7f6ae4104100 2024-05-03T22:43:32.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.452+0000 7f6ae2a00700 1 --2- 172.21.15.44:0/3281396492 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6ac80b2910 0x7f6ac80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:32.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.453+0000 7f6ae2a00700 1 --2- 172.21.15.44:0/3281396492 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6ac80b2910 0x7f6ac80b4dd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009750 tx=0x7f6ad4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:32.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.457+0000 7f6ae8a00700 1 -- 172.21.15.44:0/3281396492 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f6acc014030 con 0x7f6ae4104100 2024-05-03T22:43:32.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.706+0000 7f6ae9e00700 1 -- 172.21.15.44:0/3281396492 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f6ae419d070 con 0x7f6ae4104100 2024-05-03T22:43:32.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.707+0000 7f6ae8a00700 1 -- 172.21.15.44:0/3281396492 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6ae419d070 con 0x7f6ae4104100 2024-05-03T22:43:32.448 INFO:teuthology.orchestra.run.smithi044.stdout:227633266770 2024-05-03T22:43:32.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.709+0000 7f6ae9e00700 1 -- 172.21.15.44:0/3281396492 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6ac80b2910 msgr2=0x7f6ac80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:32.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.709+0000 7f6ae9e00700 1 --2- 172.21.15.44:0/3281396492 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6ac80b2910 0x7f6ac80b4dd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009750 tx=0x7f6ad4000bc0 comp rx=0 tx=0).stop 2024-05-03T22:43:32.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.709+0000 7f6ae9e00700 1 -- 172.21.15.44:0/3281396492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4104100 msgr2=0x7f6ae419c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:32.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.709+0000 7f6ae9e00700 1 --2- 172.21.15.44:0/3281396492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4104100 0x7f6ae419c250 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00c9b0 tx=0x7f6acc00cd70 comp rx=0 tx=0).stop 2024-05-03T22:43:32.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.710+0000 7f6ae9e00700 1 -- 172.21.15.44:0/3281396492 shutdown_connections 2024-05-03T22:43:32.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.710+0000 7f6ae9e00700 1 --2- 172.21.15.44:0/3281396492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ae4108850 0x7f6ae41a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:32.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.710+0000 7f6ae9e00700 1 --2- 172.21.15.44:0/3281396492 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6ac80b2910 0x7f6ac80b4dd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:32.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.710+0000 7f6ae9e00700 1 --2- 172.21.15.44:0/3281396492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ae4103750 0x7f6ae419bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:32.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.710+0000 7f6ae9e00700 1 --2- 172.21.15.44:0/3281396492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6ae4104100 0x7f6ae419c250 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:32.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.710+0000 7f6ae9e00700 1 -- 172.21.15.44:0/3281396492 >> 172.21.15.44:0/3281396492 conn(0x7f6ae407a600 msgr2=0x7f6ae4101360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:32.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.710+0000 7f6ae9e00700 1 -- 172.21.15.44:0/3281396492 shutdown_connections 2024-05-03T22:43:32.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:31.710+0000 7f6ae9e00700 1 -- 172.21.15.44:0/3281396492 wait complete. 2024-05-03T22:43:32.714 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:32 smithi044 ceph-mon[28604]: pgmap v480: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:43:32.714 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:32 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3281396492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-03T22:43:32.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:32 smithi060 ceph-mon[31721]: pgmap v480: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:43:32.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:32 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3281396492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-03T22:43:32.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:32 smithi160 ceph-mon[32531]: pgmap v480: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:43:32.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:32 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3281396492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-03T22:43:33.619 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:43:33.620 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:43:33.641 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266764 got 227633266770 for osd.8 2024-05-03T22:43:33.641 DEBUG:teuthology.parallel:result is None 2024-05-03T22:43:33.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.896+0000 7f8fdda00700 1 -- 172.21.15.44:0/3409152886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd8076160 msgr2=0x7f8fd8113ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:33.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.896+0000 7f8fdda00700 1 --2- 172.21.15.44:0/3409152886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd8076160 0x7f8fd8113ea0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4009990 tx=0x7f8fc4009ca0 comp rx=0 tx=0).stop 2024-05-03T22:43:33.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.897+0000 7f8fdda00700 1 -- 172.21.15.44:0/3409152886 shutdown_connections 2024-05-03T22:43:33.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.897+0000 7f8fdda00700 1 --2- 172.21.15.44:0/3409152886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fd81143e0 0x7f8fd81167d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:33.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.897+0000 7f8fdda00700 1 --2- 172.21.15.44:0/3409152886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fd8075840 0x7f8fd8075c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:33.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.897+0000 7f8fdda00700 1 --2- 172.21.15.44:0/3409152886 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd8076160 0x7f8fd8113ea0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:33.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.897+0000 7f8fdda00700 1 -- 172.21.15.44:0/3409152886 >> 172.21.15.44:0/3409152886 conn(0x7f8fd80fef20 msgr2=0x7f8fd8101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:33.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.897+0000 7f8fdda00700 1 -- 172.21.15.44:0/3409152886 shutdown_connections 2024-05-03T22:43:33.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.897+0000 7f8fdda00700 1 -- 172.21.15.44:0/3409152886 wait complete. 2024-05-03T22:43:33.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.898+0000 7f8fdda00700 1 Processor -- start 2024-05-03T22:43:33.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.899+0000 7f8fdda00700 1 -- start start 2024-05-03T22:43:33.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.899+0000 7f8fdda00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fd8075840 0x7f8fd81a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:33.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.899+0000 7f8fdda00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd8076160 0x7f8fd81a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:33.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.899+0000 7f8fdda00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fd81143e0 0x7f8fd81a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:33.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.899+0000 7f8fdda00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd8119d40 con 0x7f8fd8076160 2024-05-03T22:43:33.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.899+0000 7f8fdda00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd8119bc0 con 0x7f8fd8075840 2024-05-03T22:43:33.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.899+0000 7f8fdda00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8fd8119ec0 con 0x7f8fd81143e0 2024-05-03T22:43:33.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.899+0000 7f8fd7400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd8076160 0x7f8fd81a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:33.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.899+0000 7f8fd7400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd8076160 0x7f8fd81a0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56982/0 (socket says 172.21.15.44:56982) 2024-05-03T22:43:33.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.899+0000 7f8fd7400700 1 -- 172.21.15.44:0/3802964875 learned_addr learned my addr 172.21.15.44:0/3802964875 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:33.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.900+0000 7f8fd7e00700 1 --2- 172.21.15.44:0/3802964875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fd8075840 0x7f8fd81a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:33.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.900+0000 7f8fdd000700 1 --2- 172.21.15.44:0/3802964875 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fd81143e0 0x7f8fd81a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:33.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.900+0000 7f8fd7400700 1 -- 172.21.15.44:0/3802964875 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fd81143e0 msgr2=0x7f8fd81a4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:33.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.900+0000 7f8fd7400700 1 --2- 172.21.15.44:0/3802964875 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fd81143e0 0x7f8fd81a4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:33.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.900+0000 7f8fd7400700 1 -- 172.21.15.44:0/3802964875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fd8075840 msgr2=0x7f8fd81a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:33.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.900+0000 7f8fd7400700 1 --2- 172.21.15.44:0/3802964875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fd8075840 0x7f8fd81a0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:33.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.900+0000 7f8fd7400700 1 -- 172.21.15.44:0/3802964875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fd81a51f0 con 0x7f8fd8076160 2024-05-03T22:43:33.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.900+0000 7f8fd7e00700 1 --2- 172.21.15.44:0/3802964875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fd8075840 0x7f8fd81a0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:43:33.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.900+0000 7f8fd7400700 1 --2- 172.21.15.44:0/3802964875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd8076160 0x7f8fd81a0770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4000c00 tx=0x7f8fc40057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:33.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.901+0000 7f8fd4c00700 1 -- 172.21.15.44:0/3802964875 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc4027070 con 0x7f8fd8076160 2024-05-03T22:43:33.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.901+0000 7f8fd4c00700 1 -- 172.21.15.44:0/3802964875 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f8fc4003ff0 con 0x7f8fd8076160 2024-05-03T22:43:33.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.901+0000 7f8fdda00700 1 -- 172.21.15.44:0/3802964875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fd81a5480 con 0x7f8fd8076160 2024-05-03T22:43:33.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.901+0000 7f8fd4c00700 1 -- 172.21.15.44:0/3802964875 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc400f460 con 0x7f8fd8076160 2024-05-03T22:43:33.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.901+0000 7f8fdda00700 1 -- 172.21.15.44:0/3802964875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fd81acd60 con 0x7f8fd8076160 2024-05-03T22:43:33.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.902+0000 7f8fdda00700 1 -- 172.21.15.44:0/3802964875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fd806a190 con 0x7f8fd8076160 2024-05-03T22:43:33.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.904+0000 7f8fd4c00700 1 -- 172.21.15.44:0/3802964875 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f8fc402a070 con 0x7f8fd8076160 2024-05-03T22:43:33.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.906+0000 7f8fd4c00700 1 --2- 172.21.15.44:0/3802964875 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8fbc0b2910 0x7f8fbc0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:33.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.906+0000 7f8fd4c00700 1 -- 172.21.15.44:0/3802964875 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f8fc40e3790 con 0x7f8fd8076160 2024-05-03T22:43:33.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.906+0000 7f8fd7e00700 1 --2- 172.21.15.44:0/3802964875 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8fbc0b2910 0x7f8fbc0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:33.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.907+0000 7f8fd7e00700 1 --2- 172.21.15.44:0/3802964875 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8fbc0b2910 0x7f8fbc0b4dd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8007fd0 tx=0x7f8fc8007830 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:33.933 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:33.911+0000 7f8fd4c00700 1 -- 172.21.15.44:0/3802964875 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f8fc4013070 con 0x7f8fd8076160 2024-05-03T22:43:34.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:34.157+0000 7f8fdda00700 1 -- 172.21.15.44:0/3802964875 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f8fd802e510 con 0x7f8fd8076160 2024-05-03T22:43:34.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:34.158+0000 7f8fd4c00700 1 -- 172.21.15.44:0/3802964875 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f8fc40aaf70 con 0x7f8fd8076160 2024-05-03T22:43:34.159 INFO:teuthology.orchestra.run.smithi044.stdout:300647710781 2024-05-03T22:43:34.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:34.161+0000 7f8fdda00700 1 -- 172.21.15.44:0/3802964875 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8fbc0b2910 msgr2=0x7f8fbc0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:34.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:34.161+0000 7f8fdda00700 1 --2- 172.21.15.44:0/3802964875 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8fbc0b2910 0x7f8fbc0b4dd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8007fd0 tx=0x7f8fc8007830 comp rx=0 tx=0).stop 2024-05-03T22:43:34.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:34.161+0000 7f8fdda00700 1 -- 172.21.15.44:0/3802964875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd8076160 msgr2=0x7f8fd81a0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:34.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:34.161+0000 7f8fdda00700 1 --2- 172.21.15.44:0/3802964875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd8076160 0x7f8fd81a0770 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4000c00 tx=0x7f8fc40057c0 comp rx=0 tx=0).stop 2024-05-03T22:43:34.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:34.161+0000 7f8fdda00700 1 -- 172.21.15.44:0/3802964875 shutdown_connections 2024-05-03T22:43:34.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:34.161+0000 7f8fdda00700 1 --2- 172.21.15.44:0/3802964875 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f8fbc0b2910 0x7f8fbc0b4dd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:34.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:34.161+0000 7f8fdda00700 1 --2- 172.21.15.44:0/3802964875 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8fd81143e0 0x7f8fd81a4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:34.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:34.161+0000 7f8fdda00700 1 --2- 172.21.15.44:0/3802964875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8fd8075840 0x7f8fd81a0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:34.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:34.161+0000 7f8fdda00700 1 --2- 172.21.15.44:0/3802964875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8fd8076160 0x7f8fd81a0770 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:34.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:34.161+0000 7f8fdda00700 1 -- 172.21.15.44:0/3802964875 >> 172.21.15.44:0/3802964875 conn(0x7f8fd80fef20 msgr2=0x7f8fd8100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:34.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:34.161+0000 7f8fdda00700 1 -- 172.21.15.44:0/3802964875 shutdown_connections 2024-05-03T22:43:34.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:34.161+0000 7f8fdda00700 1 -- 172.21.15.44:0/3802964875 wait complete. 2024-05-03T22:43:34.482 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:34 smithi044 ceph-mon[28604]: pgmap v481: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:34.482 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:34 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3802964875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-03T22:43:34.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:34 smithi060 ceph-mon[31721]: pgmap v481: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:34.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:34 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3802964875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-03T22:43:34.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:34 smithi160 ceph-mon[32531]: pgmap v481: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:34.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:34 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3802964875' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-03T22:43:35.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.898+0000 7fd043200700 1 -- 172.21.15.44:0/1522937376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd03c075ff0 msgr2=0x7fd03c10f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:35.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.898+0000 7fd043200700 1 --2- 172.21.15.44:0/1522937376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd03c075ff0 0x7fd03c10f960 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd028009990 tx=0x7fd028009ca0 comp rx=0 tx=0).stop 2024-05-03T22:43:35.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.898+0000 7fd043200700 1 -- 172.21.15.44:0/1522937376 shutdown_connections 2024-05-03T22:43:35.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.898+0000 7fd043200700 1 --2- 172.21.15.44:0/1522937376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd03c10fea0 0x7fd03c112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:35.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.898+0000 7fd043200700 1 --2- 172.21.15.44:0/1522937376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd03c0756d0 0x7fd03c075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:35.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.898+0000 7fd043200700 1 --2- 172.21.15.44:0/1522937376 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd03c075ff0 0x7fd03c10f960 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:35.989 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.898+0000 7fd043200700 1 -- 172.21.15.44:0/1522937376 >> 172.21.15.44:0/1522937376 conn(0x7fd03c07a600 msgr2=0x7fd03c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:35.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.899+0000 7fd043200700 1 -- 172.21.15.44:0/1522937376 shutdown_connections 2024-05-03T22:43:35.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.899+0000 7fd043200700 1 -- 172.21.15.44:0/1522937376 wait complete. 2024-05-03T22:43:35.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.900+0000 7fd043200700 1 Processor -- start 2024-05-03T22:43:35.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.900+0000 7fd043200700 1 -- start start 2024-05-03T22:43:35.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.900+0000 7fd043200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd03c0756d0 0x7fd03c10f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:35.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.900+0000 7fd043200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd03c075ff0 0x7fd03c1095a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:35.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.900+0000 7fd043200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd03c10fea0 0x7fd03c109ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:35.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.900+0000 7fd043200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c06d8a0 con 0x7fd03c075ff0 2024-05-03T22:43:35.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.900+0000 7fd043200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c06d720 con 0x7fd03c0756d0 2024-05-03T22:43:35.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.900+0000 7fd043200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c06da20 con 0x7fd03c10fea0 2024-05-03T22:43:35.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.901+0000 7fd03b400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd03c075ff0 0x7fd03c1095a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:35.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.901+0000 7fd03b400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd03c075ff0 0x7fd03c1095a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57010/0 (socket says 172.21.15.44:57010) 2024-05-03T22:43:35.990 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.901+0000 7fd03b400700 1 -- 172.21.15.44:0/3516040491 learned_addr learned my addr 172.21.15.44:0/3516040491 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:35.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.901+0000 7fd03be00700 1 --2- 172.21.15.44:0/3516040491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd03c0756d0 0x7fd03c10f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:35.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.901+0000 7fd041200700 1 --2- 172.21.15.44:0/3516040491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd03c10fea0 0x7fd03c109ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:35.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.901+0000 7fd03b400700 1 -- 172.21.15.44:0/3516040491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd03c10fea0 msgr2=0x7fd03c109ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:35.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.901+0000 7fd03b400700 1 --2- 172.21.15.44:0/3516040491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd03c10fea0 0x7fd03c109ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:35.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.901+0000 7fd03b400700 1 -- 172.21.15.44:0/3516040491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd03c0756d0 msgr2=0x7fd03c10f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:35.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.901+0000 7fd03b400700 1 --2- 172.21.15.44:0/3516040491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd03c0756d0 0x7fd03c10f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:35.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.901+0000 7fd03b400700 1 -- 172.21.15.44:0/3516040491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03c10a150 con 0x7fd03c075ff0 2024-05-03T22:43:35.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.901+0000 7fd041200700 1 --2- 172.21.15.44:0/3516040491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd03c10fea0 0x7fd03c109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:43:35.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.902+0000 7fd03b400700 1 --2- 172.21.15.44:0/3516040491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd03c075ff0 0x7fd03c1095a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd028000c00 tx=0x7fd028003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:35.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.902+0000 7fd038c00700 1 -- 172.21.15.44:0/3516040491 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028027070 con 0x7fd03c075ff0 2024-05-03T22:43:35.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.902+0000 7fd038c00700 1 -- 172.21.15.44:0/3516040491 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fd028004130 con 0x7fd03c075ff0 2024-05-03T22:43:35.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.902+0000 7fd038c00700 1 -- 172.21.15.44:0/3516040491 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028022dc0 con 0x7fd03c075ff0 2024-05-03T22:43:35.991 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.902+0000 7fd043200700 1 -- 172.21.15.44:0/3516040491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd03c10a3e0 con 0x7fd03c075ff0 2024-05-03T22:43:35.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.902+0000 7fd043200700 1 -- 172.21.15.44:0/3516040491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd03c1b1000 con 0x7fd03c075ff0 2024-05-03T22:43:35.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.904+0000 7fd043200700 1 -- 172.21.15.44:0/3516040491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd03c076dc0 con 0x7fd03c075ff0 2024-05-03T22:43:35.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.906+0000 7fd038c00700 1 -- 172.21.15.44:0/3516040491 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd02802a070 con 0x7fd03c075ff0 2024-05-03T22:43:35.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.908+0000 7fd038c00700 1 --2- 172.21.15.44:0/3516040491 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd0200b2990 0x7fd0200b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:35.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.908+0000 7fd038c00700 1 -- 172.21.15.44:0/3516040491 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fd0280e3610 con 0x7fd03c075ff0 2024-05-03T22:43:35.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.908+0000 7fd03be00700 1 --2- 172.21.15.44:0/3516040491 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd0200b2990 0x7fd0200b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:35.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.909+0000 7fd03be00700 1 --2- 172.21.15.44:0/3516040491 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd0200b2990 0x7fd0200b4e50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd02c005fd0 tx=0x7fd02c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:35.992 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:35.913+0000 7fd038c00700 1 -- 172.21.15.44:0/3516040491 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fd028013070 con 0x7fd03c075ff0 2024-05-03T22:43:36.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:36.150+0000 7fd043200700 1 -- 172.21.15.44:0/3516040491 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fd03c1b1360 con 0x7fd03c075ff0 2024-05-03T22:43:36.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:36.151+0000 7fd038c00700 1 -- 172.21.15.44:0/3516040491 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fd0280aadf0 con 0x7fd03c075ff0 2024-05-03T22:43:36.153 INFO:teuthology.orchestra.run.smithi044.stdout:274877907013 2024-05-03T22:43:36.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:36.155+0000 7fd043200700 1 -- 172.21.15.44:0/3516040491 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd0200b2990 msgr2=0x7fd0200b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:36.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:36.155+0000 7fd043200700 1 --2- 172.21.15.44:0/3516040491 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd0200b2990 0x7fd0200b4e50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd02c005fd0 tx=0x7fd02c00a560 comp rx=0 tx=0).stop 2024-05-03T22:43:36.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:36.155+0000 7fd043200700 1 -- 172.21.15.44:0/3516040491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd03c075ff0 msgr2=0x7fd03c1095a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:36.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:36.155+0000 7fd043200700 1 --2- 172.21.15.44:0/3516040491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd03c075ff0 0x7fd03c1095a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd028000c00 tx=0x7fd028003680 comp rx=0 tx=0).stop 2024-05-03T22:43:36.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:36.155+0000 7fd043200700 1 -- 172.21.15.44:0/3516040491 shutdown_connections 2024-05-03T22:43:36.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:36.155+0000 7fd043200700 1 --2- 172.21.15.44:0/3516040491 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd0200b2990 0x7fd0200b4e50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:36.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:36.155+0000 7fd043200700 1 --2- 172.21.15.44:0/3516040491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd03c10fea0 0x7fd03c109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:36.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:36.155+0000 7fd043200700 1 --2- 172.21.15.44:0/3516040491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd03c0756d0 0x7fd03c10f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:36.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:36.155+0000 7fd043200700 1 --2- 172.21.15.44:0/3516040491 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd03c075ff0 0x7fd03c1095a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:36.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:36.155+0000 7fd043200700 1 -- 172.21.15.44:0/3516040491 >> 172.21.15.44:0/3516040491 conn(0x7fd03c07a600 msgr2=0x7fd03c1005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:36.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:36.155+0000 7fd043200700 1 -- 172.21.15.44:0/3516040491 shutdown_connections 2024-05-03T22:43:36.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:36.156+0000 7fd043200700 1 -- 172.21.15.44:0/3516040491 wait complete. 2024-05-03T22:43:36.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:36 smithi044 ceph-mon[28604]: pgmap v482: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:43:36.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:36 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3516040491' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-03T22:43:36.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:36 smithi060 ceph-mon[31721]: pgmap v482: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:43:36.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:36 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3516040491' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-03T22:43:36.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:36 smithi160 ceph-mon[32531]: pgmap v482: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:43:36.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:36 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3516040491' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-03T22:43:36.960 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986281 got 133143986285 for osd.4 2024-05-03T22:43:36.961 DEBUG:teuthology.parallel:result is None 2024-05-03T22:43:37.816 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877907008 got 274877907013 for osd.10 2024-05-03T22:43:37.816 DEBUG:teuthology.parallel:result is None 2024-05-03T22:43:38.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:38 smithi044 ceph-mon[28604]: pgmap v483: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:38.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:38 smithi060 ceph-mon[31721]: pgmap v483: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:38.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:38 smithi160 ceph-mon[32531]: pgmap v483: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:38.802 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710775 got 300647710781 for osd.11 2024-05-03T22:43:38.802 DEBUG:teuthology.parallel:result is None 2024-05-03T22:43:39.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.907+0000 7fa347800700 1 -- 172.21.15.44:0/1226709224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa340108850 msgr2=0x7fa3401103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:39.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.907+0000 7fa347800700 1 --2- 172.21.15.44:0/1226709224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa340108850 0x7fa3401103d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa33800b0d0 tx=0x7fa33800b3e0 comp rx=0 tx=0).stop 2024-05-03T22:43:39.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.907+0000 7fa347800700 1 -- 172.21.15.44:0/1226709224 shutdown_connections 2024-05-03T22:43:39.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.907+0000 7fa347800700 1 --2- 172.21.15.44:0/1226709224 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa340108850 0x7fa3401103d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:39.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.907+0000 7fa347800700 1 --2- 172.21.15.44:0/1226709224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa340103750 0x7fa340103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:39.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.907+0000 7fa347800700 1 --2- 172.21.15.44:0/1226709224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa340104100 0x7fa340108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:39.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.907+0000 7fa347800700 1 -- 172.21.15.44:0/1226709224 >> 172.21.15.44:0/1226709224 conn(0x7fa34007a600 msgr2=0x7fa34007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:39.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.907+0000 7fa347800700 1 -- 172.21.15.44:0/1226709224 shutdown_connections 2024-05-03T22:43:39.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.907+0000 7fa347800700 1 -- 172.21.15.44:0/1226709224 wait complete. 2024-05-03T22:43:39.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.908+0000 7fa347800700 1 Processor -- start 2024-05-03T22:43:39.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.908+0000 7fa347800700 1 -- start start 2024-05-03T22:43:39.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.908+0000 7fa347800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa340103750 0x7fa3401a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:39.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.909+0000 7fa347800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa340104100 0x7fa3401a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:39.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.909+0000 7fa347800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa340108850 0x7fa34019baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:39.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.909+0000 7fa347800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa340113760 con 0x7fa340104100 2024-05-03T22:43:39.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.909+0000 7fa347800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa3401135e0 con 0x7fa340108850 2024-05-03T22:43:39.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.909+0000 7fa347800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa3401138e0 con 0x7fa340103750 2024-05-03T22:43:39.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.909+0000 7fa33fe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa340104100 0x7fa3401a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:39.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.909+0000 7fa33fe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa340104100 0x7fa3401a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36606/0 (socket says 172.21.15.44:36606) 2024-05-03T22:43:39.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.909+0000 7fa33fe00700 1 -- 172.21.15.44:0/2519692442 learned_addr learned my addr 172.21.15.44:0/2519692442 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:39.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.909+0000 7fa345800700 1 --2- 172.21.15.44:0/2519692442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa340108850 0x7fa34019baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:39.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.909+0000 7fa344e00700 1 --2- 172.21.15.44:0/2519692442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa340103750 0x7fa3401a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:39.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.909+0000 7fa33fe00700 1 -- 172.21.15.44:0/2519692442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa340103750 msgr2=0x7fa3401a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:39.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.909+0000 7fa33fe00700 1 --2- 172.21.15.44:0/2519692442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa340103750 0x7fa3401a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:39.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.909+0000 7fa33fe00700 1 -- 172.21.15.44:0/2519692442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa340108850 msgr2=0x7fa34019baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:39.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.909+0000 7fa33fe00700 1 --2- 172.21.15.44:0/2519692442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa340108850 0x7fa34019baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:39.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.909+0000 7fa33fe00700 1 -- 172.21.15.44:0/2519692442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa34019c200 con 0x7fa340104100 2024-05-03T22:43:39.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.910+0000 7fa33fe00700 1 --2- 172.21.15.44:0/2519692442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa340104100 0x7fa3401a1e20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00c9b0 tx=0x7fa32c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:39.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.910+0000 7fa33d600700 1 -- 172.21.15.44:0/2519692442 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c007b00 con 0x7fa340104100 2024-05-03T22:43:39.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.910+0000 7fa33d600700 1 -- 172.21.15.44:0/2519692442 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fa32c007ca0 con 0x7fa340104100 2024-05-03T22:43:39.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.910+0000 7fa347800700 1 -- 172.21.15.44:0/2519692442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa34019c4f0 con 0x7fa340104100 2024-05-03T22:43:39.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.910+0000 7fa33d600700 1 -- 172.21.15.44:0/2519692442 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c0187c0 con 0x7fa340104100 2024-05-03T22:43:39.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.910+0000 7fa347800700 1 -- 172.21.15.44:0/2519692442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3401a87b0 con 0x7fa340104100 2024-05-03T22:43:39.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.911+0000 7fa347800700 1 -- 172.21.15.44:0/2519692442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa34006a190 con 0x7fa340104100 2024-05-03T22:43:39.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.914+0000 7fa33d600700 1 -- 172.21.15.44:0/2519692442 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa32c00f450 con 0x7fa340104100 2024-05-03T22:43:39.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.915+0000 7fa33d600700 1 --2- 172.21.15.44:0/2519692442 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa3280b2910 0x7fa3280b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:39.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.915+0000 7fa33d600700 1 -- 172.21.15.44:0/2519692442 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fa32c0e2b60 con 0x7fa340104100 2024-05-03T22:43:39.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.916+0000 7fa344e00700 1 --2- 172.21.15.44:0/2519692442 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa3280b2910 0x7fa3280b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:39.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.916+0000 7fa344e00700 1 --2- 172.21.15.44:0/2519692442 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa3280b2910 0x7fa3280b4dd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa334005950 tx=0x7fa334005ed0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:39.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.918+0000 7fa33d600700 1 -- 172.21.15.44:0/2519692442 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa32c014030 con 0x7fa340104100 2024-05-03T22:43:40.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.153+0000 7fa347800700 1 -- 172.21.15.44:0/2519692442 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fa34019cfd0 con 0x7fa340104100 2024-05-03T22:43:40.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.153+0000 7fa33d600700 1 -- 172.21.15.44:0/2519692442 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa34019cfd0 con 0x7fa340104100 2024-05-03T22:43:40.155 INFO:teuthology.orchestra.run.smithi044.stdout:107374182519 2024-05-03T22:43:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.156+0000 7fa347800700 1 -- 172.21.15.44:0/2519692442 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa3280b2910 msgr2=0x7fa3280b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.156+0000 7fa347800700 1 --2- 172.21.15.44:0/2519692442 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa3280b2910 0x7fa3280b4dd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa334005950 tx=0x7fa334005ed0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.156+0000 7fa347800700 1 -- 172.21.15.44:0/2519692442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa340104100 msgr2=0x7fa3401a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:40.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.156+0000 7fa347800700 1 --2- 172.21.15.44:0/2519692442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa340104100 0x7fa3401a1e20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00c9b0 tx=0x7fa32c00cd70 comp rx=0 tx=0).stop 2024-05-03T22:43:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.158+0000 7fa347800700 1 -- 172.21.15.44:0/2519692442 shutdown_connections 2024-05-03T22:43:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.158+0000 7fa347800700 1 --2- 172.21.15.44:0/2519692442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa340108850 0x7fa34019baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.158+0000 7fa347800700 1 --2- 172.21.15.44:0/2519692442 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa3280b2910 0x7fa3280b4dd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.158+0000 7fa347800700 1 --2- 172.21.15.44:0/2519692442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa340103750 0x7fa3401a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.158+0000 7fa347800700 1 --2- 172.21.15.44:0/2519692442 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa340104100 0x7fa3401a1e20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.158+0000 7fa347800700 1 -- 172.21.15.44:0/2519692442 >> 172.21.15.44:0/2519692442 conn(0x7fa34007a600 msgr2=0x7fa340102410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.158+0000 7fa347800700 1 -- 172.21.15.44:0/2519692442 shutdown_connections 2024-05-03T22:43:40.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.158+0000 7fa347800700 1 -- 172.21.15.44:0/2519692442 wait complete. 2024-05-03T22:43:40.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:40 smithi044 ceph-mon[28604]: pgmap v484: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:43:40.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:40 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1738150890' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-03T22:43:40.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:40 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2519692442' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-03T22:43:40.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.702+0000 7f6d59a00700 1 -- 172.21.15.44:0/3536606288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d5410e8b0 msgr2=0x7f6d5410ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:40.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.702+0000 7f6d59a00700 1 --2- 172.21.15.44:0/3536606288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d5410e8b0 0x7f6d5410ec90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009990 tx=0x7f6d44009ca0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.702+0000 7f6d59a00700 1 -- 172.21.15.44:0/3536606288 shutdown_connections 2024-05-03T22:43:40.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.702+0000 7f6d59a00700 1 --2- 172.21.15.44:0/3536606288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d5410a3a0 0x7f6d54116840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.702+0000 7f6d59a00700 1 --2- 172.21.15.44:0/3536606288 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d5410e8b0 0x7f6d5410ec90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.702+0000 7f6d59a00700 1 --2- 172.21.15.44:0/3536606288 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d541099e0 0x7f6d54109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.702+0000 7f6d59a00700 1 -- 172.21.15.44:0/3536606288 >> 172.21.15.44:0/3536606288 conn(0x7f6d54079230 msgr2=0x7f6d541082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:40.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.702+0000 7f6d59a00700 1 -- 172.21.15.44:0/3536606288 shutdown_connections 2024-05-03T22:43:40.705 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.702+0000 7f6d59a00700 1 -- 172.21.15.44:0/3536606288 wait complete. 2024-05-03T22:43:40.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.703+0000 7f6d59a00700 1 Processor -- start 2024-05-03T22:43:40.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.704+0000 7f6d59a00700 1 -- start start 2024-05-03T22:43:40.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.704+0000 7f6d59a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d541099e0 0x7f6d541a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:40.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.704+0000 7f6d59a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d5410a3a0 0x7f6d541a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:40.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.704+0000 7f6d59a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d5410e8b0 0x7f6d541a4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:40.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.704+0000 7f6d59a00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f6d54119d10 con 0x7f6d5410a3a0 2024-05-03T22:43:40.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.704+0000 7f6d59a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6d54119b90 con 0x7f6d541099e0 2024-05-03T22:43:40.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.704+0000 7f6d59a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6d54119e90 con 0x7f6d5410e8b0 2024-05-03T22:43:40.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.704+0000 7f6d4be00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d5410a3a0 0x7f6d541a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:40.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.704+0000 7f6d4be00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d5410a3a0 0x7f6d541a0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36634/0 (socket says 172.21.15.44:36634) 2024-05-03T22:43:40.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.704+0000 7f6d4be00700 1 -- 172.21.15.44:0/879527555 learned_addr learned my addr 172.21.15.44:0/879527555 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:40.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.705+0000 7f6d53e00700 1 --2- 172.21.15.44:0/879527555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d541099e0 0x7f6d541a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:40.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.705+0000 7f6d59000700 1 --2- 172.21.15.44:0/879527555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d5410e8b0 0x7f6d541a4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:40.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.705+0000 7f6d4be00700 1 -- 172.21.15.44:0/879527555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d5410e8b0 msgr2=0x7f6d541a4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:40.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.705+0000 7f6d4be00700 1 --2- 172.21.15.44:0/879527555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d5410e8b0 0x7f6d541a4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.705+0000 7f6d4be00700 1 -- 172.21.15.44:0/879527555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d541099e0 msgr2=0x7f6d541a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:40.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.705+0000 7f6d4be00700 1 --2- 172.21.15.44:0/879527555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d541099e0 0x7f6d541a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.705+0000 7f6d4be00700 1 -- 172.21.15.44:0/879527555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d541a5230 con 0x7f6d5410a3a0 2024-05-03T22:43:40.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.705+0000 7f6d53e00700 1 --2- 172.21.15.44:0/879527555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d541099e0 0x7f6d541a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:43:40.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.705+0000 7f6d4be00700 1 --2- 172.21.15.44:0/879527555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d5410a3a0 0x7f6d541a0760 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00d950 tx=0x7f6d3c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:40.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.705+0000 7f6d51600700 1 -- 172.21.15.44:0/879527555 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c016070 con 0x7f6d5410a3a0 2024-05-03T22:43:40.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.706+0000 7f6d51600700 1 -- 172.21.15.44:0/879527555 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f6d3c009b40 con 0x7f6d5410a3a0 2024-05-03T22:43:40.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.706+0000 7f6d59a00700 1 -- 172.21.15.44:0/879527555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d541a5520 con 0x7f6d5410a3a0 2024-05-03T22:43:40.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.706+0000 7f6d51600700 1 -- 172.21.15.44:0/879527555 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00f620 con 0x7f6d5410a3a0 2024-05-03T22:43:40.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.706+0000 7f6d59a00700 1 -- 172.21.15.44:0/879527555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d541acda0 con 0x7f6d5410a3a0 2024-05-03T22:43:40.709 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.707+0000 7f6d59a00700 1 -- 172.21.15.44:0/879527555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d5406a190 con 0x7f6d5410a3a0 2024-05-03T22:43:40.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.709+0000 7f6d51600700 1 -- 172.21.15.44:0/879527555 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f6d3c019070 con 0x7f6d5410a3a0 2024-05-03T22:43:40.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.712+0000 7f6d51600700 1 --2- 172.21.15.44:0/879527555 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6d380b2910 0x7f6d380b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:40.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.712+0000 7f6d51600700 1 -- 172.21.15.44:0/879527555 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f6d3c0e2840 con 0x7f6d5410a3a0 2024-05-03T22:43:40.713 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.712+0000 7f6d53e00700 1 --2- 172.21.15.44:0/879527555 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6d380b2910 0x7f6d380b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:40.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.713+0000 7f6d53e00700 1 --2- 172.21.15.44:0/879527555 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6d380b2910 0x7f6d380b4dd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400b5c0 tx=0x7f6d44005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:40.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.714+0000 7f6d51600700 1 -- 172.21.15.44:0/879527555 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f6d3c0a9f90 con 0x7f6d5410a3a0 2024-05-03T22:43:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:40 smithi060 ceph-mon[31721]: pgmap v484: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:43:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:40 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1738150890' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-03T22:43:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:40 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2519692442' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-03T22:43:40.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:40 smithi160 ceph-mon[32531]: pgmap v484: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:43:40.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:40 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1738150890' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-03T22:43:40.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:40 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2519692442' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-03T22:43:40.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.438+0000 7f34cf200700 1 -- 172.21.15.44:0/3097105264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d01033d0 msgr2=0x7f34d0103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:40.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.438+0000 7f34cf200700 1 --2- 172.21.15.44:0/3097105264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d01033d0 0x7f34d0103850 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f34bc009990 tx=0x7f34bc009ca0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.438+0000 7f34cf200700 1 -- 172.21.15.44:0/3097105264 shutdown_connections 2024-05-03T22:43:40.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.438+0000 7f34cf200700 1 --2- 172.21.15.44:0/3097105264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34d0103d90 0x7f34d01102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.438+0000 7f34cf200700 1 --2- 172.21.15.44:0/3097105264 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34d0109460 0x7f34d0109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.438+0000 7f34cf200700 1 --2- 172.21.15.44:0/3097105264 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d01033d0 0x7f34d0103850 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.438+0000 7f34cf200700 1 -- 172.21.15.44:0/3097105264 >> 172.21.15.44:0/3097105264 conn(0x7f34d00fef20 msgr2=0x7f34d0101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:40.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.438+0000 7f34cf200700 1 -- 172.21.15.44:0/3097105264 shutdown_connections 2024-05-03T22:43:40.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.438+0000 7f34cf200700 1 -- 172.21.15.44:0/3097105264 wait complete. 2024-05-03T22:43:40.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.439+0000 7f34cf200700 1 Processor -- start 2024-05-03T22:43:40.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.439+0000 7f34cf200700 1 -- start start 2024-05-03T22:43:40.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.440+0000 7f34cf200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d01033d0 0x7f34d019f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:40.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.440+0000 7f34cf200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34d0103d90 0x7f34d019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:40.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.440+0000 7f34cf200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34d0109460 0x7f34d0199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:40.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.440+0000 7f34cf200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f34d0113700 con 0x7f34d01033d0 2024-05-03T22:43:40.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.440+0000 7f34cf200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f34d0113580 con 0x7f34d0109460 2024-05-03T22:43:40.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.440+0000 7f34cf200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f34d0113880 con 0x7f34d0103d90 2024-05-03T22:43:40.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.440+0000 7f34cde00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d01033d0 0x7f34d019f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:40.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.440+0000 7f34cde00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d01033d0 0x7f34d019f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57026/0 (socket says 172.21.15.44:57026) 2024-05-03T22:43:40.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.440+0000 7f34cde00700 1 -- 172.21.15.44:0/1738150890 learned_addr learned my addr 172.21.15.44:0/1738150890 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:40.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.441+0000 7f34cd400700 1 --2- 172.21.15.44:0/1738150890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34d0103d90 0x7f34d019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:40.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.441+0000 7f34ce800700 1 --2- 172.21.15.44:0/1738150890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34d0109460 0x7f34d0199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:40.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.441+0000 7f34cde00700 1 -- 172.21.15.44:0/1738150890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34d0103d90 msgr2=0x7f34d019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:40.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.441+0000 7f34cde00700 1 --2- 172.21.15.44:0/1738150890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34d0103d90 0x7f34d019fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.441+0000 7f34cde00700 1 -- 172.21.15.44:0/1738150890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34d0109460 msgr2=0x7f34d0199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:40.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.441+0000 7f34cde00700 1 --2- 172.21.15.44:0/1738150890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34d0109460 0x7f34d0199900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.441+0000 7f34cde00700 1 -- 172.21.15.44:0/1738150890 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d019a060 con 0x7f34d01033d0 2024-05-03T22:43:40.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.441+0000 7f34cde00700 1 --2- 172.21.15.44:0/1738150890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d01033d0 0x7f34d019f740 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f34c000c920 tx=0x7f34c000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:40.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.442+0000 7f34c6a00700 1 -- 172.21.15.44:0/1738150890 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c0007b00 con 0x7f34d01033d0 2024-05-03T22:43:40.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.442+0000 7f34c6a00700 1 -- 172.21.15.44:0/1738150890 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f34c0004d00 con 0x7f34d01033d0 2024-05-03T22:43:40.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.442+0000 7f34c6a00700 1 -- 172.21.15.44:0/1738150890 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c000f450 con 0x7f34d01033d0 2024-05-03T22:43:40.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.442+0000 7f34cf200700 1 -- 172.21.15.44:0/1738150890 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d019a350 con 0x7f34d01033d0 2024-05-03T22:43:40.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.442+0000 7f34cf200700 1 -- 172.21.15.44:0/1738150890 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d01a6610 con 0x7f34d01033d0 2024-05-03T22:43:40.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.443+0000 7f34cf200700 1 -- 172.21.15.44:0/1738150890 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34d006a190 con 0x7f34d01033d0 2024-05-03T22:43:40.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.445+0000 7f34c6a00700 1 -- 172.21.15.44:0/1738150890 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f34c0004750 con 0x7f34d01033d0 2024-05-03T22:43:40.821 INFO:teuthology.orchestra.run.smithi044.stdout:154618822761 2024-05-03T22:43:40.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.448+0000 7f34c6a00700 1 --2- 172.21.15.44:0/1738150890 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f34b40b2990 0x7f34b40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:40.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.448+0000 7f34c6a00700 1 -- 172.21.15.44:0/1738150890 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f34c00e2700 con 0x7f34d01033d0 2024-05-03T22:43:40.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.448+0000 7f34cd400700 1 --2- 172.21.15.44:0/1738150890 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f34b40b2990 0x7f34b40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:40.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.449+0000 7f34cd400700 1 --2- 172.21.15.44:0/1738150890 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f34b40b2990 0x7f34b40b4e50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f34bc009750 tx=0x7f34bc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:40.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.453+0000 7f34c6a00700 1 -- 172.21.15.44:0/1738150890 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f34c0014030 con 0x7f34d01033d0 2024-05-03T22:43:40.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.711+0000 7f34cf200700 1 -- 172.21.15.44:0/1738150890 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f34d019ae30 con 0x7f34d01033d0 2024-05-03T22:43:40.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.712+0000 7f34c6a00700 1 -- 172.21.15.44:0/1738150890 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f34c00a9e50 con 0x7f34d01033d0 2024-05-03T22:43:40.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.715+0000 7f34cf200700 1 -- 172.21.15.44:0/1738150890 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f34b40b2990 msgr2=0x7f34b40b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:40.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.715+0000 7f34cf200700 1 --2- 172.21.15.44:0/1738150890 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f34b40b2990 0x7f34b40b4e50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f34bc009750 tx=0x7f34bc005fd0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.715+0000 7f34cf200700 1 -- 172.21.15.44:0/1738150890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d01033d0 msgr2=0x7f34d019f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:40.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.715+0000 7f34cf200700 1 --2- 172.21.15.44:0/1738150890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d01033d0 0x7f34d019f740 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f34c000c920 tx=0x7f34c000cce0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.715+0000 7f34cf200700 1 -- 172.21.15.44:0/1738150890 shutdown_connections 2024-05-03T22:43:40.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.715+0000 7f34cf200700 1 --2- 172.21.15.44:0/1738150890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34d0109460 0x7f34d0199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.715+0000 7f34cf200700 1 --2- 172.21.15.44:0/1738150890 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f34d01033d0 0x7f34d019f740 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.715+0000 7f34cf200700 1 --2- 172.21.15.44:0/1738150890 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f34b40b2990 0x7f34b40b4e50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.715+0000 7f34cf200700 1 --2- 172.21.15.44:0/1738150890 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34d0103d90 0x7f34d019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.715+0000 7f34cf200700 1 -- 172.21.15.44:0/1738150890 >> 172.21.15.44:0/1738150890 conn(0x7f34d00fef20 msgr2=0x7f34d00ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:40.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.715+0000 7f34cf200700 1 -- 172.21.15.44:0/1738150890 shutdown_connections 2024-05-03T22:43:40.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:39.715+0000 7f34cf200700 1 -- 172.21.15.44:0/1738150890 wait complete. 2024-05-03T22:43:40.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.953+0000 7f6d59a00700 1 -- 172.21.15.44:0/879527555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6d5402e510 con 0x7f6d5410a3a0 2024-05-03T22:43:40.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.954+0000 7f6d51600700 1 -- 172.21.15.44:0/879527555 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6d3c0a9890 con 0x7f6d5410a3a0 2024-05-03T22:43:40.955 INFO:teuthology.orchestra.run.smithi044.stdout:55834574981 2024-05-03T22:43:40.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.957+0000 7f6d59a00700 1 -- 172.21.15.44:0/879527555 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6d380b2910 msgr2=0x7f6d380b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:40.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.957+0000 7f6d59a00700 1 --2- 172.21.15.44:0/879527555 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6d380b2910 0x7f6d380b4dd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400b5c0 tx=0x7f6d44005fb0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.957+0000 7f6d59a00700 1 -- 172.21.15.44:0/879527555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d5410a3a0 msgr2=0x7f6d541a0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:40.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.957+0000 7f6d59a00700 1 --2- 172.21.15.44:0/879527555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d5410a3a0 0x7f6d541a0760 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00d950 tx=0x7f6d3c00dd10 comp rx=0 tx=0).stop 2024-05-03T22:43:40.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.957+0000 7f6d59a00700 1 -- 172.21.15.44:0/879527555 shutdown_connections 2024-05-03T22:43:40.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.957+0000 7f6d59a00700 1 --2- 172.21.15.44:0/879527555 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f6d380b2910 0x7f6d380b4dd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.957+0000 7f6d59a00700 1 --2- 172.21.15.44:0/879527555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d5410e8b0 0x7f6d541a4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.957+0000 7f6d59a00700 1 --2- 172.21.15.44:0/879527555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d541099e0 0x7f6d541a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.957+0000 7f6d59a00700 1 --2- 172.21.15.44:0/879527555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6d5410a3a0 0x7f6d541a0760 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:40.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.957+0000 7f6d59a00700 1 -- 172.21.15.44:0/879527555 >> 172.21.15.44:0/879527555 conn(0x7f6d54079230 msgr2=0x7f6d540798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:40.959 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.958+0000 7f6d59a00700 1 -- 172.21.15.44:0/879527555 shutdown_connections 2024-05-03T22:43:40.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:40.958+0000 7f6d59a00700 1 -- 172.21.15.44:0/879527555 wait complete. 2024-05-03T22:43:41.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:41 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/879527555' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-03T22:43:41.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:41 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/879527555' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-03T22:43:41.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:41 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/879527555' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-03T22:43:42.035 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822754 got 154618822761 for osd.5 2024-05-03T22:43:42.035 DEBUG:teuthology.parallel:result is None 2024-05-03T22:43:42.543 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574976 got 55834574981 for osd.1 2024-05-03T22:43:42.543 DEBUG:teuthology.parallel:result is None 2024-05-03T22:43:42.657 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:42 smithi060 ceph-mon[31721]: pgmap v485: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:43:42.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:42 smithi044 ceph-mon[28604]: pgmap v485: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:43:42.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:42 smithi160 ceph-mon[32531]: pgmap v485: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:43:42.970 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182513 got 107374182519 for osd.3 2024-05-03T22:43:42.971 DEBUG:teuthology.parallel:result is None 2024-05-03T22:43:42.971 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-03T22:43:42.971 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-03T22:43:43.458 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:43:43.619 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:43 smithi044 ceph-mon[28604]: pgmap v486: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:43.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:43 smithi060 ceph-mon[31721]: pgmap v486: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:43.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:43 smithi160 ceph-mon[32531]: pgmap v486: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.924+0000 7fb30fc00700 1 -- 172.21.15.44:0/3995911730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb308114670 msgr2=0x7fb308116a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.924+0000 7fb30fc00700 1 --2- 172.21.15.44:0/3995911730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb308114670 0x7fb308116a60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb30000b0a0 tx=0x7fb30000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:43:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.924+0000 7fb30fc00700 1 -- 172.21.15.44:0/3995911730 shutdown_connections 2024-05-03T22:43:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.924+0000 7fb30fc00700 1 --2- 172.21.15.44:0/3995911730 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb308114670 0x7fb308116a60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.924+0000 7fb30fc00700 1 --2- 172.21.15.44:0/3995911730 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3080756d0 0x7fb308075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:45.926 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.924+0000 7fb30fc00700 1 --2- 172.21.15.44:0/3995911730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb308075ff0 0x7fb308114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:45.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.924+0000 7fb30fc00700 1 -- 172.21.15.44:0/3995911730 >> 172.21.15.44:0/3995911730 conn(0x7fb30807a600 msgr2=0x7fb30807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:45.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.924+0000 7fb30fc00700 1 -- 172.21.15.44:0/3995911730 shutdown_connections 2024-05-03T22:43:45.927 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.924+0000 7fb30fc00700 1 -- 172.21.15.44:0/3995911730 wait complete. 2024-05-03T22:43:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.925+0000 7fb30fc00700 1 Processor -- start 2024-05-03T22:43:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.925+0000 7fb30fc00700 1 -- start start 2024-05-03T22:43:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.926+0000 7fb30fc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3080756d0 0x7fb3081a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.926+0000 7fb30fc00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb308075ff0 0x7fb3081a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.926+0000 7fb30fc00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb308114670 0x7fb3081a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.926+0000 7fb30fc00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb308119dd0 con 0x7fb308114670 2024-05-03T22:43:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.926+0000 7fb30fc00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb308119c50 con 0x7fb3080756d0 2024-05-03T22:43:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.926+0000 7fb30fc00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb308119f50 con 0x7fb308075ff0 2024-05-03T22:43:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.926+0000 7fb30dc00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb308114670 0x7fb3081a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.926+0000 7fb30dc00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb308114670 0x7fb3081a4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:36650/0 (socket says 172.21.15.44:36650) 2024-05-03T22:43:45.928 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.926+0000 7fb30dc00700 1 -- 172.21.15.44:0/2549366598 learned_addr learned my addr 172.21.15.44:0/2549366598 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:45.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.926+0000 7fb30d200700 1 --2- 172.21.15.44:0/2549366598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3080756d0 0x7fb3081a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:45.929 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.927+0000 7fb307e00700 1 --2- 172.21.15.44:0/2549366598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb308075ff0 0x7fb3081a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.927+0000 7fb30dc00700 1 -- 172.21.15.44:0/2549366598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb308075ff0 msgr2=0x7fb3081a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.927+0000 7fb30dc00700 1 --2- 172.21.15.44:0/2549366598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb308075ff0 0x7fb3081a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.927+0000 7fb30dc00700 1 -- 172.21.15.44:0/2549366598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3080756d0 msgr2=0x7fb3081a0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.927+0000 7fb30dc00700 1 --2- 172.21.15.44:0/2549366598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3080756d0 0x7fb3081a0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.927+0000 7fb30dc00700 1 -- 172.21.15.44:0/2549366598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3081a5170 con 0x7fb308114670 2024-05-03T22:43:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.927+0000 7fb30d200700 1 --2- 172.21.15.44:0/2549366598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3080756d0 0x7fb3081a0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:43:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.927+0000 7fb30dc00700 1 --2- 172.21.15.44:0/2549366598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb308114670 0x7fb3081a4a30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb300006070 tx=0x7fb300007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.927+0000 7fb305600700 1 -- 172.21.15.44:0/2549366598 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300003c00 con 0x7fb308114670 2024-05-03T22:43:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.928+0000 7fb305600700 1 -- 172.21.15.44:0/2549366598 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fb300003da0 con 0x7fb308114670 2024-05-03T22:43:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.928+0000 7fb30fc00700 1 -- 172.21.15.44:0/2549366598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3081a5400 con 0x7fb308114670 2024-05-03T22:43:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.928+0000 7fb305600700 1 -- 172.21.15.44:0/2549366598 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30001ba30 con 0x7fb308114670 2024-05-03T22:43:45.930 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.928+0000 7fb30fc00700 1 -- 172.21.15.44:0/2549366598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3081acce0 con 0x7fb308114670 2024-05-03T22:43:45.931 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.929+0000 7fb30fc00700 1 -- 172.21.15.44:0/2549366598 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb30806a190 con 0x7fb308114670 2024-05-03T22:43:45.932 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.931+0000 7fb305600700 1 -- 172.21.15.44:0/2549366598 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb300005760 con 0x7fb308114670 2024-05-03T22:43:45.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.933+0000 7fb305600700 1 --2- 172.21.15.44:0/2549366598 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb2f00b2990 0x7fb2f00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:45.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.933+0000 7fb305600700 1 -- 172.21.15.44:0/2549366598 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fb30000f020 con 0x7fb308114670 2024-05-03T22:43:45.934 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.933+0000 7fb30d200700 1 --2- 172.21.15.44:0/2549366598 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb2f00b2990 0x7fb2f00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:45.935 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.934+0000 7fb30d200700 1 --2- 172.21.15.44:0/2549366598 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb2f00b2990 0x7fb2f00b4e50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc005950 tx=0x7fb2fc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:45.937 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:45.936+0000 7fb305600700 1 -- 172.21.15.44:0/2549366598 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb3000ab240 con 0x7fb308114670 2024-05-03T22:43:46.173 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:46.171+0000 7fb30fc00700 1 -- 172.21.15.44:0/2549366598 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb308113a70 con 0x7fb2f00b2990 2024-05-03T22:43:46.173 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:46 smithi044 ceph-mon[28604]: pgmap v487: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:43:46.206 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:46.204+0000 7fb305600700 1 -- 172.21.15.44:0/2549366598 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340422 (secure 0 0 0) 0x7fb308113a70 con 0x7fb2f00b2990 2024-05-03T22:43:46.214 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:43:46.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:46.213+0000 7fb30fc00700 1 -- 172.21.15.44:0/2549366598 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb2f00b2990 msgr2=0x7fb2f00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:46.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:46.213+0000 7fb30fc00700 1 --2- 172.21.15.44:0/2549366598 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb2f00b2990 0x7fb2f00b4e50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc005950 tx=0x7fb2fc0058e0 comp rx=0 tx=0).stop 2024-05-03T22:43:46.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:46.213+0000 7fb30fc00700 1 -- 172.21.15.44:0/2549366598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb308114670 msgr2=0x7fb3081a4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:46.217 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:46.213+0000 7fb30fc00700 1 --2- 172.21.15.44:0/2549366598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb308114670 0x7fb3081a4a30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb300006070 tx=0x7fb300007a50 comp rx=0 tx=0).stop 2024-05-03T22:43:46.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:46.213+0000 7fb30fc00700 1 -- 172.21.15.44:0/2549366598 shutdown_connections 2024-05-03T22:43:46.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:46.213+0000 7fb30fc00700 1 --2- 172.21.15.44:0/2549366598 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb308114670 0x7fb3081a4a30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:46.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:46.213+0000 7fb30fc00700 1 --2- 172.21.15.44:0/2549366598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3080756d0 0x7fb3081a0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:46.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:46.213+0000 7fb30fc00700 1 --2- 172.21.15.44:0/2549366598 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb2f00b2990 0x7fb2f00b4e50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:46.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:46.213+0000 7fb30fc00700 1 --2- 172.21.15.44:0/2549366598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb308075ff0 0x7fb3081a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:46.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:46.213+0000 7fb30fc00700 1 -- 172.21.15.44:0/2549366598 >> 172.21.15.44:0/2549366598 conn(0x7fb30807a600 msgr2=0x7fb308113360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:46.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:46.214+0000 7fb30fc00700 1 -- 172.21.15.44:0/2549366598 shutdown_connections 2024-05-03T22:43:46.218 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:46.214+0000 7fb30fc00700 1 -- 172.21.15.44:0/2549366598 wait complete. 2024-05-03T22:43:46.218 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-05-03T22:43:46.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:46 smithi060 ceph-mon[31721]: pgmap v487: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:43:46.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:46 smithi160 ceph-mon[32531]: pgmap v487: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:43:47.147 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":487,"stamp":"2024-05-03T22:43:45.054911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658020,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1315,"num_read_kb":759,"num_write":373,"num_write_kb":2292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":308,"ondisk_log_size":308,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384252,"kb_used_data":14228,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557572,"statfs":{"total":1151940427776,"available":1151546953728,"internally_reserved":0,"allocated":14569472,"data_stored":8134718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005135"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.535408+0000","last_change":"2024-05-03T22:40:11.775947+0000","last_active":"2024-05-03T22:42:11.535408+0000","last_peered":"2024-05-03T22:42:11.535408+0000","last_clean":"2024-05-03T22:42:11.535408+0000","last_became_active":"2024-05-03T22:40:11.770836+0000","last_became_peered":"2024-05-03T22:40:11.770836+0000","last_unstale":"2024-05-03T22:42:11.535408+0000","last_undegraded":"2024-05-03T22:42:11.535408+0000","last_fullsized":"2024-05-03T22:42:11.535408+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:38:36.107368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740907+0000","last_change":"2024-05-03T22:40:11.781597+0000","last_active":"2024-05-03T22:42:11.740907+0000","last_peered":"2024-05-03T22:42:11.740907+0000","last_clean":"2024-05-03T22:42:11.740907+0000","last_became_active":"2024-05-03T22:40:11.781160+0000","last_became_peered":"2024-05-03T22:40:11.781160+0000","last_unstale":"2024-05-03T22:42:11.740907+0000","last_undegraded":"2024-05-03T22:42:11.740907+0000","last_fullsized":"2024-05-03T22:42:11.740907+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:57:41.654999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740820+0000","last_change":"2024-05-03T22:40:11.776144+0000","last_active":"2024-05-03T22:42:11.740820+0000","last_peered":"2024-05-03T22:42:11.740820+0000","last_clean":"2024-05-03T22:42:11.740820+0000","last_became_active":"2024-05-03T22:40:11.775781+0000","last_became_peered":"2024-05-03T22:40:11.775781+0000","last_unstale":"2024-05-03T22:42:11.740820+0000","last_undegraded":"2024-05-03T22:42:11.740820+0000","last_fullsized":"2024-05-03T22:42:11.740820+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:48:33.774915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748883+0000","last_change":"2024-05-03T22:40:11.773680+0000","last_active":"2024-05-03T22:42:11.748883+0000","last_peered":"2024-05-03T22:42:11.748883+0000","last_clean":"2024-05-03T22:42:11.748883+0000","last_became_active":"2024-05-03T22:40:11.771779+0000","last_became_peered":"2024-05-03T22:40:11.771779+0000","last_unstale":"2024-05-03T22:42:11.748883+0000","last_undegraded":"2024-05-03T22:42:11.748883+0000","last_fullsized":"2024-05-03T22:42:11.748883+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:29:58.849141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433671+0000","last_change":"2024-05-03T22:40:11.770873+0000","last_active":"2024-05-03T22:42:11.433671+0000","last_peered":"2024-05-03T22:42:11.433671+0000","last_clean":"2024-05-03T22:42:11.433671+0000","last_became_active":"2024-05-03T22:40:11.770361+0000","last_became_peered":"2024-05-03T22:40:11.770361+0000","last_unstale":"2024-05-03T22:42:11.433671+0000","last_undegraded":"2024-05-03T22:42:11.433671+0000","last_fullsized":"2024-05-03T22:42:11.433671+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:24:11.038058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.441126+0000","last_change":"2024-05-03T22:42:11.439751+0000","last_active":"2024-05-03T22:42:11.441126+0000","last_peered":"2024-05-03T22:42:11.441126+0000","last_clean":"2024-05-03T22:42:11.441126+0000","last_became_active":"2024-05-03T22:42:11.438556+0000","last_became_peered":"2024-05-03T22:42:11.438556+0000","last_unstale":"2024-05-03T22:42:11.441126+0000","last_undegraded":"2024-05-03T22:42:11.441126+0000","last_fullsized":"2024-05-03T22:42:11.441126+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:25:14.716559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749529+0000","last_change":"2024-05-03T22:40:11.772616+0000","last_active":"2024-05-03T22:42:11.749529+0000","last_peered":"2024-05-03T22:42:11.749529+0000","last_clean":"2024-05-03T22:42:11.749529+0000","last_became_active":"2024-05-03T22:40:11.772237+0000","last_became_peered":"2024-05-03T22:40:11.772237+0000","last_unstale":"2024-05-03T22:42:11.749529+0000","last_undegraded":"2024-05-03T22:42:11.749529+0000","last_fullsized":"2024-05-03T22:42:11.749529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:36:36.825989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748173+0000","last_change":"2024-05-03T22:40:11.771192+0000","last_active":"2024-05-03T22:42:11.748173+0000","last_peered":"2024-05-03T22:42:11.748173+0000","last_clean":"2024-05-03T22:42:11.748173+0000","last_became_active":"2024-05-03T22:40:11.770820+0000","last_became_peered":"2024-05-03T22:40:11.770820+0000","last_unstale":"2024-05-03T22:42:11.748173+0000","last_undegraded":"2024-05-03T22:42:11.748173+0000","last_fullsized":"2024-05-03T22:42:11.748173+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:51:22.303448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.752332+0000","last_change":"2024-05-03T22:42:11.751423+0000","last_active":"2024-05-03T22:42:11.752332+0000","last_peered":"2024-05-03T22:42:11.752332+0000","last_clean":"2024-05-03T22:42:11.752332+0000","last_became_active":"2024-05-03T22:42:11.750956+0000","last_became_peered":"2024-05-03T22:42:11.750956+0000","last_unstale":"2024-05-03T22:42:11.752332+0000","last_undegraded":"2024-05-03T22:42:11.752332+0000","last_fullsized":"2024-05-03T22:42:11.752332+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:07:12.615712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.440568+0000","last_change":"2024-05-03T22:42:11.437447+0000","last_active":"2024-05-03T22:42:11.440568+0000","last_peered":"2024-05-03T22:42:11.440568+0000","last_clean":"2024-05-03T22:42:11.440568+0000","last_became_active":"2024-05-03T22:42:11.436202+0000","last_became_peered":"2024-05-03T22:42:11.436202+0000","last_unstale":"2024-05-03T22:42:11.440568+0000","last_undegraded":"2024-05-03T22:42:11.440568+0000","last_fullsized":"2024-05-03T22:42:11.440568+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:50:12.891083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750344+0000","last_change":"2024-05-03T22:40:11.781381+0000","last_active":"2024-05-03T22:42:11.750344+0000","last_peered":"2024-05-03T22:42:11.750344+0000","last_clean":"2024-05-03T22:42:11.750344+0000","last_became_active":"2024-05-03T22:40:11.779293+0000","last_became_peered":"2024-05-03T22:40:11.779293+0000","last_unstale":"2024-05-03T22:42:11.750344+0000","last_undegraded":"2024-05-03T22:42:11.750344+0000","last_fullsized":"2024-05-03T22:42:11.750344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:54:12.774746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748783+0000","last_change":"2024-05-03T22:40:11.784059+0000","last_active":"2024-05-03T22:42:11.748783+0000","last_peered":"2024-05-03T22:42:11.748783+0000","last_clean":"2024-05-03T22:42:11.748783+0000","last_became_active":"2024-05-03T22:40:11.783674+0000","last_became_peered":"2024-05-03T22:40:11.783674+0000","last_unstale":"2024-05-03T22:42:11.748783+0000","last_undegraded":"2024-05-03T22:42:11.748783+0000","last_fullsized":"2024-05-03T22:42:11.748783+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:20:53.546365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.432290+0000","last_change":"2024-05-03T22:40:11.780950+0000","last_active":"2024-05-03T22:42:11.432290+0000","last_peered":"2024-05-03T22:42:11.432290+0000","last_clean":"2024-05-03T22:42:11.432290+0000","last_became_active":"2024-05-03T22:40:11.780434+0000","last_became_peered":"2024-05-03T22:40:11.780434+0000","last_unstale":"2024-05-03T22:42:11.432290+0000","last_undegraded":"2024-05-03T22:42:11.432290+0000","last_fullsized":"2024-05-03T22:42:11.432290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:28:46.616675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740592+0000","last_change":"2024-05-03T22:40:11.785985+0000","last_active":"2024-05-03T22:42:11.740592+0000","last_peered":"2024-05-03T22:42:11.740592+0000","last_clean":"2024-05-03T22:42:11.740592+0000","last_became_active":"2024-05-03T22:40:11.785615+0000","last_became_peered":"2024-05-03T22:40:11.785615+0000","last_unstale":"2024-05-03T22:42:11.740592+0000","last_undegraded":"2024-05-03T22:42:11.740592+0000","last_fullsized":"2024-05-03T22:42:11.740592+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:51:19.038726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740681+0000","last_change":"2024-05-03T22:40:11.777142+0000","last_active":"2024-05-03T22:42:11.740681+0000","last_peered":"2024-05-03T22:42:11.740681+0000","last_clean":"2024-05-03T22:42:11.740681+0000","last_became_active":"2024-05-03T22:40:11.775364+0000","last_became_peered":"2024-05-03T22:40:11.775364+0000","last_unstale":"2024-05-03T22:42:11.740681+0000","last_undegraded":"2024-05-03T22:42:11.740681+0000","last_fullsized":"2024-05-03T22:42:11.740681+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:48:06.634135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439590+0000","last_change":"2024-05-03T22:40:11.774928+0000","last_active":"2024-05-03T22:42:11.439590+0000","last_peered":"2024-05-03T22:42:11.439590+0000","last_clean":"2024-05-03T22:42:11.439590+0000","last_became_active":"2024-05-03T22:40:11.772942+0000","last_became_peered":"2024-05-03T22:40:11.772942+0000","last_unstale":"2024-05-03T22:42:11.439590+0000","last_undegraded":"2024-05-03T22:42:11.439590+0000","last_fullsized":"2024-05-03T22:42:11.439590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.054532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.535024+0000","last_change":"2024-05-03T22:40:11.777739+0000","last_active":"2024-05-03T22:42:11.535024+0000","last_peered":"2024-05-03T22:42:11.535024+0000","last_clean":"2024-05-03T22:42:11.535024+0000","last_became_active":"2024-05-03T22:40:11.776615+0000","last_became_peered":"2024-05-03T22:40:11.776615+0000","last_unstale":"2024-05-03T22:42:11.535024+0000","last_undegraded":"2024-05-03T22:42:11.535024+0000","last_fullsized":"2024-05-03T22:42:11.535024+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:34:17.672863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428570+0000","last_change":"2024-05-03T22:40:11.778880+0000","last_active":"2024-05-03T22:42:11.428570+0000","last_peered":"2024-05-03T22:42:11.428570+0000","last_clean":"2024-05-03T22:42:11.428570+0000","last_became_active":"2024-05-03T22:40:11.776901+0000","last_became_peered":"2024-05-03T22:40:11.776901+0000","last_unstale":"2024-05-03T22:42:11.428570+0000","last_undegraded":"2024-05-03T22:42:11.428570+0000","last_fullsized":"2024-05-03T22:42:11.428570+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:55:47.849284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426015+0000","last_change":"2024-05-03T22:40:11.768612+0000","last_active":"2024-05-03T22:42:11.426015+0000","last_peered":"2024-05-03T22:42:11.426015+0000","last_clean":"2024-05-03T22:42:11.426015+0000","last_became_active":"2024-05-03T22:40:11.767553+0000","last_became_peered":"2024-05-03T22:40:11.767553+0000","last_unstale":"2024-05-03T22:42:11.426015+0000","last_undegraded":"2024-05-03T22:42:11.426015+0000","last_fullsized":"2024-05-03T22:42:11.426015+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:04:36.348401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425312+0000","last_change":"2024-05-03T22:40:25.088489+0000","last_active":"2024-05-03T22:42:11.425312+0000","last_peered":"2024-05-03T22:42:11.425312+0000","last_clean":"2024-05-03T22:42:11.425312+0000","last_became_active":"2024-05-03T22:40:25.087028+0000","last_became_peered":"2024-05-03T22:40:25.087028+0000","last_unstale":"2024-05-03T22:42:11.425312+0000","last_undegraded":"2024-05-03T22:42:11.425312+0000","last_fullsized":"2024-05-03T22:42:11.425312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:38:00.084610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'13","reported_seq":177,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:43:39.578012+0000","last_change":"2024-05-03T22:40:06.682624+0000","last_active":"2024-05-03T22:43:39.578012+0000","last_peered":"2024-05-03T22:43:39.578012+0000","last_clean":"2024-05-03T22:43:39.578012+0000","last_became_active":"2024-05-03T22:40:06.682040+0000","last_became_peered":"2024-05-03T22:40:06.682040+0000","last_unstale":"2024-05-03T22:43:39.578012+0000","last_undegraded":"2024-05-03T22:43:39.578012+0000","last_fullsized":"2024-05-03T22:43:39.578012+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:39:52.905802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748274+0000","last_change":"2024-05-03T22:40:11.771570+0000","last_active":"2024-05-03T22:42:11.748274+0000","last_peered":"2024-05-03T22:42:11.748274+0000","last_clean":"2024-05-03T22:42:11.748274+0000","last_became_active":"2024-05-03T22:40:11.771165+0000","last_became_peered":"2024-05-03T22:40:11.771165+0000","last_unstale":"2024-05-03T22:42:11.748274+0000","last_undegraded":"2024-05-03T22:42:11.748274+0000","last_fullsized":"2024-05-03T22:42:11.748274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:32:08.302284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749200+0000","last_change":"2024-05-03T22:40:25.081258+0000","last_active":"2024-05-03T22:42:11.749200+0000","last_peered":"2024-05-03T22:42:11.749200+0000","last_clean":"2024-05-03T22:42:11.749200+0000","last_became_active":"2024-05-03T22:40:25.080733+0000","last_became_peered":"2024-05-03T22:40:25.080733+0000","last_unstale":"2024-05-03T22:42:11.749200+0000","last_undegraded":"2024-05-03T22:42:11.749200+0000","last_fullsized":"2024-05-03T22:42:11.749200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:46:13.570625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748957+0000","last_change":"2024-05-03T22:40:06.747674+0000","last_active":"2024-05-03T22:42:11.748957+0000","last_peered":"2024-05-03T22:42:11.748957+0000","last_clean":"2024-05-03T22:42:11.748957+0000","last_became_active":"2024-05-03T22:40:06.747267+0000","last_became_peered":"2024-05-03T22:40:06.747267+0000","last_unstale":"2024-05-03T22:42:11.748957+0000","last_undegraded":"2024-05-03T22:42:11.748957+0000","last_fullsized":"2024-05-03T22:42:11.748957+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:14:26.142063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740838+0000","last_change":"2024-05-03T22:40:11.769623+0000","last_active":"2024-05-03T22:42:11.740838+0000","last_peered":"2024-05-03T22:42:11.740838+0000","last_clean":"2024-05-03T22:42:11.740838+0000","last_became_active":"2024-05-03T22:40:11.769292+0000","last_became_peered":"2024-05-03T22:40:11.769292+0000","last_unstale":"2024-05-03T22:42:11.740838+0000","last_undegraded":"2024-05-03T22:42:11.740838+0000","last_fullsized":"2024-05-03T22:42:11.740838+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:37:49.533502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748423+0000","last_change":"2024-05-03T22:41:10.787906+0000","last_active":"2024-05-03T22:42:11.748423+0000","last_peered":"2024-05-03T22:42:11.748423+0000","last_clean":"2024-05-03T22:42:11.748423+0000","last_became_active":"2024-05-03T22:41:10.787233+0000","last_became_peered":"2024-05-03T22:41:10.787233+0000","last_unstale":"2024-05-03T22:42:11.748423+0000","last_undegraded":"2024-05-03T22:42:11.748423+0000","last_fullsized":"2024-05-03T22:42:11.748423+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:38:50.312605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'12","reported_seq":58,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433815+0000","last_change":"2024-05-03T22:40:06.685620+0000","last_active":"2024-05-03T22:42:11.433815+0000","last_peered":"2024-05-03T22:42:11.433815+0000","last_clean":"2024-05-03T22:42:11.433815+0000","last_became_active":"2024-05-03T22:40:06.684517+0000","last_became_peered":"2024-05-03T22:40:06.684517+0000","last_unstale":"2024-05-03T22:42:11.433815+0000","last_undegraded":"2024-05-03T22:42:11.433815+0000","last_fullsized":"2024-05-03T22:42:11.433815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:59:26.303253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439484+0000","last_change":"2024-05-03T22:40:11.778444+0000","last_active":"2024-05-03T22:42:11.439484+0000","last_peered":"2024-05-03T22:42:11.439484+0000","last_clean":"2024-05-03T22:42:11.439484+0000","last_became_active":"2024-05-03T22:40:11.778063+0000","last_became_peered":"2024-05-03T22:40:11.778063+0000","last_unstale":"2024-05-03T22:42:11.439484+0000","last_undegraded":"2024-05-03T22:42:11.439484+0000","last_fullsized":"2024-05-03T22:42:11.439484+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:35:53.638075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.752119+0000","last_change":"2024-05-03T22:41:11.625988+0000","last_active":"2024-05-03T22:42:11.752119+0000","last_peered":"2024-05-03T22:42:11.752119+0000","last_clean":"2024-05-03T22:42:11.752119+0000","last_became_active":"2024-05-03T22:41:11.624324+0000","last_became_peered":"2024-05-03T22:41:11.624324+0000","last_unstale":"2024-05-03T22:42:11.752119+0000","last_undegraded":"2024-05-03T22:42:11.752119+0000","last_fullsized":"2024-05-03T22:42:11.752119+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:25:34.600801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,10,3],"acting":[4,6,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"87'5","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433778+0000","last_change":"2024-05-03T22:40:06.690402+0000","last_active":"2024-05-03T22:42:11.433778+0000","last_peered":"2024-05-03T22:42:11.433778+0000","last_clean":"2024-05-03T22:42:11.433778+0000","last_became_active":"2024-05-03T22:40:06.689876+0000","last_became_peered":"2024-05-03T22:40:06.689876+0000","last_unstale":"2024-05-03T22:42:11.433778+0000","last_undegraded":"2024-05-03T22:42:11.433778+0000","last_fullsized":"2024-05-03T22:42:11.433778+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:28:36.929306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749241+0000","last_change":"2024-05-03T22:40:11.779901+0000","last_active":"2024-05-03T22:42:11.749241+0000","last_peered":"2024-05-03T22:42:11.749241+0000","last_clean":"2024-05-03T22:42:11.749241+0000","last_became_active":"2024-05-03T22:40:11.779565+0000","last_became_peered":"2024-05-03T22:40:11.779565+0000","last_unstale":"2024-05-03T22:42:11.749241+0000","last_undegraded":"2024-05-03T22:42:11.749241+0000","last_fullsized":"2024-05-03T22:42:11.749241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:05:51.650569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425751+0000","last_change":"2024-05-03T22:40:25.080244+0000","last_active":"2024-05-03T22:42:11.425751+0000","last_peered":"2024-05-03T22:42:11.425751+0000","last_clean":"2024-05-03T22:42:11.425751+0000","last_became_active":"2024-05-03T22:40:25.079711+0000","last_became_peered":"2024-05-03T22:40:25.079711+0000","last_unstale":"2024-05-03T22:42:11.425751+0000","last_undegraded":"2024-05-03T22:42:11.425751+0000","last_fullsized":"2024-05-03T22:42:11.425751+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:15:55.577907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":170,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:43:39.593292+0000","last_change":"2024-05-03T22:40:06.686480+0000","last_active":"2024-05-03T22:43:39.593292+0000","last_peered":"2024-05-03T22:43:39.593292+0000","last_clean":"2024-05-03T22:43:39.593292+0000","last_became_active":"2024-05-03T22:40:06.685932+0000","last_became_peered":"2024-05-03T22:40:06.685932+0000","last_unstale":"2024-05-03T22:43:39.593292+0000","last_undegraded":"2024-05-03T22:43:39.593292+0000","last_fullsized":"2024-05-03T22:43:39.593292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:40:50.952599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.443558+0000","last_change":"2024-05-03T22:42:11.442450+0000","last_active":"2024-05-03T22:42:11.443558+0000","last_peered":"2024-05-03T22:42:11.443558+0000","last_clean":"2024-05-03T22:42:11.443558+0000","last_became_active":"2024-05-03T22:42:11.441682+0000","last_became_peered":"2024-05-03T22:42:11.441682+0000","last_unstale":"2024-05-03T22:42:11.443558+0000","last_undegraded":"2024-05-03T22:42:11.443558+0000","last_fullsized":"2024-05-03T22:42:11.443558+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:03:42.054789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426635+0000","last_change":"2024-05-03T22:40:25.086337+0000","last_active":"2024-05-03T22:42:11.426635+0000","last_peered":"2024-05-03T22:42:11.426635+0000","last_clean":"2024-05-03T22:42:11.426635+0000","last_became_active":"2024-05-03T22:40:25.085878+0000","last_became_peered":"2024-05-03T22:40:25.085878+0000","last_unstale":"2024-05-03T22:42:11.426635+0000","last_undegraded":"2024-05-03T22:42:11.426635+0000","last_fullsized":"2024-05-03T22:42:11.426635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:54.855929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425686+0000","last_change":"2024-05-03T22:40:06.694509+0000","last_active":"2024-05-03T22:42:11.425686+0000","last_peered":"2024-05-03T22:42:11.425686+0000","last_clean":"2024-05-03T22:42:11.425686+0000","last_became_active":"2024-05-03T22:40:06.693782+0000","last_became_peered":"2024-05-03T22:40:06.693782+0000","last_unstale":"2024-05-03T22:42:11.425686+0000","last_undegraded":"2024-05-03T22:42:11.425686+0000","last_fullsized":"2024-05-03T22:42:11.425686+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:44:19.457506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748990+0000","last_change":"2024-05-03T22:40:11.777600+0000","last_active":"2024-05-03T22:42:11.748990+0000","last_peered":"2024-05-03T22:42:11.748990+0000","last_clean":"2024-05-03T22:42:11.748990+0000","last_became_active":"2024-05-03T22:40:11.777231+0000","last_became_peered":"2024-05-03T22:40:11.777231+0000","last_unstale":"2024-05-03T22:42:11.748990+0000","last_undegraded":"2024-05-03T22:42:11.748990+0000","last_fullsized":"2024-05-03T22:42:11.748990+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:47.701482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534554+0000","last_change":"2024-05-03T22:40:25.077289+0000","last_active":"2024-05-03T22:42:11.534554+0000","last_peered":"2024-05-03T22:42:11.534554+0000","last_clean":"2024-05-03T22:42:11.534554+0000","last_became_active":"2024-05-03T22:40:25.075368+0000","last_became_peered":"2024-05-03T22:40:25.075368+0000","last_unstale":"2024-05-03T22:42:11.534554+0000","last_undegraded":"2024-05-03T22:42:11.534554+0000","last_fullsized":"2024-05-03T22:42:11.534554+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:56:12.352251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.435281+0000","last_change":"2024-05-03T22:40:06.677202+0000","last_active":"2024-05-03T22:42:11.435281+0000","last_peered":"2024-05-03T22:42:11.435281+0000","last_clean":"2024-05-03T22:42:11.435281+0000","last_became_active":"2024-05-03T22:40:06.674152+0000","last_became_peered":"2024-05-03T22:40:06.674152+0000","last_unstale":"2024-05-03T22:42:11.435281+0000","last_undegraded":"2024-05-03T22:42:11.435281+0000","last_fullsized":"2024-05-03T22:42:11.435281+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:09:18.631126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.538163+0000","last_change":"2024-05-03T22:42:11.538163+0000","last_active":"2024-05-03T22:42:11.538163+0000","last_peered":"2024-05-03T22:42:11.538163+0000","last_clean":"2024-05-03T22:42:11.538163+0000","last_became_active":"2024-05-03T22:42:11.536762+0000","last_became_peered":"2024-05-03T22:42:11.536762+0000","last_unstale":"2024-05-03T22:42:11.538163+0000","last_undegraded":"2024-05-03T22:42:11.538163+0000","last_fullsized":"2024-05-03T22:42:11.538163+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:29:56.947667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740873+0000","last_change":"2024-05-03T22:40:25.076722+0000","last_active":"2024-05-03T22:42:11.740873+0000","last_peered":"2024-05-03T22:42:11.740873+0000","last_clean":"2024-05-03T22:42:11.740873+0000","last_became_active":"2024-05-03T22:40:25.076251+0000","last_became_peered":"2024-05-03T22:40:25.076251+0000","last_unstale":"2024-05-03T22:42:11.740873+0000","last_undegraded":"2024-05-03T22:42:11.740873+0000","last_fullsized":"2024-05-03T22:42:11.740873+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:34:12.236790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"87'3","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748436+0000","last_change":"2024-05-03T22:40:06.690531+0000","last_active":"2024-05-03T22:42:11.748436+0000","last_peered":"2024-05-03T22:42:11.748436+0000","last_clean":"2024-05-03T22:42:11.748436+0000","last_became_active":"2024-05-03T22:40:06.690110+0000","last_became_peered":"2024-05-03T22:40:06.690110+0000","last_unstale":"2024-05-03T22:42:11.748436+0000","last_undegraded":"2024-05-03T22:42:11.748436+0000","last_fullsized":"2024-05-03T22:42:11.748436+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:51.350473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428218+0000","last_change":"2024-05-03T22:40:11.774633+0000","last_active":"2024-05-03T22:42:11.428218+0000","last_peered":"2024-05-03T22:42:11.428218+0000","last_clean":"2024-05-03T22:42:11.428218+0000","last_became_active":"2024-05-03T22:40:11.774294+0000","last_became_peered":"2024-05-03T22:40:11.774294+0000","last_unstale":"2024-05-03T22:42:11.428218+0000","last_undegraded":"2024-05-03T22:42:11.428218+0000","last_fullsized":"2024-05-03T22:42:11.428218+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:11:56.967077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748125+0000","last_change":"2024-05-03T22:40:25.085649+0000","last_active":"2024-05-03T22:42:11.748125+0000","last_peered":"2024-05-03T22:42:11.748125+0000","last_clean":"2024-05-03T22:42:11.748125+0000","last_became_active":"2024-05-03T22:40:25.078260+0000","last_became_peered":"2024-05-03T22:40:25.078260+0000","last_unstale":"2024-05-03T22:42:11.748125+0000","last_undegraded":"2024-05-03T22:42:11.748125+0000","last_fullsized":"2024-05-03T22:42:11.748125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:29.040741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":289,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:43:42.601555+0000","last_change":"2024-05-03T22:40:06.688665+0000","last_active":"2024-05-03T22:43:42.601555+0000","last_peered":"2024-05-03T22:43:42.601555+0000","last_clean":"2024-05-03T22:43:42.601555+0000","last_became_active":"2024-05-03T22:40:06.687944+0000","last_became_peered":"2024-05-03T22:40:06.687944+0000","last_unstale":"2024-05-03T22:43:42.601555+0000","last_undegraded":"2024-05-03T22:43:42.601555+0000","last_fullsized":"2024-05-03T22:43:42.601555+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:14:43.679499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":240,"num_read_kb":240,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.441711+0000","last_change":"2024-05-03T22:40:11.774446+0000","last_active":"2024-05-03T22:42:11.441711+0000","last_peered":"2024-05-03T22:42:11.441711+0000","last_clean":"2024-05-03T22:42:11.441711+0000","last_became_active":"2024-05-03T22:40:11.774067+0000","last_became_peered":"2024-05-03T22:40:11.774067+0000","last_unstale":"2024-05-03T22:42:11.441711+0000","last_undegraded":"2024-05-03T22:42:11.441711+0000","last_fullsized":"2024-05-03T22:42:11.441711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:31:34.747963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426370+0000","last_change":"2024-05-03T22:40:25.081436+0000","last_active":"2024-05-03T22:42:11.426370+0000","last_peered":"2024-05-03T22:42:11.426370+0000","last_clean":"2024-05-03T22:42:11.426370+0000","last_became_active":"2024-05-03T22:40:25.080961+0000","last_became_peered":"2024-05-03T22:40:25.080961+0000","last_unstale":"2024-05-03T22:42:11.426370+0000","last_undegraded":"2024-05-03T22:42:11.426370+0000","last_fullsized":"2024-05-03T22:42:11.426370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:40:59.061298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750552+0000","last_change":"2024-05-03T22:40:06.694998+0000","last_active":"2024-05-03T22:42:11.750552+0000","last_peered":"2024-05-03T22:42:11.750552+0000","last_clean":"2024-05-03T22:42:11.750552+0000","last_became_active":"2024-05-03T22:40:06.691406+0000","last_became_peered":"2024-05-03T22:40:06.691406+0000","last_unstale":"2024-05-03T22:42:11.750552+0000","last_undegraded":"2024-05-03T22:42:11.750552+0000","last_fullsized":"2024-05-03T22:42:11.750552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:14:31.905257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740844+0000","last_change":"2024-05-03T22:40:11.782311+0000","last_active":"2024-05-03T22:42:11.740844+0000","last_peered":"2024-05-03T22:42:11.740844+0000","last_clean":"2024-05-03T22:42:11.740844+0000","last_became_active":"2024-05-03T22:40:11.778580+0000","last_became_peered":"2024-05-03T22:40:11.778580+0000","last_unstale":"2024-05-03T22:42:11.740844+0000","last_undegraded":"2024-05-03T22:42:11.740844+0000","last_fullsized":"2024-05-03T22:42:11.740844+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:11:01.150639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748819+0000","last_change":"2024-05-03T22:41:11.166437+0000","last_active":"2024-05-03T22:42:11.748819+0000","last_peered":"2024-05-03T22:42:11.748819+0000","last_clean":"2024-05-03T22:42:11.748819+0000","last_became_active":"2024-05-03T22:41:11.165246+0000","last_became_peered":"2024-05-03T22:41:11.165246+0000","last_unstale":"2024-05-03T22:42:11.748819+0000","last_undegraded":"2024-05-03T22:42:11.748819+0000","last_fullsized":"2024-05-03T22:42:11.748819+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:37:25.103244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748872+0000","last_change":"2024-05-03T22:40:06.749132+0000","last_active":"2024-05-03T22:42:11.748872+0000","last_peered":"2024-05-03T22:42:11.748872+0000","last_clean":"2024-05-03T22:42:11.748872+0000","last_became_active":"2024-05-03T22:40:06.748356+0000","last_became_peered":"2024-05-03T22:40:06.748356+0000","last_unstale":"2024-05-03T22:42:11.748872+0000","last_undegraded":"2024-05-03T22:42:11.748872+0000","last_fullsized":"2024-05-03T22:42:11.748872+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:17:48.243084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439747+0000","last_change":"2024-05-03T22:40:11.781238+0000","last_active":"2024-05-03T22:42:11.439747+0000","last_peered":"2024-05-03T22:42:11.439747+0000","last_clean":"2024-05-03T22:42:11.439747+0000","last_became_active":"2024-05-03T22:40:11.780812+0000","last_became_peered":"2024-05-03T22:40:11.780812+0000","last_unstale":"2024-05-03T22:42:11.439747+0000","last_undegraded":"2024-05-03T22:42:11.439747+0000","last_fullsized":"2024-05-03T22:42:11.439747+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:26:25.470321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.430241+0000","last_change":"2024-05-03T22:40:25.084169+0000","last_active":"2024-05-03T22:42:11.430241+0000","last_peered":"2024-05-03T22:42:11.430241+0000","last_clean":"2024-05-03T22:42:11.430241+0000","last_became_active":"2024-05-03T22:40:25.083547+0000","last_became_peered":"2024-05-03T22:40:25.083547+0000","last_unstale":"2024-05-03T22:42:11.430241+0000","last_undegraded":"2024-05-03T22:42:11.430241+0000","last_fullsized":"2024-05-03T22:42:11.430241+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:43:46.218698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'36","reported_seq":330,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:43:42.601577+0000","last_change":"2024-05-03T22:40:06.692333+0000","last_active":"2024-05-03T22:43:42.601577+0000","last_peered":"2024-05-03T22:43:42.601577+0000","last_clean":"2024-05-03T22:43:42.601577+0000","last_became_active":"2024-05-03T22:40:06.691737+0000","last_became_peered":"2024-05-03T22:40:06.691737+0000","last_unstale":"2024-05-03T22:43:42.601577+0000","last_undegraded":"2024-05-03T22:43:42.601577+0000","last_fullsized":"2024-05-03T22:43:42.601577+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:41:39.669559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60214,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":249,"num_read_kb":184,"num_write":38,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433443+0000","last_change":"2024-05-03T22:40:11.782887+0000","last_active":"2024-05-03T22:42:11.433443+0000","last_peered":"2024-05-03T22:42:11.433443+0000","last_clean":"2024-05-03T22:42:11.433443+0000","last_became_active":"2024-05-03T22:40:11.782098+0000","last_became_peered":"2024-05-03T22:40:11.782098+0000","last_unstale":"2024-05-03T22:42:11.433443+0000","last_undegraded":"2024-05-03T22:42:11.433443+0000","last_fullsized":"2024-05-03T22:42:11.433443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:07:14.661890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749490+0000","last_change":"2024-05-03T22:40:25.079794+0000","last_active":"2024-05-03T22:42:11.749490+0000","last_peered":"2024-05-03T22:42:11.749490+0000","last_clean":"2024-05-03T22:42:11.749490+0000","last_became_active":"2024-05-03T22:40:25.078516+0000","last_became_peered":"2024-05-03T22:40:25.078516+0000","last_unstale":"2024-05-03T22:42:11.749490+0000","last_undegraded":"2024-05-03T22:42:11.749490+0000","last_fullsized":"2024-05-03T22:42:11.749490+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:55.775154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'9","reported_seq":56,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426292+0000","last_change":"2024-05-03T22:40:06.689509+0000","last_active":"2024-05-03T22:42:11.426292+0000","last_peered":"2024-05-03T22:42:11.426292+0000","last_clean":"2024-05-03T22:42:11.426292+0000","last_became_active":"2024-05-03T22:40:06.688937+0000","last_became_peered":"2024-05-03T22:40:06.688937+0000","last_unstale":"2024-05-03T22:42:11.426292+0000","last_undegraded":"2024-05-03T22:42:11.426292+0000","last_fullsized":"2024-05-03T22:42:11.426292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:13:48.971563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.431859+0000","last_change":"2024-05-03T22:40:11.780448+0000","last_active":"2024-05-03T22:42:11.431859+0000","last_peered":"2024-05-03T22:42:11.431859+0000","last_clean":"2024-05-03T22:42:11.431859+0000","last_became_active":"2024-05-03T22:40:11.780030+0000","last_became_peered":"2024-05-03T22:40:11.780030+0000","last_unstale":"2024-05-03T22:42:11.431859+0000","last_undegraded":"2024-05-03T22:42:11.431859+0000","last_fullsized":"2024-05-03T22:42:11.431859+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:56.207342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534274+0000","last_change":"2024-05-03T22:40:25.075804+0000","last_active":"2024-05-03T22:42:11.534274+0000","last_peered":"2024-05-03T22:42:11.534274+0000","last_clean":"2024-05-03T22:42:11.534274+0000","last_became_active":"2024-05-03T22:40:25.075326+0000","last_became_peered":"2024-05-03T22:40:25.075326+0000","last_unstale":"2024-05-03T22:42:11.534274+0000","last_undegraded":"2024-05-03T22:42:11.534274+0000","last_fullsized":"2024-05-03T22:42:11.534274+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:39:56.065804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"87'5","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748659+0000","last_change":"2024-05-03T22:40:06.690432+0000","last_active":"2024-05-03T22:42:11.748659+0000","last_peered":"2024-05-03T22:42:11.748659+0000","last_clean":"2024-05-03T22:42:11.748659+0000","last_became_active":"2024-05-03T22:40:06.688957+0000","last_became_peered":"2024-05-03T22:40:06.688957+0000","last_unstale":"2024-05-03T22:42:11.748659+0000","last_undegraded":"2024-05-03T22:42:11.748659+0000","last_fullsized":"2024-05-03T22:42:11.748659+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:59:22.523855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750039+0000","last_change":"2024-05-03T22:40:11.789816+0000","last_active":"2024-05-03T22:42:11.750039+0000","last_peered":"2024-05-03T22:42:11.750039+0000","last_clean":"2024-05-03T22:42:11.750039+0000","last_became_active":"2024-05-03T22:40:11.789439+0000","last_became_peered":"2024-05-03T22:40:11.789439+0000","last_unstale":"2024-05-03T22:42:11.750039+0000","last_undegraded":"2024-05-03T22:42:11.750039+0000","last_fullsized":"2024-05-03T22:42:11.750039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:24:52.874791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428754+0000","last_change":"2024-05-03T22:40:25.091156+0000","last_active":"2024-05-03T22:42:11.428754+0000","last_peered":"2024-05-03T22:42:11.428754+0000","last_clean":"2024-05-03T22:42:11.428754+0000","last_became_active":"2024-05-03T22:40:25.090584+0000","last_became_peered":"2024-05-03T22:40:25.090584+0000","last_unstale":"2024-05-03T22:42:11.428754+0000","last_undegraded":"2024-05-03T22:42:11.428754+0000","last_fullsized":"2024-05-03T22:42:11.428754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:12:47.194197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":175,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:43:42.602205+0000","last_change":"2024-05-03T22:40:06.687847+0000","last_active":"2024-05-03T22:43:42.602205+0000","last_peered":"2024-05-03T22:43:42.602205+0000","last_clean":"2024-05-03T22:43:42.602205+0000","last_became_active":"2024-05-03T22:40:06.685784+0000","last_became_peered":"2024-05-03T22:40:06.685784+0000","last_unstale":"2024-05-03T22:43:42.602205+0000","last_undegraded":"2024-05-03T22:43:42.602205+0000","last_fullsized":"2024-05-03T22:43:42.602205+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:31:36.403709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748408+0000","last_change":"2024-05-03T22:40:11.777881+0000","last_active":"2024-05-03T22:42:11.748408+0000","last_peered":"2024-05-03T22:42:11.748408+0000","last_clean":"2024-05-03T22:42:11.748408+0000","last_became_active":"2024-05-03T22:40:11.777142+0000","last_became_peered":"2024-05-03T22:40:11.777142+0000","last_unstale":"2024-05-03T22:42:11.748408+0000","last_undegraded":"2024-05-03T22:42:11.748408+0000","last_fullsized":"2024-05-03T22:42:11.748408+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:43:19.150547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.437231+0000","last_change":"2024-05-03T22:40:25.072488+0000","last_active":"2024-05-03T22:42:11.437231+0000","last_peered":"2024-05-03T22:42:11.437231+0000","last_clean":"2024-05-03T22:42:11.437231+0000","last_became_active":"2024-05-03T22:40:25.072030+0000","last_became_peered":"2024-05-03T22:40:25.072030+0000","last_unstale":"2024-05-03T22:42:11.437231+0000","last_undegraded":"2024-05-03T22:42:11.437231+0000","last_fullsized":"2024-05-03T22:42:11.437231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:01:13.875349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'17","reported_seq":63,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.432823+0000","last_change":"2024-05-03T22:40:06.748069+0000","last_active":"2024-05-03T22:42:11.432823+0000","last_peered":"2024-05-03T22:42:11.432823+0000","last_clean":"2024-05-03T22:42:11.432823+0000","last_became_active":"2024-05-03T22:40:06.747095+0000","last_became_peered":"2024-05-03T22:40:06.747095+0000","last_unstale":"2024-05-03T22:42:11.432823+0000","last_undegraded":"2024-05-03T22:42:11.432823+0000","last_fullsized":"2024-05-03T22:42:11.432823+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:56:39.715496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748810+0000","last_change":"2024-05-03T22:40:11.780695+0000","last_active":"2024-05-03T22:42:11.748810+0000","last_peered":"2024-05-03T22:42:11.748810+0000","last_clean":"2024-05-03T22:42:11.748810+0000","last_became_active":"2024-05-03T22:40:11.780103+0000","last_became_peered":"2024-05-03T22:40:11.780103+0000","last_unstale":"2024-05-03T22:42:11.748810+0000","last_undegraded":"2024-05-03T22:42:11.748810+0000","last_fullsized":"2024-05-03T22:42:11.748810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:29:22.862772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748647+0000","last_change":"2024-05-03T22:40:25.088547+0000","last_active":"2024-05-03T22:42:11.748647+0000","last_peered":"2024-05-03T22:42:11.748647+0000","last_clean":"2024-05-03T22:42:11.748647+0000","last_became_active":"2024-05-03T22:40:25.088046+0000","last_became_peered":"2024-05-03T22:40:25.088046+0000","last_unstale":"2024-05-03T22:42:11.748647+0000","last_undegraded":"2024-05-03T22:42:11.748647+0000","last_fullsized":"2024-05-03T22:42:11.748647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:18:15.904858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433451+0000","last_change":"2024-05-03T22:40:06.691109+0000","last_active":"2024-05-03T22:42:11.433451+0000","last_peered":"2024-05-03T22:42:11.433451+0000","last_clean":"2024-05-03T22:42:11.433451+0000","last_became_active":"2024-05-03T22:40:06.690539+0000","last_became_peered":"2024-05-03T22:40:06.690539+0000","last_unstale":"2024-05-03T22:42:11.433451+0000","last_undegraded":"2024-05-03T22:42:11.433451+0000","last_fullsized":"2024-05-03T22:42:11.433451+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:18:00.701472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534918+0000","last_change":"2024-05-03T22:40:11.774465+0000","last_active":"2024-05-03T22:42:11.534918+0000","last_peered":"2024-05-03T22:42:11.534918+0000","last_clean":"2024-05-03T22:42:11.534918+0000","last_became_active":"2024-05-03T22:40:11.772816+0000","last_became_peered":"2024-05-03T22:40:11.772816+0000","last_unstale":"2024-05-03T22:42:11.534918+0000","last_undegraded":"2024-05-03T22:42:11.534918+0000","last_fullsized":"2024-05-03T22:42:11.534918+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:14:28.206641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433133+0000","last_change":"2024-05-03T22:40:25.089301+0000","last_active":"2024-05-03T22:42:11.433133+0000","last_peered":"2024-05-03T22:42:11.433133+0000","last_clean":"2024-05-03T22:42:11.433133+0000","last_became_active":"2024-05-03T22:40:25.086336+0000","last_became_peered":"2024-05-03T22:40:25.086336+0000","last_unstale":"2024-05-03T22:42:11.433133+0000","last_undegraded":"2024-05-03T22:42:11.433133+0000","last_fullsized":"2024-05-03T22:42:11.433133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:25:07.377584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428951+0000","last_change":"2024-05-03T22:40:06.750880+0000","last_active":"2024-05-03T22:42:11.428951+0000","last_peered":"2024-05-03T22:42:11.428951+0000","last_clean":"2024-05-03T22:42:11.428951+0000","last_became_active":"2024-05-03T22:40:06.750288+0000","last_became_peered":"2024-05-03T22:40:06.750288+0000","last_unstale":"2024-05-03T22:42:11.428951+0000","last_undegraded":"2024-05-03T22:42:11.428951+0000","last_fullsized":"2024-05-03T22:42:11.428951+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:29:09.545101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.427517+0000","last_change":"2024-05-03T22:40:11.769141+0000","last_active":"2024-05-03T22:42:11.427517+0000","last_peered":"2024-05-03T22:42:11.427517+0000","last_clean":"2024-05-03T22:42:11.427517+0000","last_became_active":"2024-05-03T22:40:11.768778+0000","last_became_peered":"2024-05-03T22:40:11.768778+0000","last_unstale":"2024-05-03T22:42:11.427517+0000","last_undegraded":"2024-05-03T22:42:11.427517+0000","last_fullsized":"2024-05-03T22:42:11.427517+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:15:45.811547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433113+0000","last_change":"2024-05-03T22:40:25.080100+0000","last_active":"2024-05-03T22:42:11.433113+0000","last_peered":"2024-05-03T22:42:11.433113+0000","last_clean":"2024-05-03T22:42:11.433113+0000","last_became_active":"2024-05-03T22:40:25.077009+0000","last_became_peered":"2024-05-03T22:40:25.077009+0000","last_unstale":"2024-05-03T22:42:11.433113+0000","last_undegraded":"2024-05-03T22:42:11.433113+0000","last_fullsized":"2024-05-03T22:42:11.433113+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:40:24.771677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"87'5","reported_seq":141,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:43:40.581820+0000","last_change":"2024-05-03T22:41:11.166956+0000","last_active":"2024-05-03T22:43:40.581820+0000","last_peered":"2024-05-03T22:43:40.581820+0000","last_clean":"2024-05-03T22:43:40.581820+0000","last_became_active":"2024-05-03T22:41:11.165811+0000","last_became_peered":"2024-05-03T22:41:11.165811+0000","last_unstale":"2024-05-03T22:43:40.581820+0000","last_undegraded":"2024-05-03T22:43:40.581820+0000","last_fullsized":"2024-05-03T22:43:40.581820+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:39:37.554975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426142+0000","last_change":"2024-05-03T22:40:11.776660+0000","last_active":"2024-05-03T22:42:11.426142+0000","last_peered":"2024-05-03T22:42:11.426142+0000","last_clean":"2024-05-03T22:42:11.426142+0000","last_became_active":"2024-05-03T22:40:11.775877+0000","last_became_peered":"2024-05-03T22:40:11.775877+0000","last_unstale":"2024-05-03T22:42:11.426142+0000","last_undegraded":"2024-05-03T22:42:11.426142+0000","last_fullsized":"2024-05-03T22:42:11.426142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:12:34.902276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.436537+0000","last_change":"2024-05-03T22:40:25.078900+0000","last_active":"2024-05-03T22:42:11.436537+0000","last_peered":"2024-05-03T22:42:11.436537+0000","last_clean":"2024-05-03T22:42:11.436537+0000","last_became_active":"2024-05-03T22:40:25.078440+0000","last_became_peered":"2024-05-03T22:40:25.078440+0000","last_unstale":"2024-05-03T22:42:11.436537+0000","last_undegraded":"2024-05-03T22:42:11.436537+0000","last_fullsized":"2024-05-03T22:42:11.436537+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:04:02.204303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748648+0000","last_change":"2024-05-03T22:40:11.780141+0000","last_active":"2024-05-03T22:42:11.748648+0000","last_peered":"2024-05-03T22:42:11.748648+0000","last_clean":"2024-05-03T22:42:11.748648+0000","last_became_active":"2024-05-03T22:40:11.779740+0000","last_became_peered":"2024-05-03T22:40:11.779740+0000","last_unstale":"2024-05-03T22:42:11.748648+0000","last_undegraded":"2024-05-03T22:42:11.748648+0000","last_fullsized":"2024-05-03T22:42:11.748648+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:48:14.419409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":172,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:43:42.600509+0000","last_change":"2024-05-03T22:40:06.747825+0000","last_active":"2024-05-03T22:43:42.600509+0000","last_peered":"2024-05-03T22:43:42.600509+0000","last_clean":"2024-05-03T22:43:42.600509+0000","last_became_active":"2024-05-03T22:40:06.747345+0000","last_became_peered":"2024-05-03T22:40:06.747345+0000","last_unstale":"2024-05-03T22:43:42.600509+0000","last_undegraded":"2024-05-03T22:43:42.600509+0000","last_fullsized":"2024-05-03T22:43:42.600509+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:23:58.770807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750186+0000","last_change":"2024-05-03T22:40:25.076382+0000","last_active":"2024-05-03T22:42:11.750186+0000","last_peered":"2024-05-03T22:42:11.750186+0000","last_clean":"2024-05-03T22:42:11.750186+0000","last_became_active":"2024-05-03T22:40:25.075866+0000","last_became_peered":"2024-05-03T22:40:25.075866+0000","last_unstale":"2024-05-03T22:42:11.750186+0000","last_undegraded":"2024-05-03T22:42:11.750186+0000","last_fullsized":"2024-05-03T22:42:11.750186+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:10:58.048190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748398+0000","last_change":"2024-05-03T22:40:11.768232+0000","last_active":"2024-05-03T22:42:11.748398+0000","last_peered":"2024-05-03T22:42:11.748398+0000","last_clean":"2024-05-03T22:42:11.748398+0000","last_became_active":"2024-05-03T22:40:11.767784+0000","last_became_peered":"2024-05-03T22:40:11.767784+0000","last_unstale":"2024-05-03T22:42:11.748398+0000","last_undegraded":"2024-05-03T22:42:11.748398+0000","last_fullsized":"2024-05-03T22:42:11.748398+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:37:41.299588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":54,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748610+0000","last_change":"2024-05-03T22:40:06.681934+0000","last_active":"2024-05-03T22:42:11.748610+0000","last_peered":"2024-05-03T22:42:11.748610+0000","last_clean":"2024-05-03T22:42:11.748610+0000","last_became_active":"2024-05-03T22:40:06.675829+0000","last_became_peered":"2024-05-03T22:40:06.675829+0000","last_unstale":"2024-05-03T22:42:11.748610+0000","last_undegraded":"2024-05-03T22:42:11.748610+0000","last_fullsized":"2024-05-03T22:42:11.748610+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:06:23.890364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":116,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748263+0000","last_change":"2024-05-03T22:38:10.625763+0000","last_active":"2024-05-03T22:42:11.748263+0000","last_peered":"2024-05-03T22:42:11.748263+0000","last_clean":"2024-05-03T22:42:11.748263+0000","last_became_active":"2024-05-03T22:38:10.607711+0000","last_became_peered":"2024-05-03T22:38:10.607711+0000","last_unstale":"2024-05-03T22:42:11.748263+0000","last_undegraded":"2024-05-03T22:42:11.748263+0000","last_fullsized":"2024-05-03T22:42:11.748263+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:33:25.181816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:33:25.181816+0000","last_clean_scrub_stamp":"2024-05-03T22:33:25.181816+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:10:54.973897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749392+0000","last_change":"2024-05-03T22:41:11.623002+0000","last_active":"2024-05-03T22:42:11.749392+0000","last_peered":"2024-05-03T22:42:11.749392+0000","last_clean":"2024-05-03T22:42:11.749392+0000","last_became_active":"2024-05-03T22:41:11.621904+0000","last_became_peered":"2024-05-03T22:41:11.621904+0000","last_unstale":"2024-05-03T22:42:11.749392+0000","last_undegraded":"2024-05-03T22:42:11.749392+0000","last_fullsized":"2024-05-03T22:42:11.749392+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:01:12.917296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.442292+0000","last_change":"2024-05-03T22:42:11.440087+0000","last_active":"2024-05-03T22:42:11.442292+0000","last_peered":"2024-05-03T22:42:11.442292+0000","last_clean":"2024-05-03T22:42:11.442292+0000","last_became_active":"2024-05-03T22:42:11.438630+0000","last_became_peered":"2024-05-03T22:42:11.438630+0000","last_unstale":"2024-05-03T22:42:11.442292+0000","last_undegraded":"2024-05-03T22:42:11.442292+0000","last_fullsized":"2024-05-03T22:42:11.442292+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:21:37.660638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":55,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748282+0000","last_change":"2024-05-03T22:41:10.787499+0000","last_active":"2024-05-03T22:42:11.748282+0000","last_peered":"2024-05-03T22:42:11.748282+0000","last_clean":"2024-05-03T22:42:11.748282+0000","last_became_active":"2024-05-03T22:41:10.786987+0000","last_became_peered":"2024-05-03T22:41:10.786987+0000","last_unstale":"2024-05-03T22:42:11.748282+0000","last_undegraded":"2024-05-03T22:42:11.748282+0000","last_fullsized":"2024-05-03T22:42:11.748282+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:18:39.460516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534038+0000","last_change":"2024-05-03T22:40:25.072522+0000","last_active":"2024-05-03T22:42:11.534038+0000","last_peered":"2024-05-03T22:42:11.534038+0000","last_clean":"2024-05-03T22:42:11.534038+0000","last_became_active":"2024-05-03T22:40:25.071988+0000","last_became_peered":"2024-05-03T22:40:25.071988+0000","last_unstale":"2024-05-03T22:42:11.534038+0000","last_undegraded":"2024-05-03T22:42:11.534038+0000","last_fullsized":"2024-05-03T22:42:11.534038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:36:49.992077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'4","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433575+0000","last_change":"2024-05-03T22:40:06.748316+0000","last_active":"2024-05-03T22:42:11.433575+0000","last_peered":"2024-05-03T22:42:11.433575+0000","last_clean":"2024-05-03T22:42:11.433575+0000","last_became_active":"2024-05-03T22:40:06.747321+0000","last_became_peered":"2024-05-03T22:40:06.747321+0000","last_unstale":"2024-05-03T22:42:11.433575+0000","last_undegraded":"2024-05-03T22:42:11.433575+0000","last_fullsized":"2024-05-03T22:42:11.433575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:59:52.305810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433571+0000","last_change":"2024-05-03T22:40:11.773115+0000","last_active":"2024-05-03T22:42:11.433571+0000","last_peered":"2024-05-03T22:42:11.433571+0000","last_clean":"2024-05-03T22:42:11.433571+0000","last_became_active":"2024-05-03T22:40:11.771352+0000","last_became_peered":"2024-05-03T22:40:11.771352+0000","last_unstale":"2024-05-03T22:42:11.433571+0000","last_undegraded":"2024-05-03T22:42:11.433571+0000","last_fullsized":"2024-05-03T22:42:11.433571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:24:36.913141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748104+0000","last_change":"2024-05-03T22:40:25.083290+0000","last_active":"2024-05-03T22:42:11.748104+0000","last_peered":"2024-05-03T22:42:11.748104+0000","last_clean":"2024-05-03T22:42:11.748104+0000","last_became_active":"2024-05-03T22:40:25.077556+0000","last_became_peered":"2024-05-03T22:40:25.077556+0000","last_unstale":"2024-05-03T22:42:11.748104+0000","last_undegraded":"2024-05-03T22:42:11.748104+0000","last_fullsized":"2024-05-03T22:42:11.748104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:43.848783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'14","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:16.180229+0000","last_change":"2024-05-03T22:41:10.795185+0000","last_active":"2024-05-03T22:42:16.180229+0000","last_peered":"2024-05-03T22:42:16.180229+0000","last_clean":"2024-05-03T22:42:16.180229+0000","last_became_active":"2024-05-03T22:41:10.790617+0000","last_became_peered":"2024-05-03T22:41:10.790617+0000","last_unstale":"2024-05-03T22:42:16.180229+0000","last_undegraded":"2024-05-03T22:42:16.180229+0000","last_fullsized":"2024-05-03T22:42:16.180229+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:15:00.364227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749106+0000","last_change":"2024-05-03T22:40:11.769663+0000","last_active":"2024-05-03T22:42:11.749106+0000","last_peered":"2024-05-03T22:42:11.749106+0000","last_clean":"2024-05-03T22:42:11.749106+0000","last_became_active":"2024-05-03T22:40:11.769330+0000","last_became_peered":"2024-05-03T22:40:11.769330+0000","last_unstale":"2024-05-03T22:42:11.749106+0000","last_undegraded":"2024-05-03T22:42:11.749106+0000","last_fullsized":"2024-05-03T22:42:11.749106+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:44:12.326952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425185+0000","last_change":"2024-05-03T22:40:25.079604+0000","last_active":"2024-05-03T22:42:11.425185+0000","last_peered":"2024-05-03T22:42:11.425185+0000","last_clean":"2024-05-03T22:42:11.425185+0000","last_became_active":"2024-05-03T22:40:25.076067+0000","last_became_peered":"2024-05-03T22:40:25.076067+0000","last_unstale":"2024-05-03T22:42:11.425185+0000","last_undegraded":"2024-05-03T22:42:11.425185+0000","last_fullsized":"2024-05-03T22:42:11.425185+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:27:03.905659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":53,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749519+0000","last_change":"2024-05-03T22:40:07.327718+0000","last_active":"2024-05-03T22:42:11.749519+0000","last_peered":"2024-05-03T22:42:11.749519+0000","last_clean":"2024-05-03T22:42:11.749519+0000","last_became_active":"2024-05-03T22:40:07.326930+0000","last_became_peered":"2024-05-03T22:40:07.326930+0000","last_unstale":"2024-05-03T22:42:11.749519+0000","last_undegraded":"2024-05-03T22:42:11.749519+0000","last_fullsized":"2024-05-03T22:42:11.749519+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:46:55.497971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740985+0000","last_change":"2024-05-03T22:40:11.766023+0000","last_active":"2024-05-03T22:42:11.740985+0000","last_peered":"2024-05-03T22:42:11.740985+0000","last_clean":"2024-05-03T22:42:11.740985+0000","last_became_active":"2024-05-03T22:40:11.765263+0000","last_became_peered":"2024-05-03T22:40:11.765263+0000","last_unstale":"2024-05-03T22:42:11.740985+0000","last_undegraded":"2024-05-03T22:42:11.740985+0000","last_fullsized":"2024-05-03T22:42:11.740985+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:55.002669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748827+0000","last_change":"2024-05-03T22:40:25.085411+0000","last_active":"2024-05-03T22:42:11.748827+0000","last_peered":"2024-05-03T22:42:11.748827+0000","last_clean":"2024-05-03T22:42:11.748827+0000","last_became_active":"2024-05-03T22:40:25.084813+0000","last_became_peered":"2024-05-03T22:40:25.084813+0000","last_unstale":"2024-05-03T22:42:11.748827+0000","last_undegraded":"2024-05-03T22:42:11.748827+0000","last_fullsized":"2024-05-03T22:42:11.748827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:41:38.455648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439805+0000","last_change":"2024-05-03T22:40:06.748099+0000","last_active":"2024-05-03T22:42:11.439805+0000","last_peered":"2024-05-03T22:42:11.439805+0000","last_clean":"2024-05-03T22:42:11.439805+0000","last_became_active":"2024-05-03T22:40:06.747702+0000","last_became_peered":"2024-05-03T22:40:06.747702+0000","last_unstale":"2024-05-03T22:42:11.439805+0000","last_undegraded":"2024-05-03T22:42:11.439805+0000","last_fullsized":"2024-05-03T22:42:11.439805+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:12:09.736986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433000+0000","last_change":"2024-05-03T22:40:11.780914+0000","last_active":"2024-05-03T22:42:11.433000+0000","last_peered":"2024-05-03T22:42:11.433000+0000","last_clean":"2024-05-03T22:42:11.433000+0000","last_became_active":"2024-05-03T22:40:11.780481+0000","last_became_peered":"2024-05-03T22:40:11.780481+0000","last_unstale":"2024-05-03T22:42:11.433000+0000","last_undegraded":"2024-05-03T22:42:11.433000+0000","last_fullsized":"2024-05-03T22:42:11.433000+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:34:11.676590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428877+0000","last_change":"2024-05-03T22:40:25.091028+0000","last_active":"2024-05-03T22:42:11.428877+0000","last_peered":"2024-05-03T22:42:11.428877+0000","last_clean":"2024-05-03T22:42:11.428877+0000","last_became_active":"2024-05-03T22:40:25.090516+0000","last_became_peered":"2024-05-03T22:40:25.090516+0000","last_unstale":"2024-05-03T22:42:11.428877+0000","last_undegraded":"2024-05-03T22:42:11.428877+0000","last_fullsized":"2024-05-03T22:42:11.428877+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:16:17.803991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'7","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748234+0000","last_change":"2024-05-03T22:40:06.686659+0000","last_active":"2024-05-03T22:42:11.748234+0000","last_peered":"2024-05-03T22:42:11.748234+0000","last_clean":"2024-05-03T22:42:11.748234+0000","last_became_active":"2024-05-03T22:40:06.686049+0000","last_became_peered":"2024-05-03T22:40:06.686049+0000","last_unstale":"2024-05-03T22:42:11.748234+0000","last_undegraded":"2024-05-03T22:42:11.748234+0000","last_fullsized":"2024-05-03T22:42:11.748234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:18:52.198642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534725+0000","last_change":"2024-05-03T22:40:11.770188+0000","last_active":"2024-05-03T22:42:11.534725+0000","last_peered":"2024-05-03T22:42:11.534725+0000","last_clean":"2024-05-03T22:42:11.534725+0000","last_became_active":"2024-05-03T22:40:11.769792+0000","last_became_peered":"2024-05-03T22:40:11.769792+0000","last_unstale":"2024-05-03T22:42:11.534725+0000","last_undegraded":"2024-05-03T22:42:11.534725+0000","last_fullsized":"2024-05-03T22:42:11.534725+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:33:44.917398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748427+0000","last_change":"2024-05-03T22:40:25.086799+0000","last_active":"2024-05-03T22:42:11.748427+0000","last_peered":"2024-05-03T22:42:11.748427+0000","last_clean":"2024-05-03T22:42:11.748427+0000","last_became_active":"2024-05-03T22:40:25.086318+0000","last_became_peered":"2024-05-03T22:40:25.086318+0000","last_unstale":"2024-05-03T22:42:11.748427+0000","last_undegraded":"2024-05-03T22:42:11.748427+0000","last_fullsized":"2024-05-03T22:42:11.748427+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:58.895616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"87'3","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425939+0000","last_change":"2024-05-03T22:40:06.687143+0000","last_active":"2024-05-03T22:42:11.425939+0000","last_peered":"2024-05-03T22:42:11.425939+0000","last_clean":"2024-05-03T22:42:11.425939+0000","last_became_active":"2024-05-03T22:40:06.686479+0000","last_became_peered":"2024-05-03T22:40:06.686479+0000","last_unstale":"2024-05-03T22:42:11.425939+0000","last_undegraded":"2024-05-03T22:42:11.425939+0000","last_fullsized":"2024-05-03T22:42:11.425939+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:23:11.325334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748661+0000","last_change":"2024-05-03T22:40:11.766225+0000","last_active":"2024-05-03T22:42:11.748661+0000","last_peered":"2024-05-03T22:42:11.748661+0000","last_clean":"2024-05-03T22:42:11.748661+0000","last_became_active":"2024-05-03T22:40:11.765888+0000","last_became_peered":"2024-05-03T22:40:11.765888+0000","last_unstale":"2024-05-03T22:42:11.748661+0000","last_undegraded":"2024-05-03T22:42:11.748661+0000","last_fullsized":"2024-05-03T22:42:11.748661+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:12:31.300562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749146+0000","last_change":"2024-05-03T22:40:25.081276+0000","last_active":"2024-05-03T22:42:11.749146+0000","last_peered":"2024-05-03T22:42:11.749146+0000","last_clean":"2024-05-03T22:42:11.749146+0000","last_became_active":"2024-05-03T22:40:25.080766+0000","last_became_peered":"2024-05-03T22:40:25.080766+0000","last_unstale":"2024-05-03T22:42:11.749146+0000","last_undegraded":"2024-05-03T22:42:11.749146+0000","last_fullsized":"2024-05-03T22:42:11.749146+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:54:49.970169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":60,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433077+0000","last_change":"2024-05-03T22:41:10.790834+0000","last_active":"2024-05-03T22:42:11.433077+0000","last_peered":"2024-05-03T22:42:11.433077+0000","last_clean":"2024-05-03T22:42:11.433077+0000","last_became_active":"2024-05-03T22:41:10.777613+0000","last_became_peered":"2024-05-03T22:41:10.777613+0000","last_unstale":"2024-05-03T22:42:11.433077+0000","last_undegraded":"2024-05-03T22:42:11.433077+0000","last_fullsized":"2024-05-03T22:42:11.433077+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:28:12.000819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749939+0000","last_change":"2024-05-03T22:40:11.779626+0000","last_active":"2024-05-03T22:42:11.749939+0000","last_peered":"2024-05-03T22:42:11.749939+0000","last_clean":"2024-05-03T22:42:11.749939+0000","last_became_active":"2024-05-03T22:40:11.779232+0000","last_became_peered":"2024-05-03T22:40:11.779232+0000","last_unstale":"2024-05-03T22:42:11.749939+0000","last_undegraded":"2024-05-03T22:42:11.749939+0000","last_fullsized":"2024-05-03T22:42:11.749939+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:46:09.507758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439098+0000","last_change":"2024-05-03T22:40:25.079098+0000","last_active":"2024-05-03T22:42:11.439098+0000","last_peered":"2024-05-03T22:42:11.439098+0000","last_clean":"2024-05-03T22:42:11.439098+0000","last_became_active":"2024-05-03T22:40:25.078646+0000","last_became_peered":"2024-05-03T22:40:25.078646+0000","last_unstale":"2024-05-03T22:42:11.439098+0000","last_undegraded":"2024-05-03T22:42:11.439098+0000","last_fullsized":"2024-05-03T22:42:11.439098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:54:17.938515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"87'6","reported_seq":175,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:43:42.603240+0000","last_change":"2024-05-03T22:40:07.327901+0000","last_active":"2024-05-03T22:43:42.603240+0000","last_peered":"2024-05-03T22:43:42.603240+0000","last_clean":"2024-05-03T22:43:42.603240+0000","last_became_active":"2024-05-03T22:40:07.326619+0000","last_became_peered":"2024-05-03T22:40:07.326619+0000","last_unstale":"2024-05-03T22:43:42.603240+0000","last_undegraded":"2024-05-03T22:43:42.603240+0000","last_fullsized":"2024-05-03T22:43:42.603240+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:38:00.537433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750499+0000","last_change":"2024-05-03T22:40:11.783624+0000","last_active":"2024-05-03T22:42:11.750499+0000","last_peered":"2024-05-03T22:42:11.750499+0000","last_clean":"2024-05-03T22:42:11.750499+0000","last_became_active":"2024-05-03T22:40:11.779891+0000","last_became_peered":"2024-05-03T22:40:11.779891+0000","last_unstale":"2024-05-03T22:42:11.750499+0000","last_undegraded":"2024-05-03T22:42:11.750499+0000","last_fullsized":"2024-05-03T22:42:11.750499+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:54:05.069207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740508+0000","last_change":"2024-05-03T22:40:25.089793+0000","last_active":"2024-05-03T22:42:11.740508+0000","last_peered":"2024-05-03T22:42:11.740508+0000","last_clean":"2024-05-03T22:42:11.740508+0000","last_became_active":"2024-05-03T22:40:25.087879+0000","last_became_peered":"2024-05-03T22:40:25.087879+0000","last_unstale":"2024-05-03T22:42:11.740508+0000","last_undegraded":"2024-05-03T22:42:11.740508+0000","last_fullsized":"2024-05-03T22:42:11.740508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:36:39.533480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"87'3","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749307+0000","last_change":"2024-05-03T22:40:06.679093+0000","last_active":"2024-05-03T22:42:11.749307+0000","last_peered":"2024-05-03T22:42:11.749307+0000","last_clean":"2024-05-03T22:42:11.749307+0000","last_became_active":"2024-05-03T22:40:06.677527+0000","last_became_peered":"2024-05-03T22:40:06.677527+0000","last_unstale":"2024-05-03T22:42:11.749307+0000","last_undegraded":"2024-05-03T22:42:11.749307+0000","last_fullsized":"2024-05-03T22:42:11.749307+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:26:34.600615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749632+0000","last_change":"2024-05-03T22:40:11.774786+0000","last_active":"2024-05-03T22:42:11.749632+0000","last_peered":"2024-05-03T22:42:11.749632+0000","last_clean":"2024-05-03T22:42:11.749632+0000","last_became_active":"2024-05-03T22:40:11.767060+0000","last_became_peered":"2024-05-03T22:40:11.767060+0000","last_unstale":"2024-05-03T22:42:11.749632+0000","last_undegraded":"2024-05-03T22:42:11.749632+0000","last_fullsized":"2024-05-03T22:42:11.749632+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:28:47.576215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748315+0000","last_change":"2024-05-03T22:40:25.076231+0000","last_active":"2024-05-03T22:42:11.748315+0000","last_peered":"2024-05-03T22:42:11.748315+0000","last_clean":"2024-05-03T22:42:11.748315+0000","last_became_active":"2024-05-03T22:40:25.075787+0000","last_became_peered":"2024-05-03T22:40:25.075787+0000","last_unstale":"2024-05-03T22:42:11.748315+0000","last_undegraded":"2024-05-03T22:42:11.748315+0000","last_fullsized":"2024-05-03T22:42:11.748315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:17:10.068772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":60,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.436969+0000","last_change":"2024-05-03T22:41:11.174406+0000","last_active":"2024-05-03T22:42:11.436969+0000","last_peered":"2024-05-03T22:42:11.436969+0000","last_clean":"2024-05-03T22:42:11.436969+0000","last_became_active":"2024-05-03T22:41:11.166209+0000","last_became_peered":"2024-05-03T22:41:11.166209+0000","last_unstale":"2024-05-03T22:42:11.436969+0000","last_undegraded":"2024-05-03T22:42:11.436969+0000","last_fullsized":"2024-05-03T22:42:11.436969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:35:06.117972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750601+0000","last_change":"2024-05-03T22:40:11.781047+0000","last_active":"2024-05-03T22:42:11.750601+0000","last_peered":"2024-05-03T22:42:11.750601+0000","last_clean":"2024-05-03T22:42:11.750601+0000","last_became_active":"2024-05-03T22:40:11.779374+0000","last_became_peered":"2024-05-03T22:40:11.779374+0000","last_unstale":"2024-05-03T22:42:11.750601+0000","last_undegraded":"2024-05-03T22:42:11.750601+0000","last_fullsized":"2024-05-03T22:42:11.750601+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:18:35.718495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534982+0000","last_change":"2024-05-03T22:40:11.773640+0000","last_active":"2024-05-03T22:42:11.534982+0000","last_peered":"2024-05-03T22:42:11.534982+0000","last_clean":"2024-05-03T22:42:11.534982+0000","last_became_active":"2024-05-03T22:40:11.772554+0000","last_became_peered":"2024-05-03T22:40:11.772554+0000","last_unstale":"2024-05-03T22:42:11.534982+0000","last_undegraded":"2024-05-03T22:42:11.534982+0000","last_fullsized":"2024-05-03T22:42:11.534982+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:19:24.593238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425429+0000","last_change":"2024-05-03T22:41:10.787952+0000","last_active":"2024-05-03T22:42:11.425429+0000","last_peered":"2024-05-03T22:42:11.425429+0000","last_clean":"2024-05-03T22:42:11.425429+0000","last_became_active":"2024-05-03T22:41:10.787399+0000","last_became_peered":"2024-05-03T22:41:10.787399+0000","last_unstale":"2024-05-03T22:42:11.425429+0000","last_undegraded":"2024-05-03T22:42:11.425429+0000","last_fullsized":"2024-05-03T22:42:11.425429+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:56:00.722885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426316+0000","last_change":"2024-05-03T22:40:11.767997+0000","last_active":"2024-05-03T22:42:11.426316+0000","last_peered":"2024-05-03T22:42:11.426316+0000","last_clean":"2024-05-03T22:42:11.426316+0000","last_became_active":"2024-05-03T22:40:11.765779+0000","last_became_peered":"2024-05-03T22:40:11.765779+0000","last_unstale":"2024-05-03T22:42:11.426316+0000","last_undegraded":"2024-05-03T22:42:11.426316+0000","last_fullsized":"2024-05-03T22:42:11.426316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:46:57.126690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740670+0000","last_change":"2024-05-03T22:40:11.774012+0000","last_active":"2024-05-03T22:42:11.740670+0000","last_peered":"2024-05-03T22:42:11.740670+0000","last_clean":"2024-05-03T22:42:11.740670+0000","last_became_active":"2024-05-03T22:40:11.771152+0000","last_became_peered":"2024-05-03T22:40:11.771152+0000","last_unstale":"2024-05-03T22:42:11.740670+0000","last_undegraded":"2024-05-03T22:42:11.740670+0000","last_fullsized":"2024-05-03T22:42:11.740670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:44:27.905860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433863+0000","last_change":"2024-05-03T22:40:11.772190+0000","last_active":"2024-05-03T22:42:11.433863+0000","last_peered":"2024-05-03T22:42:11.433863+0000","last_clean":"2024-05-03T22:42:11.433863+0000","last_became_active":"2024-05-03T22:40:11.771788+0000","last_became_peered":"2024-05-03T22:40:11.771788+0000","last_unstale":"2024-05-03T22:42:11.433863+0000","last_undegraded":"2024-05-03T22:42:11.433863+0000","last_fullsized":"2024-05-03T22:42:11.433863+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:55:47.610034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.535280+0000","last_change":"2024-05-03T22:40:11.776770+0000","last_active":"2024-05-03T22:42:11.535280+0000","last_peered":"2024-05-03T22:42:11.535280+0000","last_clean":"2024-05-03T22:42:11.535280+0000","last_became_active":"2024-05-03T22:40:11.773644+0000","last_became_peered":"2024-05-03T22:40:11.773644+0000","last_unstale":"2024-05-03T22:42:11.535280+0000","last_undegraded":"2024-05-03T22:42:11.535280+0000","last_fullsized":"2024-05-03T22:42:11.535280+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:15:38.145066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426509+0000","last_change":"2024-05-03T22:40:11.771708+0000","last_active":"2024-05-03T22:42:11.426509+0000","last_peered":"2024-05-03T22:42:11.426509+0000","last_clean":"2024-05-03T22:42:11.426509+0000","last_became_active":"2024-05-03T22:40:11.770806+0000","last_became_peered":"2024-05-03T22:40:11.770806+0000","last_unstale":"2024-05-03T22:42:11.426509+0000","last_undegraded":"2024-05-03T22:42:11.426509+0000","last_fullsized":"2024-05-03T22:42:11.426509+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:25:46.219330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749291+0000","last_change":"2024-05-03T22:40:11.773209+0000","last_active":"2024-05-03T22:42:11.749291+0000","last_peered":"2024-05-03T22:42:11.749291+0000","last_clean":"2024-05-03T22:42:11.749291+0000","last_became_active":"2024-05-03T22:40:11.771783+0000","last_became_peered":"2024-05-03T22:40:11.771783+0000","last_unstale":"2024-05-03T22:42:11.749291+0000","last_undegraded":"2024-05-03T22:42:11.749291+0000","last_fullsized":"2024-05-03T22:42:11.749291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:06:28.133378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748547+0000","last_change":"2024-05-03T22:40:11.771988+0000","last_active":"2024-05-03T22:42:11.748547+0000","last_peered":"2024-05-03T22:42:11.748547+0000","last_clean":"2024-05-03T22:42:11.748547+0000","last_became_active":"2024-05-03T22:40:11.771542+0000","last_became_peered":"2024-05-03T22:40:11.771542+0000","last_unstale":"2024-05-03T22:42:11.748547+0000","last_undegraded":"2024-05-03T22:42:11.748547+0000","last_fullsized":"2024-05-03T22:42:11.748547+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:31:59.912571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748253+0000","last_change":"2024-05-03T22:40:11.762129+0000","last_active":"2024-05-03T22:42:11.748253+0000","last_peered":"2024-05-03T22:42:11.748253+0000","last_clean":"2024-05-03T22:42:11.748253+0000","last_became_active":"2024-05-03T22:40:11.761770+0000","last_became_peered":"2024-05-03T22:40:11.761770+0000","last_unstale":"2024-05-03T22:42:11.748253+0000","last_undegraded":"2024-05-03T22:42:11.748253+0000","last_fullsized":"2024-05-03T22:42:11.748253+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:02:10.618602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439941+0000","last_change":"2024-05-03T22:40:11.788411+0000","last_active":"2024-05-03T22:42:11.439941+0000","last_peered":"2024-05-03T22:42:11.439941+0000","last_clean":"2024-05-03T22:42:11.439941+0000","last_became_active":"2024-05-03T22:40:11.785013+0000","last_became_peered":"2024-05-03T22:40:11.785013+0000","last_unstale":"2024-05-03T22:42:11.439941+0000","last_undegraded":"2024-05-03T22:42:11.439941+0000","last_fullsized":"2024-05-03T22:42:11.439941+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:36:41.638224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.432131+0000","last_change":"2024-05-03T22:40:11.773992+0000","last_active":"2024-05-03T22:42:11.432131+0000","last_peered":"2024-05-03T22:42:11.432131+0000","last_clean":"2024-05-03T22:42:11.432131+0000","last_became_active":"2024-05-03T22:40:11.772926+0000","last_became_peered":"2024-05-03T22:40:11.772926+0000","last_unstale":"2024-05-03T22:42:11.432131+0000","last_undegraded":"2024-05-03T22:42:11.432131+0000","last_fullsized":"2024-05-03T22:42:11.432131+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:02:57.215605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534925+0000","last_change":"2024-05-03T22:40:11.777987+0000","last_active":"2024-05-03T22:42:11.534925+0000","last_peered":"2024-05-03T22:42:11.534925+0000","last_clean":"2024-05-03T22:42:11.534925+0000","last_became_active":"2024-05-03T22:40:11.774177+0000","last_became_peered":"2024-05-03T22:40:11.774177+0000","last_unstale":"2024-05-03T22:42:11.534925+0000","last_undegraded":"2024-05-03T22:42:11.534925+0000","last_fullsized":"2024-05-03T22:42:11.534925+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:21:57.332460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67418,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1239,"num_read_kb":695,"num_write":248,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":202254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710783,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":516983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877907015,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37028,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708124,"statfs":{"total":95995035648,"available":95957118976,"internally_reserved":0,"allocated":1724416,"data_stored":1163425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070542,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":520030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266773,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1052672,"data_stored":516312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863463004,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1646592,"data_stored":1112221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626530,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":511438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1097728,"data_stored":572682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738507,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":513285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1118208,"data_stored":573293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182520,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1044480,"data_stored":511146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986289,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1040384,"data_stored":515903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822762,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32804,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712348,"statfs":{"total":95995035648,"available":95961444352,"internally_reserved":0,"allocated":1658880,"data_stored":1108000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-03T22:43:47.153 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-03T22:43:47.269 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:47 smithi044 ceph-mon[28604]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:43:47.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:47 smithi060 ceph-mon[31721]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:43:47.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:47 smithi160 ceph-mon[32531]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:43:47.656 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:43:48.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:48 smithi044 ceph-mon[28604]: pgmap v488: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:48.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:48 smithi060 ceph-mon[31721]: pgmap v488: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:48.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:48 smithi160 ceph-mon[32531]: pgmap v488: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.065+0000 7fb6e5600700 1 -- 172.21.15.44:0/4264423133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6e0103d90 msgr2=0x7fb6e01102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.065+0000 7fb6e5600700 1 --2- 172.21.15.44:0/4264423133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6e0103d90 0x7fb6e01102a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800b0a0 tx=0x7fb6d800b3b0 comp rx=0 tx=0).stop 2024-05-03T22:43:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.065+0000 7fb6e5600700 1 -- 172.21.15.44:0/4264423133 shutdown_connections 2024-05-03T22:43:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.065+0000 7fb6e5600700 1 --2- 172.21.15.44:0/4264423133 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6e0103d90 0x7fb6e01102a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.065+0000 7fb6e5600700 1 --2- 172.21.15.44:0/4264423133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6e0109460 0x7fb6e0109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:50.067 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.065+0000 7fb6e5600700 1 --2- 172.21.15.44:0/4264423133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6e01033d0 0x7fb6e0103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:50.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.065+0000 7fb6e5600700 1 -- 172.21.15.44:0/4264423133 >> 172.21.15.44:0/4264423133 conn(0x7fb6e00fef20 msgr2=0x7fb6e0101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:50.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.065+0000 7fb6e5600700 1 -- 172.21.15.44:0/4264423133 shutdown_connections 2024-05-03T22:43:50.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.065+0000 7fb6e5600700 1 -- 172.21.15.44:0/4264423133 wait complete. 2024-05-03T22:43:50.068 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.066+0000 7fb6e5600700 1 Processor -- start 2024-05-03T22:43:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.067+0000 7fb6e5600700 1 -- start start 2024-05-03T22:43:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.067+0000 7fb6e5600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6e01033d0 0x7fb6e019f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.067+0000 7fb6e5600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6e0103d90 0x7fb6e019fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.067+0000 7fb6e5600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6e0109460 0x7fb6e0199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.067+0000 7fb6e5600700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e0113800 con 0x7fb6e0109460 2024-05-03T22:43:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.067+0000 7fb6e5600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e0113680 con 0x7fb6e01033d0 2024-05-03T22:43:50.069 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.067+0000 7fb6e5600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e0113980 con 0x7fb6e0103d90 2024-05-03T22:43:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.068+0000 7fb6e4c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6e0109460 0x7fb6e0199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.068+0000 7fb6e4c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6e0109460 0x7fb6e0199ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47726/0 (socket says 172.21.15.44:47726) 2024-05-03T22:43:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.068+0000 7fb6e4c00700 1 -- 172.21.15.44:0/208694138 learned_addr learned my addr 172.21.15.44:0/208694138 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.068+0000 7fb6dfe00700 1 --2- 172.21.15.44:0/208694138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6e01033d0 0x7fb6e019f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.068+0000 7fb6df400700 1 --2- 172.21.15.44:0/208694138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6e0103d90 0x7fb6e019fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.068+0000 7fb6e4c00700 1 -- 172.21.15.44:0/208694138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6e0103d90 msgr2=0x7fb6e019fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.068+0000 7fb6e4c00700 1 --2- 172.21.15.44:0/208694138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6e0103d90 0x7fb6e019fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:50.070 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.068+0000 7fb6e4c00700 1 -- 172.21.15.44:0/208694138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6e01033d0 msgr2=0x7fb6e019f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.068+0000 7fb6e4c00700 1 --2- 172.21.15.44:0/208694138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6e01033d0 0x7fb6e019f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.068+0000 7fb6e4c00700 1 -- 172.21.15.44:0/208694138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e019a220 con 0x7fb6e0109460 2024-05-03T22:43:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.069+0000 7fb6e4c00700 1 --2- 172.21.15.44:0/208694138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6e0109460 0x7fb6e0199ac0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800b070 tx=0x7fb6d8007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.069+0000 7fb6dcc00700 1 -- 172.21.15.44:0/208694138 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8022070 con 0x7fb6e0109460 2024-05-03T22:43:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.069+0000 7fb6dcc00700 1 -- 172.21.15.44:0/208694138 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fb6d8007e40 con 0x7fb6e0109460 2024-05-03T22:43:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.069+0000 7fb6dcc00700 1 -- 172.21.15.44:0/208694138 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d801d830 con 0x7fb6e0109460 2024-05-03T22:43:50.071 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.069+0000 7fb6e5600700 1 -- 172.21.15.44:0/208694138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e019a4b0 con 0x7fb6e0109460 2024-05-03T22:43:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.069+0000 7fb6e5600700 1 -- 172.21.15.44:0/208694138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e01a67d0 con 0x7fb6e0109460 2024-05-03T22:43:50.072 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.070+0000 7fb6e5600700 1 -- 172.21.15.44:0/208694138 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6e006a190 con 0x7fb6e0109460 2024-05-03T22:43:50.074 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.073+0000 7fb6dcc00700 1 -- 172.21.15.44:0/208694138 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb6d8003c00 con 0x7fb6e0109460 2024-05-03T22:43:50.075 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.074+0000 7fb6dcc00700 1 --2- 172.21.15.44:0/208694138 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb6c40b2990 0x7fb6c40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:50.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.075+0000 7fb6dcc00700 1 -- 172.21.15.44:0/208694138 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fb6d800f020 con 0x7fb6e0109460 2024-05-03T22:43:50.076 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.075+0000 7fb6dfe00700 1 --2- 172.21.15.44:0/208694138 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb6c40b2990 0x7fb6c40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:50.077 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.076+0000 7fb6dfe00700 1 --2- 172.21.15.44:0/208694138 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb6c40b2990 0x7fb6c40b4e50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb6e019ac00 tx=0x7fb6d0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.077+0000 7fb6dcc00700 1 -- 172.21.15.44:0/208694138 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb6d80aa6e0 con 0x7fb6e0109460 2024-05-03T22:43:50.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.313+0000 7fb6e5600700 1 -- 172.21.15.44:0/208694138 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6e019aff0 con 0x7fb6c40b2990 2024-05-03T22:43:50.343 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.342+0000 7fb6dcc00700 1 -- 172.21.15.44:0/208694138 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340422 (secure 0 0 0) 0x7fb6e019aff0 con 0x7fb6c40b2990 2024-05-03T22:43:50.344 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:50 smithi044 ceph-mon[28604]: pgmap v489: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:43:50.345 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:43:50.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.353+0000 7fb6e5600700 1 -- 172.21.15.44:0/208694138 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb6c40b2990 msgr2=0x7fb6c40b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:50.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.353+0000 7fb6e5600700 1 --2- 172.21.15.44:0/208694138 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb6c40b2990 0x7fb6c40b4e50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb6e019ac00 tx=0x7fb6d0009190 comp rx=0 tx=0).stop 2024-05-03T22:43:50.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.353+0000 7fb6e5600700 1 -- 172.21.15.44:0/208694138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6e0109460 msgr2=0x7fb6e0199ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:50.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.353+0000 7fb6e5600700 1 --2- 172.21.15.44:0/208694138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6e0109460 0x7fb6e0199ac0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800b070 tx=0x7fb6d8007a10 comp rx=0 tx=0).stop 2024-05-03T22:43:50.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.353+0000 7fb6e5600700 1 -- 172.21.15.44:0/208694138 shutdown_connections 2024-05-03T22:43:50.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.353+0000 7fb6e5600700 1 --2- 172.21.15.44:0/208694138 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb6e0109460 0x7fb6e0199ac0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:50.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.353+0000 7fb6e5600700 1 --2- 172.21.15.44:0/208694138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6e01033d0 0x7fb6e019f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:50.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.353+0000 7fb6e5600700 1 --2- 172.21.15.44:0/208694138 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb6c40b2990 0x7fb6c40b4e50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:50.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.353+0000 7fb6e5600700 1 --2- 172.21.15.44:0/208694138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6e0103d90 0x7fb6e019fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:50.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.353+0000 7fb6e5600700 1 -- 172.21.15.44:0/208694138 >> 172.21.15.44:0/208694138 conn(0x7fb6e00fef20 msgr2=0x7fb6e00ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:50.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.354+0000 7fb6e5600700 1 -- 172.21.15.44:0/208694138 shutdown_connections 2024-05-03T22:43:50.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:50.354+0000 7fb6e5600700 1 -- 172.21.15.44:0/208694138 wait complete. 2024-05-03T22:43:50.356 INFO:teuthology.orchestra.run.smithi044.stderr:dumped all 2024-05-03T22:43:50.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:50 smithi060 ceph-mon[31721]: pgmap v489: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:43:50.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:50 smithi160 ceph-mon[32531]: pgmap v489: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:43:51.359 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":489,"stamp":"2024-05-03T22:43:49.057038+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658020,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1355,"num_read_kb":784,"num_write":373,"num_write_kb":2292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":308,"ondisk_log_size":308,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384252,"kb_used_data":14228,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557572,"statfs":{"total":1151940427776,"available":1151546953728,"internally_reserved":0,"allocated":14569472,"data_stored":8134718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005876"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.535408+0000","last_change":"2024-05-03T22:40:11.775947+0000","last_active":"2024-05-03T22:42:11.535408+0000","last_peered":"2024-05-03T22:42:11.535408+0000","last_clean":"2024-05-03T22:42:11.535408+0000","last_became_active":"2024-05-03T22:40:11.770836+0000","last_became_peered":"2024-05-03T22:40:11.770836+0000","last_unstale":"2024-05-03T22:42:11.535408+0000","last_undegraded":"2024-05-03T22:42:11.535408+0000","last_fullsized":"2024-05-03T22:42:11.535408+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:38:36.107368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740907+0000","last_change":"2024-05-03T22:40:11.781597+0000","last_active":"2024-05-03T22:42:11.740907+0000","last_peered":"2024-05-03T22:42:11.740907+0000","last_clean":"2024-05-03T22:42:11.740907+0000","last_became_active":"2024-05-03T22:40:11.781160+0000","last_became_peered":"2024-05-03T22:40:11.781160+0000","last_unstale":"2024-05-03T22:42:11.740907+0000","last_undegraded":"2024-05-03T22:42:11.740907+0000","last_fullsized":"2024-05-03T22:42:11.740907+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:57:41.654999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740820+0000","last_change":"2024-05-03T22:40:11.776144+0000","last_active":"2024-05-03T22:42:11.740820+0000","last_peered":"2024-05-03T22:42:11.740820+0000","last_clean":"2024-05-03T22:42:11.740820+0000","last_became_active":"2024-05-03T22:40:11.775781+0000","last_became_peered":"2024-05-03T22:40:11.775781+0000","last_unstale":"2024-05-03T22:42:11.740820+0000","last_undegraded":"2024-05-03T22:42:11.740820+0000","last_fullsized":"2024-05-03T22:42:11.740820+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:48:33.774915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748883+0000","last_change":"2024-05-03T22:40:11.773680+0000","last_active":"2024-05-03T22:42:11.748883+0000","last_peered":"2024-05-03T22:42:11.748883+0000","last_clean":"2024-05-03T22:42:11.748883+0000","last_became_active":"2024-05-03T22:40:11.771779+0000","last_became_peered":"2024-05-03T22:40:11.771779+0000","last_unstale":"2024-05-03T22:42:11.748883+0000","last_undegraded":"2024-05-03T22:42:11.748883+0000","last_fullsized":"2024-05-03T22:42:11.748883+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:29:58.849141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433671+0000","last_change":"2024-05-03T22:40:11.770873+0000","last_active":"2024-05-03T22:42:11.433671+0000","last_peered":"2024-05-03T22:42:11.433671+0000","last_clean":"2024-05-03T22:42:11.433671+0000","last_became_active":"2024-05-03T22:40:11.770361+0000","last_became_peered":"2024-05-03T22:40:11.770361+0000","last_unstale":"2024-05-03T22:42:11.433671+0000","last_undegraded":"2024-05-03T22:42:11.433671+0000","last_fullsized":"2024-05-03T22:42:11.433671+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:24:11.038058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.441126+0000","last_change":"2024-05-03T22:42:11.439751+0000","last_active":"2024-05-03T22:42:11.441126+0000","last_peered":"2024-05-03T22:42:11.441126+0000","last_clean":"2024-05-03T22:42:11.441126+0000","last_became_active":"2024-05-03T22:42:11.438556+0000","last_became_peered":"2024-05-03T22:42:11.438556+0000","last_unstale":"2024-05-03T22:42:11.441126+0000","last_undegraded":"2024-05-03T22:42:11.441126+0000","last_fullsized":"2024-05-03T22:42:11.441126+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:25:14.716559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,6],"acting":[10,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749529+0000","last_change":"2024-05-03T22:40:11.772616+0000","last_active":"2024-05-03T22:42:11.749529+0000","last_peered":"2024-05-03T22:42:11.749529+0000","last_clean":"2024-05-03T22:42:11.749529+0000","last_became_active":"2024-05-03T22:40:11.772237+0000","last_became_peered":"2024-05-03T22:40:11.772237+0000","last_unstale":"2024-05-03T22:42:11.749529+0000","last_undegraded":"2024-05-03T22:42:11.749529+0000","last_fullsized":"2024-05-03T22:42:11.749529+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:36:36.825989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748173+0000","last_change":"2024-05-03T22:40:11.771192+0000","last_active":"2024-05-03T22:42:11.748173+0000","last_peered":"2024-05-03T22:42:11.748173+0000","last_clean":"2024-05-03T22:42:11.748173+0000","last_became_active":"2024-05-03T22:40:11.770820+0000","last_became_peered":"2024-05-03T22:40:11.770820+0000","last_unstale":"2024-05-03T22:42:11.748173+0000","last_undegraded":"2024-05-03T22:42:11.748173+0000","last_fullsized":"2024-05-03T22:42:11.748173+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:51:22.303448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.752332+0000","last_change":"2024-05-03T22:42:11.751423+0000","last_active":"2024-05-03T22:42:11.752332+0000","last_peered":"2024-05-03T22:42:11.752332+0000","last_clean":"2024-05-03T22:42:11.752332+0000","last_became_active":"2024-05-03T22:42:11.750956+0000","last_became_peered":"2024-05-03T22:42:11.750956+0000","last_unstale":"2024-05-03T22:42:11.752332+0000","last_undegraded":"2024-05-03T22:42:11.752332+0000","last_fullsized":"2024-05-03T22:42:11.752332+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:07:12.615712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.440568+0000","last_change":"2024-05-03T22:42:11.437447+0000","last_active":"2024-05-03T22:42:11.440568+0000","last_peered":"2024-05-03T22:42:11.440568+0000","last_clean":"2024-05-03T22:42:11.440568+0000","last_became_active":"2024-05-03T22:42:11.436202+0000","last_became_peered":"2024-05-03T22:42:11.436202+0000","last_unstale":"2024-05-03T22:42:11.440568+0000","last_undegraded":"2024-05-03T22:42:11.440568+0000","last_fullsized":"2024-05-03T22:42:11.440568+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:50:12.891083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750344+0000","last_change":"2024-05-03T22:40:11.781381+0000","last_active":"2024-05-03T22:42:11.750344+0000","last_peered":"2024-05-03T22:42:11.750344+0000","last_clean":"2024-05-03T22:42:11.750344+0000","last_became_active":"2024-05-03T22:40:11.779293+0000","last_became_peered":"2024-05-03T22:40:11.779293+0000","last_unstale":"2024-05-03T22:42:11.750344+0000","last_undegraded":"2024-05-03T22:42:11.750344+0000","last_fullsized":"2024-05-03T22:42:11.750344+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:54:12.774746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748783+0000","last_change":"2024-05-03T22:40:11.784059+0000","last_active":"2024-05-03T22:42:11.748783+0000","last_peered":"2024-05-03T22:42:11.748783+0000","last_clean":"2024-05-03T22:42:11.748783+0000","last_became_active":"2024-05-03T22:40:11.783674+0000","last_became_peered":"2024-05-03T22:40:11.783674+0000","last_unstale":"2024-05-03T22:42:11.748783+0000","last_undegraded":"2024-05-03T22:42:11.748783+0000","last_fullsized":"2024-05-03T22:42:11.748783+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:20:53.546365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.432290+0000","last_change":"2024-05-03T22:40:11.780950+0000","last_active":"2024-05-03T22:42:11.432290+0000","last_peered":"2024-05-03T22:42:11.432290+0000","last_clean":"2024-05-03T22:42:11.432290+0000","last_became_active":"2024-05-03T22:40:11.780434+0000","last_became_peered":"2024-05-03T22:40:11.780434+0000","last_unstale":"2024-05-03T22:42:11.432290+0000","last_undegraded":"2024-05-03T22:42:11.432290+0000","last_fullsized":"2024-05-03T22:42:11.432290+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:28:46.616675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740592+0000","last_change":"2024-05-03T22:40:11.785985+0000","last_active":"2024-05-03T22:42:11.740592+0000","last_peered":"2024-05-03T22:42:11.740592+0000","last_clean":"2024-05-03T22:42:11.740592+0000","last_became_active":"2024-05-03T22:40:11.785615+0000","last_became_peered":"2024-05-03T22:40:11.785615+0000","last_unstale":"2024-05-03T22:42:11.740592+0000","last_undegraded":"2024-05-03T22:42:11.740592+0000","last_fullsized":"2024-05-03T22:42:11.740592+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:51:19.038726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740681+0000","last_change":"2024-05-03T22:40:11.777142+0000","last_active":"2024-05-03T22:42:11.740681+0000","last_peered":"2024-05-03T22:42:11.740681+0000","last_clean":"2024-05-03T22:42:11.740681+0000","last_became_active":"2024-05-03T22:40:11.775364+0000","last_became_peered":"2024-05-03T22:40:11.775364+0000","last_unstale":"2024-05-03T22:42:11.740681+0000","last_undegraded":"2024-05-03T22:42:11.740681+0000","last_fullsized":"2024-05-03T22:42:11.740681+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:48:06.634135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439590+0000","last_change":"2024-05-03T22:40:11.774928+0000","last_active":"2024-05-03T22:42:11.439590+0000","last_peered":"2024-05-03T22:42:11.439590+0000","last_clean":"2024-05-03T22:42:11.439590+0000","last_became_active":"2024-05-03T22:40:11.772942+0000","last_became_peered":"2024-05-03T22:40:11.772942+0000","last_unstale":"2024-05-03T22:42:11.439590+0000","last_undegraded":"2024-05-03T22:42:11.439590+0000","last_fullsized":"2024-05-03T22:42:11.439590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:23:25.054532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.535024+0000","last_change":"2024-05-03T22:40:11.777739+0000","last_active":"2024-05-03T22:42:11.535024+0000","last_peered":"2024-05-03T22:42:11.535024+0000","last_clean":"2024-05-03T22:42:11.535024+0000","last_became_active":"2024-05-03T22:40:11.776615+0000","last_became_peered":"2024-05-03T22:40:11.776615+0000","last_unstale":"2024-05-03T22:42:11.535024+0000","last_undegraded":"2024-05-03T22:42:11.535024+0000","last_fullsized":"2024-05-03T22:42:11.535024+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:34:17.672863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428570+0000","last_change":"2024-05-03T22:40:11.778880+0000","last_active":"2024-05-03T22:42:11.428570+0000","last_peered":"2024-05-03T22:42:11.428570+0000","last_clean":"2024-05-03T22:42:11.428570+0000","last_became_active":"2024-05-03T22:40:11.776901+0000","last_became_peered":"2024-05-03T22:40:11.776901+0000","last_unstale":"2024-05-03T22:42:11.428570+0000","last_undegraded":"2024-05-03T22:42:11.428570+0000","last_fullsized":"2024-05-03T22:42:11.428570+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:55:47.849284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426015+0000","last_change":"2024-05-03T22:40:11.768612+0000","last_active":"2024-05-03T22:42:11.426015+0000","last_peered":"2024-05-03T22:42:11.426015+0000","last_clean":"2024-05-03T22:42:11.426015+0000","last_became_active":"2024-05-03T22:40:11.767553+0000","last_became_peered":"2024-05-03T22:40:11.767553+0000","last_unstale":"2024-05-03T22:42:11.426015+0000","last_undegraded":"2024-05-03T22:42:11.426015+0000","last_fullsized":"2024-05-03T22:42:11.426015+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:04:36.348401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425312+0000","last_change":"2024-05-03T22:40:25.088489+0000","last_active":"2024-05-03T22:42:11.425312+0000","last_peered":"2024-05-03T22:42:11.425312+0000","last_clean":"2024-05-03T22:42:11.425312+0000","last_became_active":"2024-05-03T22:40:25.087028+0000","last_became_peered":"2024-05-03T22:40:25.087028+0000","last_unstale":"2024-05-03T22:42:11.425312+0000","last_undegraded":"2024-05-03T22:42:11.425312+0000","last_fullsized":"2024-05-03T22:42:11.425312+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:38:00.084610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'13","reported_seq":182,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:43:44.592602+0000","last_change":"2024-05-03T22:40:06.682624+0000","last_active":"2024-05-03T22:43:44.592602+0000","last_peered":"2024-05-03T22:43:44.592602+0000","last_clean":"2024-05-03T22:43:44.592602+0000","last_became_active":"2024-05-03T22:40:06.682040+0000","last_became_peered":"2024-05-03T22:40:06.682040+0000","last_unstale":"2024-05-03T22:43:44.592602+0000","last_undegraded":"2024-05-03T22:43:44.592602+0000","last_fullsized":"2024-05-03T22:43:44.592602+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:39:52.905802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748274+0000","last_change":"2024-05-03T22:40:11.771570+0000","last_active":"2024-05-03T22:42:11.748274+0000","last_peered":"2024-05-03T22:42:11.748274+0000","last_clean":"2024-05-03T22:42:11.748274+0000","last_became_active":"2024-05-03T22:40:11.771165+0000","last_became_peered":"2024-05-03T22:40:11.771165+0000","last_unstale":"2024-05-03T22:42:11.748274+0000","last_undegraded":"2024-05-03T22:42:11.748274+0000","last_fullsized":"2024-05-03T22:42:11.748274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:32:08.302284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749200+0000","last_change":"2024-05-03T22:40:25.081258+0000","last_active":"2024-05-03T22:42:11.749200+0000","last_peered":"2024-05-03T22:42:11.749200+0000","last_clean":"2024-05-03T22:42:11.749200+0000","last_became_active":"2024-05-03T22:40:25.080733+0000","last_became_peered":"2024-05-03T22:40:25.080733+0000","last_unstale":"2024-05-03T22:42:11.749200+0000","last_undegraded":"2024-05-03T22:42:11.749200+0000","last_fullsized":"2024-05-03T22:42:11.749200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:46:13.570625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748957+0000","last_change":"2024-05-03T22:40:06.747674+0000","last_active":"2024-05-03T22:42:11.748957+0000","last_peered":"2024-05-03T22:42:11.748957+0000","last_clean":"2024-05-03T22:42:11.748957+0000","last_became_active":"2024-05-03T22:40:06.747267+0000","last_became_peered":"2024-05-03T22:40:06.747267+0000","last_unstale":"2024-05-03T22:42:11.748957+0000","last_undegraded":"2024-05-03T22:42:11.748957+0000","last_fullsized":"2024-05-03T22:42:11.748957+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:14:26.142063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740838+0000","last_change":"2024-05-03T22:40:11.769623+0000","last_active":"2024-05-03T22:42:11.740838+0000","last_peered":"2024-05-03T22:42:11.740838+0000","last_clean":"2024-05-03T22:42:11.740838+0000","last_became_active":"2024-05-03T22:40:11.769292+0000","last_became_peered":"2024-05-03T22:40:11.769292+0000","last_unstale":"2024-05-03T22:42:11.740838+0000","last_undegraded":"2024-05-03T22:42:11.740838+0000","last_fullsized":"2024-05-03T22:42:11.740838+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:37:49.533502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748423+0000","last_change":"2024-05-03T22:41:10.787906+0000","last_active":"2024-05-03T22:42:11.748423+0000","last_peered":"2024-05-03T22:42:11.748423+0000","last_clean":"2024-05-03T22:42:11.748423+0000","last_became_active":"2024-05-03T22:41:10.787233+0000","last_became_peered":"2024-05-03T22:41:10.787233+0000","last_unstale":"2024-05-03T22:42:11.748423+0000","last_undegraded":"2024-05-03T22:42:11.748423+0000","last_fullsized":"2024-05-03T22:42:11.748423+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:38:50.312605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'12","reported_seq":58,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433815+0000","last_change":"2024-05-03T22:40:06.685620+0000","last_active":"2024-05-03T22:42:11.433815+0000","last_peered":"2024-05-03T22:42:11.433815+0000","last_clean":"2024-05-03T22:42:11.433815+0000","last_became_active":"2024-05-03T22:40:06.684517+0000","last_became_peered":"2024-05-03T22:40:06.684517+0000","last_unstale":"2024-05-03T22:42:11.433815+0000","last_undegraded":"2024-05-03T22:42:11.433815+0000","last_fullsized":"2024-05-03T22:42:11.433815+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:59:26.303253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439484+0000","last_change":"2024-05-03T22:40:11.778444+0000","last_active":"2024-05-03T22:42:11.439484+0000","last_peered":"2024-05-03T22:42:11.439484+0000","last_clean":"2024-05-03T22:42:11.439484+0000","last_became_active":"2024-05-03T22:40:11.778063+0000","last_became_peered":"2024-05-03T22:40:11.778063+0000","last_unstale":"2024-05-03T22:42:11.439484+0000","last_undegraded":"2024-05-03T22:42:11.439484+0000","last_fullsized":"2024-05-03T22:42:11.439484+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:35:53.638075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.752119+0000","last_change":"2024-05-03T22:41:11.625988+0000","last_active":"2024-05-03T22:42:11.752119+0000","last_peered":"2024-05-03T22:42:11.752119+0000","last_clean":"2024-05-03T22:42:11.752119+0000","last_became_active":"2024-05-03T22:41:11.624324+0000","last_became_peered":"2024-05-03T22:41:11.624324+0000","last_unstale":"2024-05-03T22:42:11.752119+0000","last_undegraded":"2024-05-03T22:42:11.752119+0000","last_fullsized":"2024-05-03T22:42:11.752119+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:25:34.600801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,10,3],"acting":[4,6,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"87'5","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433778+0000","last_change":"2024-05-03T22:40:06.690402+0000","last_active":"2024-05-03T22:42:11.433778+0000","last_peered":"2024-05-03T22:42:11.433778+0000","last_clean":"2024-05-03T22:42:11.433778+0000","last_became_active":"2024-05-03T22:40:06.689876+0000","last_became_peered":"2024-05-03T22:40:06.689876+0000","last_unstale":"2024-05-03T22:42:11.433778+0000","last_undegraded":"2024-05-03T22:42:11.433778+0000","last_fullsized":"2024-05-03T22:42:11.433778+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:28:36.929306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749241+0000","last_change":"2024-05-03T22:40:11.779901+0000","last_active":"2024-05-03T22:42:11.749241+0000","last_peered":"2024-05-03T22:42:11.749241+0000","last_clean":"2024-05-03T22:42:11.749241+0000","last_became_active":"2024-05-03T22:40:11.779565+0000","last_became_peered":"2024-05-03T22:40:11.779565+0000","last_unstale":"2024-05-03T22:42:11.749241+0000","last_undegraded":"2024-05-03T22:42:11.749241+0000","last_fullsized":"2024-05-03T22:42:11.749241+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:05:51.650569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425751+0000","last_change":"2024-05-03T22:40:25.080244+0000","last_active":"2024-05-03T22:42:11.425751+0000","last_peered":"2024-05-03T22:42:11.425751+0000","last_clean":"2024-05-03T22:42:11.425751+0000","last_became_active":"2024-05-03T22:40:25.079711+0000","last_became_peered":"2024-05-03T22:40:25.079711+0000","last_unstale":"2024-05-03T22:42:11.425751+0000","last_undegraded":"2024-05-03T22:42:11.425751+0000","last_fullsized":"2024-05-03T22:42:11.425751+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:15:55.577907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'5","reported_seq":175,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:43:44.610197+0000","last_change":"2024-05-03T22:40:06.686480+0000","last_active":"2024-05-03T22:43:44.610197+0000","last_peered":"2024-05-03T22:43:44.610197+0000","last_clean":"2024-05-03T22:43:44.610197+0000","last_became_active":"2024-05-03T22:40:06.685932+0000","last_became_peered":"2024-05-03T22:40:06.685932+0000","last_unstale":"2024-05-03T22:43:44.610197+0000","last_undegraded":"2024-05-03T22:43:44.610197+0000","last_fullsized":"2024-05-03T22:43:44.610197+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:40:50.952599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.443558+0000","last_change":"2024-05-03T22:42:11.442450+0000","last_active":"2024-05-03T22:42:11.443558+0000","last_peered":"2024-05-03T22:42:11.443558+0000","last_clean":"2024-05-03T22:42:11.443558+0000","last_became_active":"2024-05-03T22:42:11.441682+0000","last_became_peered":"2024-05-03T22:42:11.441682+0000","last_unstale":"2024-05-03T22:42:11.443558+0000","last_undegraded":"2024-05-03T22:42:11.443558+0000","last_fullsized":"2024-05-03T22:42:11.443558+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:03:42.054789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426635+0000","last_change":"2024-05-03T22:40:25.086337+0000","last_active":"2024-05-03T22:42:11.426635+0000","last_peered":"2024-05-03T22:42:11.426635+0000","last_clean":"2024-05-03T22:42:11.426635+0000","last_became_active":"2024-05-03T22:40:25.085878+0000","last_became_peered":"2024-05-03T22:40:25.085878+0000","last_unstale":"2024-05-03T22:42:11.426635+0000","last_undegraded":"2024-05-03T22:42:11.426635+0000","last_fullsized":"2024-05-03T22:42:11.426635+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:54.855929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"87'7","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425686+0000","last_change":"2024-05-03T22:40:06.694509+0000","last_active":"2024-05-03T22:42:11.425686+0000","last_peered":"2024-05-03T22:42:11.425686+0000","last_clean":"2024-05-03T22:42:11.425686+0000","last_became_active":"2024-05-03T22:40:06.693782+0000","last_became_peered":"2024-05-03T22:40:06.693782+0000","last_unstale":"2024-05-03T22:42:11.425686+0000","last_undegraded":"2024-05-03T22:42:11.425686+0000","last_fullsized":"2024-05-03T22:42:11.425686+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:44:19.457506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748990+0000","last_change":"2024-05-03T22:40:11.777600+0000","last_active":"2024-05-03T22:42:11.748990+0000","last_peered":"2024-05-03T22:42:11.748990+0000","last_clean":"2024-05-03T22:42:11.748990+0000","last_became_active":"2024-05-03T22:40:11.777231+0000","last_became_peered":"2024-05-03T22:40:11.777231+0000","last_unstale":"2024-05-03T22:42:11.748990+0000","last_undegraded":"2024-05-03T22:42:11.748990+0000","last_fullsized":"2024-05-03T22:42:11.748990+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:48:47.701482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534554+0000","last_change":"2024-05-03T22:40:25.077289+0000","last_active":"2024-05-03T22:42:11.534554+0000","last_peered":"2024-05-03T22:42:11.534554+0000","last_clean":"2024-05-03T22:42:11.534554+0000","last_became_active":"2024-05-03T22:40:25.075368+0000","last_became_peered":"2024-05-03T22:40:25.075368+0000","last_unstale":"2024-05-03T22:42:11.534554+0000","last_undegraded":"2024-05-03T22:42:11.534554+0000","last_fullsized":"2024-05-03T22:42:11.534554+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:56:12.352251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"87'3","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.435281+0000","last_change":"2024-05-03T22:40:06.677202+0000","last_active":"2024-05-03T22:42:11.435281+0000","last_peered":"2024-05-03T22:42:11.435281+0000","last_clean":"2024-05-03T22:42:11.435281+0000","last_became_active":"2024-05-03T22:40:06.674152+0000","last_became_peered":"2024-05-03T22:40:06.674152+0000","last_unstale":"2024-05-03T22:42:11.435281+0000","last_undegraded":"2024-05-03T22:42:11.435281+0000","last_fullsized":"2024-05-03T22:42:11.435281+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:09:18.631126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.538163+0000","last_change":"2024-05-03T22:42:11.538163+0000","last_active":"2024-05-03T22:42:11.538163+0000","last_peered":"2024-05-03T22:42:11.538163+0000","last_clean":"2024-05-03T22:42:11.538163+0000","last_became_active":"2024-05-03T22:42:11.536762+0000","last_became_peered":"2024-05-03T22:42:11.536762+0000","last_unstale":"2024-05-03T22:42:11.538163+0000","last_undegraded":"2024-05-03T22:42:11.538163+0000","last_fullsized":"2024-05-03T22:42:11.538163+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:29:56.947667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,6],"acting":[9,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740873+0000","last_change":"2024-05-03T22:40:25.076722+0000","last_active":"2024-05-03T22:42:11.740873+0000","last_peered":"2024-05-03T22:42:11.740873+0000","last_clean":"2024-05-03T22:42:11.740873+0000","last_became_active":"2024-05-03T22:40:25.076251+0000","last_became_peered":"2024-05-03T22:40:25.076251+0000","last_unstale":"2024-05-03T22:42:11.740873+0000","last_undegraded":"2024-05-03T22:42:11.740873+0000","last_fullsized":"2024-05-03T22:42:11.740873+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:34:12.236790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"87'3","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748436+0000","last_change":"2024-05-03T22:40:06.690531+0000","last_active":"2024-05-03T22:42:11.748436+0000","last_peered":"2024-05-03T22:42:11.748436+0000","last_clean":"2024-05-03T22:42:11.748436+0000","last_became_active":"2024-05-03T22:40:06.690110+0000","last_became_peered":"2024-05-03T22:40:06.690110+0000","last_unstale":"2024-05-03T22:42:11.748436+0000","last_undegraded":"2024-05-03T22:42:11.748436+0000","last_fullsized":"2024-05-03T22:42:11.748436+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:51.350473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428218+0000","last_change":"2024-05-03T22:40:11.774633+0000","last_active":"2024-05-03T22:42:11.428218+0000","last_peered":"2024-05-03T22:42:11.428218+0000","last_clean":"2024-05-03T22:42:11.428218+0000","last_became_active":"2024-05-03T22:40:11.774294+0000","last_became_peered":"2024-05-03T22:40:11.774294+0000","last_unstale":"2024-05-03T22:42:11.428218+0000","last_undegraded":"2024-05-03T22:42:11.428218+0000","last_fullsized":"2024-05-03T22:42:11.428218+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:11:56.967077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748125+0000","last_change":"2024-05-03T22:40:25.085649+0000","last_active":"2024-05-03T22:42:11.748125+0000","last_peered":"2024-05-03T22:42:11.748125+0000","last_clean":"2024-05-03T22:42:11.748125+0000","last_became_active":"2024-05-03T22:40:25.078260+0000","last_became_peered":"2024-05-03T22:40:25.078260+0000","last_unstale":"2024-05-03T22:42:11.748125+0000","last_undegraded":"2024-05-03T22:42:11.748125+0000","last_fullsized":"2024-05-03T22:42:11.748125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:34:29.040741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":299,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:43:47.617369+0000","last_change":"2024-05-03T22:40:06.688665+0000","last_active":"2024-05-03T22:43:47.617369+0000","last_peered":"2024-05-03T22:43:47.617369+0000","last_clean":"2024-05-03T22:43:47.617369+0000","last_became_active":"2024-05-03T22:40:06.687944+0000","last_became_peered":"2024-05-03T22:40:06.687944+0000","last_unstale":"2024-05-03T22:43:47.617369+0000","last_undegraded":"2024-05-03T22:43:47.617369+0000","last_fullsized":"2024-05-03T22:43:47.617369+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:14:43.679499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":250,"num_read_kb":250,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.441711+0000","last_change":"2024-05-03T22:40:11.774446+0000","last_active":"2024-05-03T22:42:11.441711+0000","last_peered":"2024-05-03T22:42:11.441711+0000","last_clean":"2024-05-03T22:42:11.441711+0000","last_became_active":"2024-05-03T22:40:11.774067+0000","last_became_peered":"2024-05-03T22:40:11.774067+0000","last_unstale":"2024-05-03T22:42:11.441711+0000","last_undegraded":"2024-05-03T22:42:11.441711+0000","last_fullsized":"2024-05-03T22:42:11.441711+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:31:34.747963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426370+0000","last_change":"2024-05-03T22:40:25.081436+0000","last_active":"2024-05-03T22:42:11.426370+0000","last_peered":"2024-05-03T22:42:11.426370+0000","last_clean":"2024-05-03T22:42:11.426370+0000","last_became_active":"2024-05-03T22:40:25.080961+0000","last_became_peered":"2024-05-03T22:40:25.080961+0000","last_unstale":"2024-05-03T22:42:11.426370+0000","last_undegraded":"2024-05-03T22:42:11.426370+0000","last_fullsized":"2024-05-03T22:42:11.426370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:40:59.061298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"87'4","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750552+0000","last_change":"2024-05-03T22:40:06.694998+0000","last_active":"2024-05-03T22:42:11.750552+0000","last_peered":"2024-05-03T22:42:11.750552+0000","last_clean":"2024-05-03T22:42:11.750552+0000","last_became_active":"2024-05-03T22:40:06.691406+0000","last_became_peered":"2024-05-03T22:40:06.691406+0000","last_unstale":"2024-05-03T22:42:11.750552+0000","last_undegraded":"2024-05-03T22:42:11.750552+0000","last_fullsized":"2024-05-03T22:42:11.750552+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:14:31.905257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740844+0000","last_change":"2024-05-03T22:40:11.782311+0000","last_active":"2024-05-03T22:42:11.740844+0000","last_peered":"2024-05-03T22:42:11.740844+0000","last_clean":"2024-05-03T22:42:11.740844+0000","last_became_active":"2024-05-03T22:40:11.778580+0000","last_became_peered":"2024-05-03T22:40:11.778580+0000","last_unstale":"2024-05-03T22:42:11.740844+0000","last_undegraded":"2024-05-03T22:42:11.740844+0000","last_fullsized":"2024-05-03T22:42:11.740844+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:11:01.150639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748819+0000","last_change":"2024-05-03T22:41:11.166437+0000","last_active":"2024-05-03T22:42:11.748819+0000","last_peered":"2024-05-03T22:42:11.748819+0000","last_clean":"2024-05-03T22:42:11.748819+0000","last_became_active":"2024-05-03T22:41:11.165246+0000","last_became_peered":"2024-05-03T22:41:11.165246+0000","last_unstale":"2024-05-03T22:42:11.748819+0000","last_undegraded":"2024-05-03T22:42:11.748819+0000","last_fullsized":"2024-05-03T22:42:11.748819+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:37:25.103244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,8],"acting":[4,1,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"87'5","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748872+0000","last_change":"2024-05-03T22:40:06.749132+0000","last_active":"2024-05-03T22:42:11.748872+0000","last_peered":"2024-05-03T22:42:11.748872+0000","last_clean":"2024-05-03T22:42:11.748872+0000","last_became_active":"2024-05-03T22:40:06.748356+0000","last_became_peered":"2024-05-03T22:40:06.748356+0000","last_unstale":"2024-05-03T22:42:11.748872+0000","last_undegraded":"2024-05-03T22:42:11.748872+0000","last_fullsized":"2024-05-03T22:42:11.748872+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:17:48.243084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439747+0000","last_change":"2024-05-03T22:40:11.781238+0000","last_active":"2024-05-03T22:42:11.439747+0000","last_peered":"2024-05-03T22:42:11.439747+0000","last_clean":"2024-05-03T22:42:11.439747+0000","last_became_active":"2024-05-03T22:40:11.780812+0000","last_became_peered":"2024-05-03T22:40:11.780812+0000","last_unstale":"2024-05-03T22:42:11.439747+0000","last_undegraded":"2024-05-03T22:42:11.439747+0000","last_fullsized":"2024-05-03T22:42:11.439747+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:26:25.470321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.430241+0000","last_change":"2024-05-03T22:40:25.084169+0000","last_active":"2024-05-03T22:42:11.430241+0000","last_peered":"2024-05-03T22:42:11.430241+0000","last_clean":"2024-05-03T22:42:11.430241+0000","last_became_active":"2024-05-03T22:40:25.083547+0000","last_became_peered":"2024-05-03T22:40:25.083547+0000","last_unstale":"2024-05-03T22:42:11.430241+0000","last_undegraded":"2024-05-03T22:42:11.430241+0000","last_fullsized":"2024-05-03T22:42:11.430241+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:43:46.218698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"89'36","reported_seq":340,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:43:47.616927+0000","last_change":"2024-05-03T22:40:06.692333+0000","last_active":"2024-05-03T22:43:47.616927+0000","last_peered":"2024-05-03T22:43:47.616927+0000","last_clean":"2024-05-03T22:43:47.616927+0000","last_became_active":"2024-05-03T22:40:06.691737+0000","last_became_peered":"2024-05-03T22:40:06.691737+0000","last_unstale":"2024-05-03T22:43:47.616927+0000","last_undegraded":"2024-05-03T22:43:47.616927+0000","last_fullsized":"2024-05-03T22:43:47.616927+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:41:39.669559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60214,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":259,"num_read_kb":189,"num_write":38,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433443+0000","last_change":"2024-05-03T22:40:11.782887+0000","last_active":"2024-05-03T22:42:11.433443+0000","last_peered":"2024-05-03T22:42:11.433443+0000","last_clean":"2024-05-03T22:42:11.433443+0000","last_became_active":"2024-05-03T22:40:11.782098+0000","last_became_peered":"2024-05-03T22:40:11.782098+0000","last_unstale":"2024-05-03T22:42:11.433443+0000","last_undegraded":"2024-05-03T22:42:11.433443+0000","last_fullsized":"2024-05-03T22:42:11.433443+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:07:14.661890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749490+0000","last_change":"2024-05-03T22:40:25.079794+0000","last_active":"2024-05-03T22:42:11.749490+0000","last_peered":"2024-05-03T22:42:11.749490+0000","last_clean":"2024-05-03T22:42:11.749490+0000","last_became_active":"2024-05-03T22:40:25.078516+0000","last_became_peered":"2024-05-03T22:40:25.078516+0000","last_unstale":"2024-05-03T22:42:11.749490+0000","last_undegraded":"2024-05-03T22:42:11.749490+0000","last_fullsized":"2024-05-03T22:42:11.749490+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:34:55.775154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"87'9","reported_seq":56,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426292+0000","last_change":"2024-05-03T22:40:06.689509+0000","last_active":"2024-05-03T22:42:11.426292+0000","last_peered":"2024-05-03T22:42:11.426292+0000","last_clean":"2024-05-03T22:42:11.426292+0000","last_became_active":"2024-05-03T22:40:06.688937+0000","last_became_peered":"2024-05-03T22:40:06.688937+0000","last_unstale":"2024-05-03T22:42:11.426292+0000","last_undegraded":"2024-05-03T22:42:11.426292+0000","last_fullsized":"2024-05-03T22:42:11.426292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:13:48.971563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.431859+0000","last_change":"2024-05-03T22:40:11.780448+0000","last_active":"2024-05-03T22:42:11.431859+0000","last_peered":"2024-05-03T22:42:11.431859+0000","last_clean":"2024-05-03T22:42:11.431859+0000","last_became_active":"2024-05-03T22:40:11.780030+0000","last_became_peered":"2024-05-03T22:40:11.780030+0000","last_unstale":"2024-05-03T22:42:11.431859+0000","last_undegraded":"2024-05-03T22:42:11.431859+0000","last_fullsized":"2024-05-03T22:42:11.431859+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:58:56.207342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534274+0000","last_change":"2024-05-03T22:40:25.075804+0000","last_active":"2024-05-03T22:42:11.534274+0000","last_peered":"2024-05-03T22:42:11.534274+0000","last_clean":"2024-05-03T22:42:11.534274+0000","last_became_active":"2024-05-03T22:40:25.075326+0000","last_became_peered":"2024-05-03T22:40:25.075326+0000","last_unstale":"2024-05-03T22:42:11.534274+0000","last_undegraded":"2024-05-03T22:42:11.534274+0000","last_fullsized":"2024-05-03T22:42:11.534274+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:39:56.065804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"87'5","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748659+0000","last_change":"2024-05-03T22:40:06.690432+0000","last_active":"2024-05-03T22:42:11.748659+0000","last_peered":"2024-05-03T22:42:11.748659+0000","last_clean":"2024-05-03T22:42:11.748659+0000","last_became_active":"2024-05-03T22:40:06.688957+0000","last_became_peered":"2024-05-03T22:40:06.688957+0000","last_unstale":"2024-05-03T22:42:11.748659+0000","last_undegraded":"2024-05-03T22:42:11.748659+0000","last_fullsized":"2024-05-03T22:42:11.748659+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:59:22.523855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750039+0000","last_change":"2024-05-03T22:40:11.789816+0000","last_active":"2024-05-03T22:42:11.750039+0000","last_peered":"2024-05-03T22:42:11.750039+0000","last_clean":"2024-05-03T22:42:11.750039+0000","last_became_active":"2024-05-03T22:40:11.789439+0000","last_became_peered":"2024-05-03T22:40:11.789439+0000","last_unstale":"2024-05-03T22:42:11.750039+0000","last_undegraded":"2024-05-03T22:42:11.750039+0000","last_fullsized":"2024-05-03T22:42:11.750039+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:24:52.874791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428754+0000","last_change":"2024-05-03T22:40:25.091156+0000","last_active":"2024-05-03T22:42:11.428754+0000","last_peered":"2024-05-03T22:42:11.428754+0000","last_clean":"2024-05-03T22:42:11.428754+0000","last_became_active":"2024-05-03T22:40:25.090584+0000","last_became_peered":"2024-05-03T22:40:25.090584+0000","last_unstale":"2024-05-03T22:42:11.428754+0000","last_undegraded":"2024-05-03T22:42:11.428754+0000","last_fullsized":"2024-05-03T22:42:11.428754+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:12:47.194197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":175,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:43:42.602205+0000","last_change":"2024-05-03T22:40:06.687847+0000","last_active":"2024-05-03T22:43:42.602205+0000","last_peered":"2024-05-03T22:43:42.602205+0000","last_clean":"2024-05-03T22:43:42.602205+0000","last_became_active":"2024-05-03T22:40:06.685784+0000","last_became_peered":"2024-05-03T22:40:06.685784+0000","last_unstale":"2024-05-03T22:43:42.602205+0000","last_undegraded":"2024-05-03T22:43:42.602205+0000","last_fullsized":"2024-05-03T22:43:42.602205+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:31:36.403709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748408+0000","last_change":"2024-05-03T22:40:11.777881+0000","last_active":"2024-05-03T22:42:11.748408+0000","last_peered":"2024-05-03T22:42:11.748408+0000","last_clean":"2024-05-03T22:42:11.748408+0000","last_became_active":"2024-05-03T22:40:11.777142+0000","last_became_peered":"2024-05-03T22:40:11.777142+0000","last_unstale":"2024-05-03T22:42:11.748408+0000","last_undegraded":"2024-05-03T22:42:11.748408+0000","last_fullsized":"2024-05-03T22:42:11.748408+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:43:19.150547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.437231+0000","last_change":"2024-05-03T22:40:25.072488+0000","last_active":"2024-05-03T22:42:11.437231+0000","last_peered":"2024-05-03T22:42:11.437231+0000","last_clean":"2024-05-03T22:42:11.437231+0000","last_became_active":"2024-05-03T22:40:25.072030+0000","last_became_peered":"2024-05-03T22:40:25.072030+0000","last_unstale":"2024-05-03T22:42:11.437231+0000","last_undegraded":"2024-05-03T22:42:11.437231+0000","last_fullsized":"2024-05-03T22:42:11.437231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:01:13.875349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"87'17","reported_seq":63,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.432823+0000","last_change":"2024-05-03T22:40:06.748069+0000","last_active":"2024-05-03T22:42:11.432823+0000","last_peered":"2024-05-03T22:42:11.432823+0000","last_clean":"2024-05-03T22:42:11.432823+0000","last_became_active":"2024-05-03T22:40:06.747095+0000","last_became_peered":"2024-05-03T22:40:06.747095+0000","last_unstale":"2024-05-03T22:42:11.432823+0000","last_undegraded":"2024-05-03T22:42:11.432823+0000","last_fullsized":"2024-05-03T22:42:11.432823+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:56:39.715496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748810+0000","last_change":"2024-05-03T22:40:11.780695+0000","last_active":"2024-05-03T22:42:11.748810+0000","last_peered":"2024-05-03T22:42:11.748810+0000","last_clean":"2024-05-03T22:42:11.748810+0000","last_became_active":"2024-05-03T22:40:11.780103+0000","last_became_peered":"2024-05-03T22:40:11.780103+0000","last_unstale":"2024-05-03T22:42:11.748810+0000","last_undegraded":"2024-05-03T22:42:11.748810+0000","last_fullsized":"2024-05-03T22:42:11.748810+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:29:22.862772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748647+0000","last_change":"2024-05-03T22:40:25.088547+0000","last_active":"2024-05-03T22:42:11.748647+0000","last_peered":"2024-05-03T22:42:11.748647+0000","last_clean":"2024-05-03T22:42:11.748647+0000","last_became_active":"2024-05-03T22:40:25.088046+0000","last_became_peered":"2024-05-03T22:40:25.088046+0000","last_unstale":"2024-05-03T22:42:11.748647+0000","last_undegraded":"2024-05-03T22:42:11.748647+0000","last_fullsized":"2024-05-03T22:42:11.748647+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:18:15.904858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433451+0000","last_change":"2024-05-03T22:40:06.691109+0000","last_active":"2024-05-03T22:42:11.433451+0000","last_peered":"2024-05-03T22:42:11.433451+0000","last_clean":"2024-05-03T22:42:11.433451+0000","last_became_active":"2024-05-03T22:40:06.690539+0000","last_became_peered":"2024-05-03T22:40:06.690539+0000","last_unstale":"2024-05-03T22:42:11.433451+0000","last_undegraded":"2024-05-03T22:42:11.433451+0000","last_fullsized":"2024-05-03T22:42:11.433451+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T01:18:00.701472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534918+0000","last_change":"2024-05-03T22:40:11.774465+0000","last_active":"2024-05-03T22:42:11.534918+0000","last_peered":"2024-05-03T22:42:11.534918+0000","last_clean":"2024-05-03T22:42:11.534918+0000","last_became_active":"2024-05-03T22:40:11.772816+0000","last_became_peered":"2024-05-03T22:40:11.772816+0000","last_unstale":"2024-05-03T22:42:11.534918+0000","last_undegraded":"2024-05-03T22:42:11.534918+0000","last_fullsized":"2024-05-03T22:42:11.534918+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:14:28.206641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433133+0000","last_change":"2024-05-03T22:40:25.089301+0000","last_active":"2024-05-03T22:42:11.433133+0000","last_peered":"2024-05-03T22:42:11.433133+0000","last_clean":"2024-05-03T22:42:11.433133+0000","last_became_active":"2024-05-03T22:40:25.086336+0000","last_became_peered":"2024-05-03T22:40:25.086336+0000","last_unstale":"2024-05-03T22:42:11.433133+0000","last_undegraded":"2024-05-03T22:42:11.433133+0000","last_fullsized":"2024-05-03T22:42:11.433133+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:25:07.377584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"87'1","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428951+0000","last_change":"2024-05-03T22:40:06.750880+0000","last_active":"2024-05-03T22:42:11.428951+0000","last_peered":"2024-05-03T22:42:11.428951+0000","last_clean":"2024-05-03T22:42:11.428951+0000","last_became_active":"2024-05-03T22:40:06.750288+0000","last_became_peered":"2024-05-03T22:40:06.750288+0000","last_unstale":"2024-05-03T22:42:11.428951+0000","last_undegraded":"2024-05-03T22:42:11.428951+0000","last_fullsized":"2024-05-03T22:42:11.428951+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:29:09.545101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.427517+0000","last_change":"2024-05-03T22:40:11.769141+0000","last_active":"2024-05-03T22:42:11.427517+0000","last_peered":"2024-05-03T22:42:11.427517+0000","last_clean":"2024-05-03T22:42:11.427517+0000","last_became_active":"2024-05-03T22:40:11.768778+0000","last_became_peered":"2024-05-03T22:40:11.768778+0000","last_unstale":"2024-05-03T22:42:11.427517+0000","last_undegraded":"2024-05-03T22:42:11.427517+0000","last_fullsized":"2024-05-03T22:42:11.427517+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:15:45.811547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433113+0000","last_change":"2024-05-03T22:40:25.080100+0000","last_active":"2024-05-03T22:42:11.433113+0000","last_peered":"2024-05-03T22:42:11.433113+0000","last_clean":"2024-05-03T22:42:11.433113+0000","last_became_active":"2024-05-03T22:40:25.077009+0000","last_became_peered":"2024-05-03T22:40:25.077009+0000","last_unstale":"2024-05-03T22:42:11.433113+0000","last_undegraded":"2024-05-03T22:42:11.433113+0000","last_fullsized":"2024-05-03T22:42:11.433113+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:40:24.771677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"87'5","reported_seq":146,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:43:45.597277+0000","last_change":"2024-05-03T22:41:11.166956+0000","last_active":"2024-05-03T22:43:45.597277+0000","last_peered":"2024-05-03T22:43:45.597277+0000","last_clean":"2024-05-03T22:43:45.597277+0000","last_became_active":"2024-05-03T22:41:11.165811+0000","last_became_peered":"2024-05-03T22:41:11.165811+0000","last_unstale":"2024-05-03T22:43:45.597277+0000","last_undegraded":"2024-05-03T22:43:45.597277+0000","last_fullsized":"2024-05-03T22:43:45.597277+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:39:37.554975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,1],"acting":[11,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426142+0000","last_change":"2024-05-03T22:40:11.776660+0000","last_active":"2024-05-03T22:42:11.426142+0000","last_peered":"2024-05-03T22:42:11.426142+0000","last_clean":"2024-05-03T22:42:11.426142+0000","last_became_active":"2024-05-03T22:40:11.775877+0000","last_became_peered":"2024-05-03T22:40:11.775877+0000","last_unstale":"2024-05-03T22:42:11.426142+0000","last_undegraded":"2024-05-03T22:42:11.426142+0000","last_fullsized":"2024-05-03T22:42:11.426142+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:12:34.902276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.436537+0000","last_change":"2024-05-03T22:40:25.078900+0000","last_active":"2024-05-03T22:42:11.436537+0000","last_peered":"2024-05-03T22:42:11.436537+0000","last_clean":"2024-05-03T22:42:11.436537+0000","last_became_active":"2024-05-03T22:40:25.078440+0000","last_became_peered":"2024-05-03T22:40:25.078440+0000","last_unstale":"2024-05-03T22:42:11.436537+0000","last_undegraded":"2024-05-03T22:42:11.436537+0000","last_fullsized":"2024-05-03T22:42:11.436537+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:04:02.204303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748648+0000","last_change":"2024-05-03T22:40:11.780141+0000","last_active":"2024-05-03T22:42:11.748648+0000","last_peered":"2024-05-03T22:42:11.748648+0000","last_clean":"2024-05-03T22:42:11.748648+0000","last_became_active":"2024-05-03T22:40:11.779740+0000","last_became_peered":"2024-05-03T22:40:11.779740+0000","last_unstale":"2024-05-03T22:42:11.748648+0000","last_undegraded":"2024-05-03T22:42:11.748648+0000","last_fullsized":"2024-05-03T22:42:11.748648+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:48:14.419409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":177,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:43:47.616755+0000","last_change":"2024-05-03T22:40:06.747825+0000","last_active":"2024-05-03T22:43:47.616755+0000","last_peered":"2024-05-03T22:43:47.616755+0000","last_clean":"2024-05-03T22:43:47.616755+0000","last_became_active":"2024-05-03T22:40:06.747345+0000","last_became_peered":"2024-05-03T22:40:06.747345+0000","last_unstale":"2024-05-03T22:43:47.616755+0000","last_undegraded":"2024-05-03T22:43:47.616755+0000","last_fullsized":"2024-05-03T22:43:47.616755+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:23:58.770807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":127,"num_read_kb":127,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750186+0000","last_change":"2024-05-03T22:40:25.076382+0000","last_active":"2024-05-03T22:42:11.750186+0000","last_peered":"2024-05-03T22:42:11.750186+0000","last_clean":"2024-05-03T22:42:11.750186+0000","last_became_active":"2024-05-03T22:40:25.075866+0000","last_became_peered":"2024-05-03T22:40:25.075866+0000","last_unstale":"2024-05-03T22:42:11.750186+0000","last_undegraded":"2024-05-03T22:42:11.750186+0000","last_fullsized":"2024-05-03T22:42:11.750186+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:10:58.048190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748398+0000","last_change":"2024-05-03T22:40:11.768232+0000","last_active":"2024-05-03T22:42:11.748398+0000","last_peered":"2024-05-03T22:42:11.748398+0000","last_clean":"2024-05-03T22:42:11.748398+0000","last_became_active":"2024-05-03T22:40:11.767784+0000","last_became_peered":"2024-05-03T22:40:11.767784+0000","last_unstale":"2024-05-03T22:42:11.748398+0000","last_undegraded":"2024-05-03T22:42:11.748398+0000","last_fullsized":"2024-05-03T22:42:11.748398+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:37:41.299588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'6","reported_seq":54,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748610+0000","last_change":"2024-05-03T22:40:06.681934+0000","last_active":"2024-05-03T22:42:11.748610+0000","last_peered":"2024-05-03T22:42:11.748610+0000","last_clean":"2024-05-03T22:42:11.748610+0000","last_became_active":"2024-05-03T22:40:06.675829+0000","last_became_peered":"2024-05-03T22:40:06.675829+0000","last_unstale":"2024-05-03T22:42:11.748610+0000","last_undegraded":"2024-05-03T22:42:11.748610+0000","last_fullsized":"2024-05-03T22:42:11.748610+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:06:23.890364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":116,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748263+0000","last_change":"2024-05-03T22:38:10.625763+0000","last_active":"2024-05-03T22:42:11.748263+0000","last_peered":"2024-05-03T22:42:11.748263+0000","last_clean":"2024-05-03T22:42:11.748263+0000","last_became_active":"2024-05-03T22:38:10.607711+0000","last_became_peered":"2024-05-03T22:38:10.607711+0000","last_unstale":"2024-05-03T22:42:11.748263+0000","last_undegraded":"2024-05-03T22:42:11.748263+0000","last_fullsized":"2024-05-03T22:42:11.748263+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:33:25.181816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:33:25.181816+0000","last_clean_scrub_stamp":"2024-05-03T22:33:25.181816+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:10:54.973897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749392+0000","last_change":"2024-05-03T22:41:11.623002+0000","last_active":"2024-05-03T22:42:11.749392+0000","last_peered":"2024-05-03T22:42:11.749392+0000","last_clean":"2024-05-03T22:42:11.749392+0000","last_became_active":"2024-05-03T22:41:11.621904+0000","last_became_peered":"2024-05-03T22:41:11.621904+0000","last_unstale":"2024-05-03T22:42:11.749392+0000","last_undegraded":"2024-05-03T22:42:11.749392+0000","last_fullsized":"2024-05-03T22:42:11.749392+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:01:12.917296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.442292+0000","last_change":"2024-05-03T22:42:11.440087+0000","last_active":"2024-05-03T22:42:11.442292+0000","last_peered":"2024-05-03T22:42:11.442292+0000","last_clean":"2024-05-03T22:42:11.442292+0000","last_became_active":"2024-05-03T22:42:11.438630+0000","last_became_peered":"2024-05-03T22:42:11.438630+0000","last_unstale":"2024-05-03T22:42:11.442292+0000","last_undegraded":"2024-05-03T22:42:11.442292+0000","last_fullsized":"2024-05-03T22:42:11.442292+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:21:37.660638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,2],"acting":[6,9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'4","reported_seq":55,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748282+0000","last_change":"2024-05-03T22:41:10.787499+0000","last_active":"2024-05-03T22:42:11.748282+0000","last_peered":"2024-05-03T22:42:11.748282+0000","last_clean":"2024-05-03T22:42:11.748282+0000","last_became_active":"2024-05-03T22:41:10.786987+0000","last_became_peered":"2024-05-03T22:41:10.786987+0000","last_unstale":"2024-05-03T22:42:11.748282+0000","last_undegraded":"2024-05-03T22:42:11.748282+0000","last_fullsized":"2024-05-03T22:42:11.748282+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:18:39.460516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534038+0000","last_change":"2024-05-03T22:40:25.072522+0000","last_active":"2024-05-03T22:42:11.534038+0000","last_peered":"2024-05-03T22:42:11.534038+0000","last_clean":"2024-05-03T22:42:11.534038+0000","last_became_active":"2024-05-03T22:40:25.071988+0000","last_became_peered":"2024-05-03T22:40:25.071988+0000","last_unstale":"2024-05-03T22:42:11.534038+0000","last_undegraded":"2024-05-03T22:42:11.534038+0000","last_fullsized":"2024-05-03T22:42:11.534038+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:36:49.992077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"87'4","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433575+0000","last_change":"2024-05-03T22:40:06.748316+0000","last_active":"2024-05-03T22:42:11.433575+0000","last_peered":"2024-05-03T22:42:11.433575+0000","last_clean":"2024-05-03T22:42:11.433575+0000","last_became_active":"2024-05-03T22:40:06.747321+0000","last_became_peered":"2024-05-03T22:40:06.747321+0000","last_unstale":"2024-05-03T22:42:11.433575+0000","last_undegraded":"2024-05-03T22:42:11.433575+0000","last_fullsized":"2024-05-03T22:42:11.433575+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:59:52.305810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433571+0000","last_change":"2024-05-03T22:40:11.773115+0000","last_active":"2024-05-03T22:42:11.433571+0000","last_peered":"2024-05-03T22:42:11.433571+0000","last_clean":"2024-05-03T22:42:11.433571+0000","last_became_active":"2024-05-03T22:40:11.771352+0000","last_became_peered":"2024-05-03T22:40:11.771352+0000","last_unstale":"2024-05-03T22:42:11.433571+0000","last_undegraded":"2024-05-03T22:42:11.433571+0000","last_fullsized":"2024-05-03T22:42:11.433571+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:24:36.913141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748104+0000","last_change":"2024-05-03T22:40:25.083290+0000","last_active":"2024-05-03T22:42:11.748104+0000","last_peered":"2024-05-03T22:42:11.748104+0000","last_clean":"2024-05-03T22:42:11.748104+0000","last_became_active":"2024-05-03T22:40:25.077556+0000","last_became_peered":"2024-05-03T22:40:25.077556+0000","last_unstale":"2024-05-03T22:42:11.748104+0000","last_undegraded":"2024-05-03T22:42:11.748104+0000","last_fullsized":"2024-05-03T22:42:11.748104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:57:43.848783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'14","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:16.180229+0000","last_change":"2024-05-03T22:41:10.795185+0000","last_active":"2024-05-03T22:42:16.180229+0000","last_peered":"2024-05-03T22:42:16.180229+0000","last_clean":"2024-05-03T22:42:16.180229+0000","last_became_active":"2024-05-03T22:41:10.790617+0000","last_became_peered":"2024-05-03T22:41:10.790617+0000","last_unstale":"2024-05-03T22:42:16.180229+0000","last_undegraded":"2024-05-03T22:42:16.180229+0000","last_fullsized":"2024-05-03T22:42:16.180229+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:15:00.364227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749106+0000","last_change":"2024-05-03T22:40:11.769663+0000","last_active":"2024-05-03T22:42:11.749106+0000","last_peered":"2024-05-03T22:42:11.749106+0000","last_clean":"2024-05-03T22:42:11.749106+0000","last_became_active":"2024-05-03T22:40:11.769330+0000","last_became_peered":"2024-05-03T22:40:11.769330+0000","last_unstale":"2024-05-03T22:42:11.749106+0000","last_undegraded":"2024-05-03T22:42:11.749106+0000","last_fullsized":"2024-05-03T22:42:11.749106+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T22:44:12.326952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425185+0000","last_change":"2024-05-03T22:40:25.079604+0000","last_active":"2024-05-03T22:42:11.425185+0000","last_peered":"2024-05-03T22:42:11.425185+0000","last_clean":"2024-05-03T22:42:11.425185+0000","last_became_active":"2024-05-03T22:40:25.076067+0000","last_became_peered":"2024-05-03T22:40:25.076067+0000","last_unstale":"2024-05-03T22:42:11.425185+0000","last_undegraded":"2024-05-03T22:42:11.425185+0000","last_fullsized":"2024-05-03T22:42:11.425185+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:27:03.905659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"87'7","reported_seq":53,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749519+0000","last_change":"2024-05-03T22:40:07.327718+0000","last_active":"2024-05-03T22:42:11.749519+0000","last_peered":"2024-05-03T22:42:11.749519+0000","last_clean":"2024-05-03T22:42:11.749519+0000","last_became_active":"2024-05-03T22:40:07.326930+0000","last_became_peered":"2024-05-03T22:40:07.326930+0000","last_unstale":"2024-05-03T22:42:11.749519+0000","last_undegraded":"2024-05-03T22:42:11.749519+0000","last_fullsized":"2024-05-03T22:42:11.749519+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:46:55.497971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740985+0000","last_change":"2024-05-03T22:40:11.766023+0000","last_active":"2024-05-03T22:42:11.740985+0000","last_peered":"2024-05-03T22:42:11.740985+0000","last_clean":"2024-05-03T22:42:11.740985+0000","last_became_active":"2024-05-03T22:40:11.765263+0000","last_became_peered":"2024-05-03T22:40:11.765263+0000","last_unstale":"2024-05-03T22:42:11.740985+0000","last_undegraded":"2024-05-03T22:42:11.740985+0000","last_fullsized":"2024-05-03T22:42:11.740985+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:55.002669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748827+0000","last_change":"2024-05-03T22:40:25.085411+0000","last_active":"2024-05-03T22:42:11.748827+0000","last_peered":"2024-05-03T22:42:11.748827+0000","last_clean":"2024-05-03T22:42:11.748827+0000","last_became_active":"2024-05-03T22:40:25.084813+0000","last_became_peered":"2024-05-03T22:40:25.084813+0000","last_unstale":"2024-05-03T22:42:11.748827+0000","last_undegraded":"2024-05-03T22:42:11.748827+0000","last_fullsized":"2024-05-03T22:42:11.748827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:41:38.455648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439805+0000","last_change":"2024-05-03T22:40:06.748099+0000","last_active":"2024-05-03T22:42:11.439805+0000","last_peered":"2024-05-03T22:42:11.439805+0000","last_clean":"2024-05-03T22:42:11.439805+0000","last_became_active":"2024-05-03T22:40:06.747702+0000","last_became_peered":"2024-05-03T22:40:06.747702+0000","last_unstale":"2024-05-03T22:42:11.439805+0000","last_undegraded":"2024-05-03T22:42:11.439805+0000","last_fullsized":"2024-05-03T22:42:11.439805+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:12:09.736986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433000+0000","last_change":"2024-05-03T22:40:11.780914+0000","last_active":"2024-05-03T22:42:11.433000+0000","last_peered":"2024-05-03T22:42:11.433000+0000","last_clean":"2024-05-03T22:42:11.433000+0000","last_became_active":"2024-05-03T22:40:11.780481+0000","last_became_peered":"2024-05-03T22:40:11.780481+0000","last_unstale":"2024-05-03T22:42:11.433000+0000","last_undegraded":"2024-05-03T22:42:11.433000+0000","last_fullsized":"2024-05-03T22:42:11.433000+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:34:11.676590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.428877+0000","last_change":"2024-05-03T22:40:25.091028+0000","last_active":"2024-05-03T22:42:11.428877+0000","last_peered":"2024-05-03T22:42:11.428877+0000","last_clean":"2024-05-03T22:42:11.428877+0000","last_became_active":"2024-05-03T22:40:25.090516+0000","last_became_peered":"2024-05-03T22:40:25.090516+0000","last_unstale":"2024-05-03T22:42:11.428877+0000","last_undegraded":"2024-05-03T22:42:11.428877+0000","last_fullsized":"2024-05-03T22:42:11.428877+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:16:17.803991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.9","version":"87'7","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748234+0000","last_change":"2024-05-03T22:40:06.686659+0000","last_active":"2024-05-03T22:42:11.748234+0000","last_peered":"2024-05-03T22:42:11.748234+0000","last_clean":"2024-05-03T22:42:11.748234+0000","last_became_active":"2024-05-03T22:40:06.686049+0000","last_became_peered":"2024-05-03T22:40:06.686049+0000","last_unstale":"2024-05-03T22:42:11.748234+0000","last_undegraded":"2024-05-03T22:42:11.748234+0000","last_fullsized":"2024-05-03T22:42:11.748234+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:18:52.198642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534725+0000","last_change":"2024-05-03T22:40:11.770188+0000","last_active":"2024-05-03T22:42:11.534725+0000","last_peered":"2024-05-03T22:42:11.534725+0000","last_clean":"2024-05-03T22:42:11.534725+0000","last_became_active":"2024-05-03T22:40:11.769792+0000","last_became_peered":"2024-05-03T22:40:11.769792+0000","last_unstale":"2024-05-03T22:42:11.534725+0000","last_undegraded":"2024-05-03T22:42:11.534725+0000","last_fullsized":"2024-05-03T22:42:11.534725+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:33:44.917398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748427+0000","last_change":"2024-05-03T22:40:25.086799+0000","last_active":"2024-05-03T22:42:11.748427+0000","last_peered":"2024-05-03T22:42:11.748427+0000","last_clean":"2024-05-03T22:42:11.748427+0000","last_became_active":"2024-05-03T22:40:25.086318+0000","last_became_peered":"2024-05-03T22:40:25.086318+0000","last_unstale":"2024-05-03T22:42:11.748427+0000","last_undegraded":"2024-05-03T22:42:11.748427+0000","last_fullsized":"2024-05-03T22:42:11.748427+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:03:58.895616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"87'3","reported_seq":48,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425939+0000","last_change":"2024-05-03T22:40:06.687143+0000","last_active":"2024-05-03T22:42:11.425939+0000","last_peered":"2024-05-03T22:42:11.425939+0000","last_clean":"2024-05-03T22:42:11.425939+0000","last_became_active":"2024-05-03T22:40:06.686479+0000","last_became_peered":"2024-05-03T22:40:06.686479+0000","last_unstale":"2024-05-03T22:42:11.425939+0000","last_undegraded":"2024-05-03T22:42:11.425939+0000","last_fullsized":"2024-05-03T22:42:11.425939+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:23:11.325334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748661+0000","last_change":"2024-05-03T22:40:11.766225+0000","last_active":"2024-05-03T22:42:11.748661+0000","last_peered":"2024-05-03T22:42:11.748661+0000","last_clean":"2024-05-03T22:42:11.748661+0000","last_became_active":"2024-05-03T22:40:11.765888+0000","last_became_peered":"2024-05-03T22:40:11.765888+0000","last_unstale":"2024-05-03T22:42:11.748661+0000","last_undegraded":"2024-05-03T22:42:11.748661+0000","last_fullsized":"2024-05-03T22:42:11.748661+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:12:31.300562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749146+0000","last_change":"2024-05-03T22:40:25.081276+0000","last_active":"2024-05-03T22:42:11.749146+0000","last_peered":"2024-05-03T22:42:11.749146+0000","last_clean":"2024-05-03T22:42:11.749146+0000","last_became_active":"2024-05-03T22:40:25.080766+0000","last_became_peered":"2024-05-03T22:40:25.080766+0000","last_unstale":"2024-05-03T22:42:11.749146+0000","last_undegraded":"2024-05-03T22:42:11.749146+0000","last_fullsized":"2024-05-03T22:42:11.749146+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:54:49.970169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":60,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433077+0000","last_change":"2024-05-03T22:41:10.790834+0000","last_active":"2024-05-03T22:42:11.433077+0000","last_peered":"2024-05-03T22:42:11.433077+0000","last_clean":"2024-05-03T22:42:11.433077+0000","last_became_active":"2024-05-03T22:41:10.777613+0000","last_became_peered":"2024-05-03T22:41:10.777613+0000","last_unstale":"2024-05-03T22:42:11.433077+0000","last_undegraded":"2024-05-03T22:42:11.433077+0000","last_fullsized":"2024-05-03T22:42:11.433077+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:28:12.000819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749939+0000","last_change":"2024-05-03T22:40:11.779626+0000","last_active":"2024-05-03T22:42:11.749939+0000","last_peered":"2024-05-03T22:42:11.749939+0000","last_clean":"2024-05-03T22:42:11.749939+0000","last_became_active":"2024-05-03T22:40:11.779232+0000","last_became_peered":"2024-05-03T22:40:11.779232+0000","last_unstale":"2024-05-03T22:42:11.749939+0000","last_undegraded":"2024-05-03T22:42:11.749939+0000","last_fullsized":"2024-05-03T22:42:11.749939+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:46:09.507758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439098+0000","last_change":"2024-05-03T22:40:25.079098+0000","last_active":"2024-05-03T22:42:11.439098+0000","last_peered":"2024-05-03T22:42:11.439098+0000","last_clean":"2024-05-03T22:42:11.439098+0000","last_became_active":"2024-05-03T22:40:25.078646+0000","last_became_peered":"2024-05-03T22:40:25.078646+0000","last_unstale":"2024-05-03T22:42:11.439098+0000","last_undegraded":"2024-05-03T22:42:11.439098+0000","last_fullsized":"2024-05-03T22:42:11.439098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:54:17.938515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"87'6","reported_seq":175,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:43:42.603240+0000","last_change":"2024-05-03T22:40:07.327901+0000","last_active":"2024-05-03T22:43:42.603240+0000","last_peered":"2024-05-03T22:43:42.603240+0000","last_clean":"2024-05-03T22:43:42.603240+0000","last_became_active":"2024-05-03T22:40:07.326619+0000","last_became_peered":"2024-05-03T22:40:07.326619+0000","last_unstale":"2024-05-03T22:43:42.603240+0000","last_undegraded":"2024-05-03T22:43:42.603240+0000","last_fullsized":"2024-05-03T22:43:42.603240+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:38:00.537433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750499+0000","last_change":"2024-05-03T22:40:11.783624+0000","last_active":"2024-05-03T22:42:11.750499+0000","last_peered":"2024-05-03T22:42:11.750499+0000","last_clean":"2024-05-03T22:42:11.750499+0000","last_became_active":"2024-05-03T22:40:11.779891+0000","last_became_peered":"2024-05-03T22:40:11.779891+0000","last_unstale":"2024-05-03T22:42:11.750499+0000","last_undegraded":"2024-05-03T22:42:11.750499+0000","last_fullsized":"2024-05-03T22:42:11.750499+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:54:05.069207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740508+0000","last_change":"2024-05-03T22:40:25.089793+0000","last_active":"2024-05-03T22:42:11.740508+0000","last_peered":"2024-05-03T22:42:11.740508+0000","last_clean":"2024-05-03T22:42:11.740508+0000","last_became_active":"2024-05-03T22:40:25.087879+0000","last_became_peered":"2024-05-03T22:40:25.087879+0000","last_unstale":"2024-05-03T22:42:11.740508+0000","last_undegraded":"2024-05-03T22:42:11.740508+0000","last_fullsized":"2024-05-03T22:42:11.740508+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:36:39.533480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"87'3","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749307+0000","last_change":"2024-05-03T22:40:06.679093+0000","last_active":"2024-05-03T22:42:11.749307+0000","last_peered":"2024-05-03T22:42:11.749307+0000","last_clean":"2024-05-03T22:42:11.749307+0000","last_became_active":"2024-05-03T22:40:06.677527+0000","last_became_peered":"2024-05-03T22:40:06.677527+0000","last_unstale":"2024-05-03T22:42:11.749307+0000","last_undegraded":"2024-05-03T22:42:11.749307+0000","last_fullsized":"2024-05-03T22:42:11.749307+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T08:26:34.600615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749632+0000","last_change":"2024-05-03T22:40:11.774786+0000","last_active":"2024-05-03T22:42:11.749632+0000","last_peered":"2024-05-03T22:42:11.749632+0000","last_clean":"2024-05-03T22:42:11.749632+0000","last_became_active":"2024-05-03T22:40:11.767060+0000","last_became_peered":"2024-05-03T22:40:11.767060+0000","last_unstale":"2024-05-03T22:42:11.749632+0000","last_undegraded":"2024-05-03T22:42:11.749632+0000","last_fullsized":"2024-05-03T22:42:11.749632+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T09:28:47.576215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748315+0000","last_change":"2024-05-03T22:40:25.076231+0000","last_active":"2024-05-03T22:42:11.748315+0000","last_peered":"2024-05-03T22:42:11.748315+0000","last_clean":"2024-05-03T22:42:11.748315+0000","last_became_active":"2024-05-03T22:40:25.075787+0000","last_became_peered":"2024-05-03T22:40:25.075787+0000","last_unstale":"2024-05-03T22:42:11.748315+0000","last_undegraded":"2024-05-03T22:42:11.748315+0000","last_fullsized":"2024-05-03T22:42:11.748315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:24.027776+0000","last_clean_scrub_stamp":"2024-05-03T22:40:24.027776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:17:10.068772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"87'5","reported_seq":60,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.436969+0000","last_change":"2024-05-03T22:41:11.174406+0000","last_active":"2024-05-03T22:42:11.436969+0000","last_peered":"2024-05-03T22:42:11.436969+0000","last_clean":"2024-05-03T22:42:11.436969+0000","last_became_active":"2024-05-03T22:41:11.166209+0000","last_became_peered":"2024-05-03T22:41:11.166209+0000","last_unstale":"2024-05-03T22:42:11.436969+0000","last_undegraded":"2024-05-03T22:42:11.436969+0000","last_fullsized":"2024-05-03T22:42:11.436969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:05.644070+0000","last_clean_scrub_stamp":"2024-05-03T22:40:05.644070+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:35:06.117972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,1],"acting":[6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.750601+0000","last_change":"2024-05-03T22:40:11.781047+0000","last_active":"2024-05-03T22:42:11.750601+0000","last_peered":"2024-05-03T22:42:11.750601+0000","last_clean":"2024-05-03T22:42:11.750601+0000","last_became_active":"2024-05-03T22:40:11.779374+0000","last_became_peered":"2024-05-03T22:40:11.779374+0000","last_unstale":"2024-05-03T22:42:11.750601+0000","last_undegraded":"2024-05-03T22:42:11.750601+0000","last_fullsized":"2024-05-03T22:42:11.750601+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:18:35.718495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534982+0000","last_change":"2024-05-03T22:40:11.773640+0000","last_active":"2024-05-03T22:42:11.534982+0000","last_peered":"2024-05-03T22:42:11.534982+0000","last_clean":"2024-05-03T22:42:11.534982+0000","last_became_active":"2024-05-03T22:40:11.772554+0000","last_became_peered":"2024-05-03T22:40:11.772554+0000","last_unstale":"2024-05-03T22:42:11.534982+0000","last_undegraded":"2024-05-03T22:42:11.534982+0000","last_fullsized":"2024-05-03T22:42:11.534982+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:19:24.593238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.425429+0000","last_change":"2024-05-03T22:41:10.787952+0000","last_active":"2024-05-03T22:42:11.425429+0000","last_peered":"2024-05-03T22:42:11.425429+0000","last_clean":"2024-05-03T22:42:11.425429+0000","last_became_active":"2024-05-03T22:41:10.787399+0000","last_became_peered":"2024-05-03T22:41:10.787399+0000","last_unstale":"2024-05-03T22:42:11.425429+0000","last_undegraded":"2024-05-03T22:42:11.425429+0000","last_fullsized":"2024-05-03T22:42:11.425429+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:56:00.722885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426316+0000","last_change":"2024-05-03T22:40:11.767997+0000","last_active":"2024-05-03T22:42:11.426316+0000","last_peered":"2024-05-03T22:42:11.426316+0000","last_clean":"2024-05-03T22:42:11.426316+0000","last_became_active":"2024-05-03T22:40:11.765779+0000","last_became_peered":"2024-05-03T22:40:11.765779+0000","last_unstale":"2024-05-03T22:42:11.426316+0000","last_undegraded":"2024-05-03T22:42:11.426316+0000","last_fullsized":"2024-05-03T22:42:11.426316+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-04T23:46:57.126690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.740670+0000","last_change":"2024-05-03T22:40:11.774012+0000","last_active":"2024-05-03T22:42:11.740670+0000","last_peered":"2024-05-03T22:42:11.740670+0000","last_clean":"2024-05-03T22:42:11.740670+0000","last_became_active":"2024-05-03T22:40:11.771152+0000","last_became_peered":"2024-05-03T22:40:11.771152+0000","last_unstale":"2024-05-03T22:42:11.740670+0000","last_undegraded":"2024-05-03T22:42:11.740670+0000","last_fullsized":"2024-05-03T22:42:11.740670+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T07:44:27.905860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.433863+0000","last_change":"2024-05-03T22:40:11.772190+0000","last_active":"2024-05-03T22:42:11.433863+0000","last_peered":"2024-05-03T22:42:11.433863+0000","last_clean":"2024-05-03T22:42:11.433863+0000","last_became_active":"2024-05-03T22:40:11.771788+0000","last_became_peered":"2024-05-03T22:40:11.771788+0000","last_unstale":"2024-05-03T22:42:11.433863+0000","last_undegraded":"2024-05-03T22:42:11.433863+0000","last_fullsized":"2024-05-03T22:42:11.433863+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T04:55:47.610034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.535280+0000","last_change":"2024-05-03T22:40:11.776770+0000","last_active":"2024-05-03T22:42:11.535280+0000","last_peered":"2024-05-03T22:42:11.535280+0000","last_clean":"2024-05-03T22:42:11.535280+0000","last_became_active":"2024-05-03T22:40:11.773644+0000","last_became_peered":"2024-05-03T22:40:11.773644+0000","last_unstale":"2024-05-03T22:42:11.535280+0000","last_undegraded":"2024-05-03T22:42:11.535280+0000","last_fullsized":"2024-05-03T22:42:11.535280+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T06:15:38.145066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.426509+0000","last_change":"2024-05-03T22:40:11.771708+0000","last_active":"2024-05-03T22:42:11.426509+0000","last_peered":"2024-05-03T22:42:11.426509+0000","last_clean":"2024-05-03T22:42:11.426509+0000","last_became_active":"2024-05-03T22:40:11.770806+0000","last_became_peered":"2024-05-03T22:40:11.770806+0000","last_unstale":"2024-05-03T22:42:11.426509+0000","last_undegraded":"2024-05-03T22:42:11.426509+0000","last_fullsized":"2024-05-03T22:42:11.426509+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:25:46.219330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.749291+0000","last_change":"2024-05-03T22:40:11.773209+0000","last_active":"2024-05-03T22:42:11.749291+0000","last_peered":"2024-05-03T22:42:11.749291+0000","last_clean":"2024-05-03T22:42:11.749291+0000","last_became_active":"2024-05-03T22:40:11.771783+0000","last_became_peered":"2024-05-03T22:40:11.771783+0000","last_unstale":"2024-05-03T22:42:11.749291+0000","last_undegraded":"2024-05-03T22:42:11.749291+0000","last_fullsized":"2024-05-03T22:42:11.749291+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T10:06:28.133378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748547+0000","last_change":"2024-05-03T22:40:11.771988+0000","last_active":"2024-05-03T22:42:11.748547+0000","last_peered":"2024-05-03T22:42:11.748547+0000","last_clean":"2024-05-03T22:42:11.748547+0000","last_became_active":"2024-05-03T22:40:11.771542+0000","last_became_peered":"2024-05-03T22:40:11.771542+0000","last_unstale":"2024-05-03T22:42:11.748547+0000","last_undegraded":"2024-05-03T22:42:11.748547+0000","last_fullsized":"2024-05-03T22:42:11.748547+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:31:59.912571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.748253+0000","last_change":"2024-05-03T22:40:11.762129+0000","last_active":"2024-05-03T22:42:11.748253+0000","last_peered":"2024-05-03T22:42:11.748253+0000","last_clean":"2024-05-03T22:42:11.748253+0000","last_became_active":"2024-05-03T22:40:11.761770+0000","last_became_peered":"2024-05-03T22:40:11.761770+0000","last_unstale":"2024-05-03T22:42:11.748253+0000","last_undegraded":"2024-05-03T22:42:11.748253+0000","last_fullsized":"2024-05-03T22:42:11.748253+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T03:02:10.618602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.439941+0000","last_change":"2024-05-03T22:40:11.788411+0000","last_active":"2024-05-03T22:42:11.439941+0000","last_peered":"2024-05-03T22:42:11.439941+0000","last_clean":"2024-05-03T22:42:11.439941+0000","last_became_active":"2024-05-03T22:40:11.785013+0000","last_became_peered":"2024-05-03T22:40:11.785013+0000","last_unstale":"2024-05-03T22:42:11.439941+0000","last_undegraded":"2024-05-03T22:42:11.439941+0000","last_fullsized":"2024-05-03T22:42:11.439941+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T00:36:41.638224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.432131+0000","last_change":"2024-05-03T22:40:11.773992+0000","last_active":"2024-05-03T22:42:11.432131+0000","last_peered":"2024-05-03T22:42:11.432131+0000","last_clean":"2024-05-03T22:42:11.432131+0000","last_became_active":"2024-05-03T22:40:11.772926+0000","last_became_peered":"2024-05-03T22:40:11.772926+0000","last_unstale":"2024-05-03T22:42:11.432131+0000","last_undegraded":"2024-05-03T22:42:11.432131+0000","last_fullsized":"2024-05-03T22:42:11.432131+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T02:02:57.215605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-05-03T22:42:11.534925+0000","last_change":"2024-05-03T22:40:11.777987+0000","last_active":"2024-05-03T22:42:11.534925+0000","last_peered":"2024-05-03T22:42:11.534925+0000","last_clean":"2024-05-03T22:42:11.534925+0000","last_became_active":"2024-05-03T22:40:11.774177+0000","last_became_peered":"2024-05-03T22:40:11.774177+0000","last_unstale":"2024-05-03T22:42:11.534925+0000","last_undegraded":"2024-05-03T22:42:11.534925+0000","last_fullsized":"2024-05-03T22:42:11.534925+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-03T22:40:10.700964+0000","last_clean_scrub_stamp":"2024-05-03T22:40:10.700964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-05T05:21:57.332460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":67418,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1279,"num_read_kb":720,"num_write":248,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":202254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":214,"ondisk_log_size":214,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":70,"seq":300647710784,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":516983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877907016,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":37028,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708124,"statfs":{"total":95995035648,"available":95957118976,"internally_reserved":0,"allocated":1724416,"data_stored":1163425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":36174272},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":59,"seq":253403070543,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":520030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266773,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1052672,"data_stored":516312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863463004,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1646592,"data_stored":1112221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626531,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":511438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1097728,"data_stored":572682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738508,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1056768,"data_stored":513285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1118208,"data_stored":573293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182521,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1044480,"data_stored":511146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986289,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1040384,"data_stored":515903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822763,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32804,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712348,"statfs":{"total":95995035648,"available":95961444352,"internally_reserved":0,"allocated":1658880,"data_stored":1108000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":61966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-03T22:43:51.364 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-03T22:43:51.364 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-03T22:43:51.364 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-03T22:43:51.364 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph health --format=json 2024-05-03T22:43:51.481 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:51 smithi044 ceph-mon[28604]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:43:51.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:51 smithi060 ceph-mon[31721]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:43:51.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:51 smithi160 ceph-mon[32531]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-03T22:43:51.876 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:43:52.292 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:52 smithi044 ceph-mon[28604]: pgmap v490: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:43:52.417 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:52 smithi160 ceph-mon[32531]: pgmap v490: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:43:52.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:52 smithi060 ceph-mon[31721]: pgmap v490: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:43:54.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.359+0000 7f7abac00700 1 -- 172.21.15.44:0/4059958187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ab41056c0 msgr2=0x7f7ab4105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:54.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.359+0000 7f7abac00700 1 --2- 172.21.15.44:0/4059958187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ab41056c0 0x7f7ab4105b40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009990 tx=0x7f7aa0009ca0 comp rx=0 tx=0).stop 2024-05-03T22:43:54.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.359+0000 7f7abac00700 1 -- 172.21.15.44:0/4059958187 shutdown_connections 2024-05-03T22:43:54.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.359+0000 7f7abac00700 1 --2- 172.21.15.44:0/4059958187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab4106080 0x7f7ab4112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:54.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.359+0000 7f7abac00700 1 --2- 172.21.15.44:0/4059958187 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ab410b6c0 0x7f7ab410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:54.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.359+0000 7f7abac00700 1 --2- 172.21.15.44:0/4059958187 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ab41056c0 0x7f7ab4105b40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:54.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.359+0000 7f7abac00700 1 -- 172.21.15.44:0/4059958187 >> 172.21.15.44:0/4059958187 conn(0x7f7ab4101170 msgr2=0x7f7ab4103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:54.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.359+0000 7f7abac00700 1 -- 172.21.15.44:0/4059958187 shutdown_connections 2024-05-03T22:43:54.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.359+0000 7f7abac00700 1 -- 172.21.15.44:0/4059958187 wait complete. 2024-05-03T22:43:54.362 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:54 smithi044 ceph-mon[28604]: pgmap v491: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:54.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.360+0000 7f7abac00700 1 Processor -- start 2024-05-03T22:43:54.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.361+0000 7f7abac00700 1 -- start start 2024-05-03T22:43:54.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.361+0000 7f7abac00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ab41056c0 0x7f7ab419bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:54.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.361+0000 7f7abac00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ab4106080 0x7f7ab419c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:54.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.361+0000 7f7abac00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab410b6c0 0x7f7ab41a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:54.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.361+0000 7f7abac00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab41159e0 con 0x7f7ab4106080 2024-05-03T22:43:54.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.361+0000 7f7abac00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab4115860 con 0x7f7ab410b6c0 2024-05-03T22:43:54.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.361+0000 7f7abac00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab4115b60 con 0x7f7ab41056c0 2024-05-03T22:43:54.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.361+0000 7f7ab3400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ab4106080 0x7f7ab419c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:54.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.361+0000 7f7ab3400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ab4106080 0x7f7ab419c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47744/0 (socket says 172.21.15.44:47744) 2024-05-03T22:43:54.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.361+0000 7f7ab3400700 1 -- 172.21.15.44:0/4088169501 learned_addr learned my addr 172.21.15.44:0/4088169501 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:54.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.362+0000 7f7ab8c00700 1 --2- 172.21.15.44:0/4088169501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab410b6c0 0x7f7ab41a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:54.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.362+0000 7f7ab3e00700 1 --2- 172.21.15.44:0/4088169501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ab41056c0 0x7f7ab419bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:54.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.362+0000 7f7ab3400700 1 -- 172.21.15.44:0/4088169501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ab41056c0 msgr2=0x7f7ab419bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:54.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.362+0000 7f7ab3400700 1 --2- 172.21.15.44:0/4088169501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ab41056c0 0x7f7ab419bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:54.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.362+0000 7f7ab3400700 1 -- 172.21.15.44:0/4088169501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab410b6c0 msgr2=0x7f7ab41a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:54.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.362+0000 7f7ab3400700 1 --2- 172.21.15.44:0/4088169501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab410b6c0 0x7f7ab41a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:54.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.362+0000 7f7ab3400700 1 -- 172.21.15.44:0/4088169501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab41a0e90 con 0x7f7ab4106080 2024-05-03T22:43:54.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.362+0000 7f7ab3400700 1 --2- 172.21.15.44:0/4088169501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ab4106080 0x7f7ab419c410 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00057c0 tx=0x7f7aa00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:54.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.363+0000 7f7ab0c00700 1 -- 172.21.15.44:0/4088169501 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0027070 con 0x7f7ab4106080 2024-05-03T22:43:54.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.363+0000 7f7ab0c00700 1 -- 172.21.15.44:0/4088169501 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f7aa0004070 con 0x7f7ab4106080 2024-05-03T22:43:54.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.363+0000 7f7abac00700 1 -- 172.21.15.44:0/4088169501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ab41a1120 con 0x7f7ab4106080 2024-05-03T22:43:54.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.363+0000 7f7ab0c00700 1 -- 172.21.15.44:0/4088169501 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0022d40 con 0x7f7ab4106080 2024-05-03T22:43:54.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.363+0000 7f7abac00700 1 -- 172.21.15.44:0/4088169501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ab41a8a00 con 0x7f7ab4106080 2024-05-03T22:43:54.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.364+0000 7f7abac00700 1 -- 172.21.15.44:0/4088169501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ab406a190 con 0x7f7ab4106080 2024-05-03T22:43:54.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.367+0000 7f7ab0c00700 1 -- 172.21.15.44:0/4088169501 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f7aa002a070 con 0x7f7ab4106080 2024-05-03T22:43:54.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.369+0000 7f7ab0c00700 1 --2- 172.21.15.44:0/4088169501 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7a980b2910 0x7f7a980b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:54.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.369+0000 7f7ab0c00700 1 -- 172.21.15.44:0/4088169501 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f7aa00e3b30 con 0x7f7ab4106080 2024-05-03T22:43:54.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.369+0000 7f7ab3e00700 1 --2- 172.21.15.44:0/4088169501 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7a980b2910 0x7f7a980b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:54.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.370+0000 7f7ab3e00700 1 --2- 172.21.15.44:0/4088169501 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7a980b2910 0x7f7a980b4dd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400bbb0 tx=0x7f7aa400b590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:54.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.371+0000 7f7ab0c00700 1 -- 172.21.15.44:0/4088169501 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f7aa0031020 con 0x7f7ab4106080 2024-05-03T22:43:54.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:54 smithi060 ceph-mon[31721]: pgmap v491: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:54.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:54 smithi160 ceph-mon[32531]: pgmap v491: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:54.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.657+0000 7f7abac00700 1 -- 172.21.15.44:0/4088169501 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7ab402e510 con 0x7f7ab4106080 2024-05-03T22:43:54.659 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.658+0000 7f7ab0c00700 1 -- 172.21.15.44:0/4088169501 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f7aa0013070 con 0x7f7ab4106080 2024-05-03T22:43:54.659 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:43:54.660 INFO:teuthology.orchestra.run.smithi044.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-03T22:43:54.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.661+0000 7f7abac00700 1 -- 172.21.15.44:0/4088169501 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7a980b2910 msgr2=0x7f7a980b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:54.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.661+0000 7f7abac00700 1 --2- 172.21.15.44:0/4088169501 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7a980b2910 0x7f7a980b4dd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400bbb0 tx=0x7f7aa400b590 comp rx=0 tx=0).stop 2024-05-03T22:43:54.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.661+0000 7f7abac00700 1 -- 172.21.15.44:0/4088169501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ab4106080 msgr2=0x7f7ab419c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:54.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.661+0000 7f7abac00700 1 --2- 172.21.15.44:0/4088169501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ab4106080 0x7f7ab419c410 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7aa00057c0 tx=0x7f7aa00057f0 comp rx=0 tx=0).stop 2024-05-03T22:43:54.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.662+0000 7f7abac00700 1 -- 172.21.15.44:0/4088169501 shutdown_connections 2024-05-03T22:43:54.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.662+0000 7f7abac00700 1 --2- 172.21.15.44:0/4088169501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ab410b6c0 0x7f7ab41a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:54.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.662+0000 7f7abac00700 1 --2- 172.21.15.44:0/4088169501 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7a980b2910 0x7f7a980b4dd0 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400bbb0 tx=0x7f7aa400b590 comp rx=0 tx=0).stop 2024-05-03T22:43:54.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.662+0000 7f7abac00700 1 --2- 172.21.15.44:0/4088169501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ab41056c0 0x7f7ab419bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:54.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.662+0000 7f7abac00700 1 --2- 172.21.15.44:0/4088169501 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7ab4106080 0x7f7ab419c410 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:54.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.662+0000 7f7abac00700 1 -- 172.21.15.44:0/4088169501 >> 172.21.15.44:0/4088169501 conn(0x7f7ab4101170 msgr2=0x7f7ab41018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:54.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.663+0000 7f7abac00700 1 -- 172.21.15.44:0/4088169501 shutdown_connections 2024-05-03T22:43:54.665 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:54.663+0000 7f7abac00700 1 -- 172.21.15.44:0/4088169501 wait complete. 2024-05-03T22:43:55.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:55 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/4088169501' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-03T22:43:55.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:55 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/4088169501' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-03T22:43:55.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:55 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/4088169501' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-03T22:43:55.566 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-03T22:43:55.567 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:43:56.042 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:43:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:56 smithi044 ceph-mon[28604]: pgmap v492: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:43:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:56 smithi060 ceph-mon[31721]: pgmap v492: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:43:56.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:56 smithi160 ceph-mon[32531]: pgmap v492: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:43:58.362 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:58 smithi044 ceph-mon[28604]: pgmap v493: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:58.384 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.381+0000 7fde4b600700 1 -- 172.21.15.44:0/3624525088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde44104100 msgr2=0x7fde44108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:58.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.381+0000 7fde4b600700 1 --2- 172.21.15.44:0/3624525088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde44104100 0x7fde44108120 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fde300099c0 tx=0x7fde30009cd0 comp rx=0 tx=0).stop 2024-05-03T22:43:58.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.381+0000 7fde4b600700 1 -- 172.21.15.44:0/3624525088 shutdown_connections 2024-05-03T22:43:58.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.381+0000 7fde4b600700 1 --2- 172.21.15.44:0/3624525088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde44108850 0x7fde441103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:58.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.381+0000 7fde4b600700 1 --2- 172.21.15.44:0/3624525088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde44103750 0x7fde44103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:58.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.381+0000 7fde4b600700 1 --2- 172.21.15.44:0/3624525088 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde44104100 0x7fde44108120 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:58.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.381+0000 7fde4b600700 1 -- 172.21.15.44:0/3624525088 >> 172.21.15.44:0/3624525088 conn(0x7fde4407a600 msgr2=0x7fde4407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:58.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.381+0000 7fde4b600700 1 -- 172.21.15.44:0/3624525088 shutdown_connections 2024-05-03T22:43:58.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.381+0000 7fde4b600700 1 -- 172.21.15.44:0/3624525088 wait complete. 2024-05-03T22:43:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.382+0000 7fde4b600700 1 Processor -- start 2024-05-03T22:43:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.382+0000 7fde4b600700 1 -- start start 2024-05-03T22:43:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.383+0000 7fde4b600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde44103750 0x7fde4419f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.383+0000 7fde4b600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde44104100 0x7fde4419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.383+0000 7fde4b600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde44108850 0x7fde44199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.383+0000 7fde4b600700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fde44113750 con 0x7fde44108850 2024-05-03T22:43:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.383+0000 7fde4b600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fde441135d0 con 0x7fde44103750 2024-05-03T22:43:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.383+0000 7fde4b600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fde441138d0 con 0x7fde44104100 2024-05-03T22:43:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.383+0000 7fde49600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde44108850 0x7fde44199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.383+0000 7fde49600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde44108850 0x7fde44199950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47762/0 (socket says 172.21.15.44:47762) 2024-05-03T22:43:58.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.383+0000 7fde49600700 1 -- 172.21.15.44:0/3871315251 learned_addr learned my addr 172.21.15.44:0/3871315251 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:43:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.383+0000 7fde48c00700 1 --2- 172.21.15.44:0/3871315251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde44103750 0x7fde4419f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.384+0000 7fde43e00700 1 --2- 172.21.15.44:0/3871315251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde44104100 0x7fde4419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.384+0000 7fde49600700 1 -- 172.21.15.44:0/3871315251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde44104100 msgr2=0x7fde4419fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.384+0000 7fde49600700 1 --2- 172.21.15.44:0/3871315251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde44104100 0x7fde4419fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.384+0000 7fde49600700 1 -- 172.21.15.44:0/3871315251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde44103750 msgr2=0x7fde4419f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.384+0000 7fde49600700 1 --2- 172.21.15.44:0/3871315251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde44103750 0x7fde4419f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.384+0000 7fde49600700 1 -- 172.21.15.44:0/3871315251 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4419a0b0 con 0x7fde44108850 2024-05-03T22:43:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.384+0000 7fde43e00700 1 --2- 172.21.15.44:0/3871315251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde44104100 0x7fde4419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:43:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.384+0000 7fde49600700 1 --2- 172.21.15.44:0/3871315251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde44108850 0x7fde44199950 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00c970 tx=0x7fde3c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.385+0000 7fde41600700 1 -- 172.21.15.44:0/3871315251 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c00ce60 con 0x7fde44108850 2024-05-03T22:43:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.385+0000 7fde41600700 1 -- 172.21.15.44:0/3871315251 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fde3c004830 con 0x7fde44108850 2024-05-03T22:43:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.385+0000 7fde41600700 1 -- 172.21.15.44:0/3871315251 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3c005570 con 0x7fde44108850 2024-05-03T22:43:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.385+0000 7fde4b600700 1 -- 172.21.15.44:0/3871315251 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde4419a3a0 con 0x7fde44108850 2024-05-03T22:43:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.385+0000 7fde4b600700 1 -- 172.21.15.44:0/3871315251 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde441a6660 con 0x7fde44108850 2024-05-03T22:43:58.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.386+0000 7fde4b600700 1 -- 172.21.15.44:0/3871315251 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde4406a190 con 0x7fde44108850 2024-05-03T22:43:58.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.388+0000 7fde41600700 1 -- 172.21.15.44:0/3871315251 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fde3c0049e0 con 0x7fde44108850 2024-05-03T22:43:58.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.390+0000 7fde41600700 1 --2- 172.21.15.44:0/3871315251 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fde2c0b2990 0x7fde2c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:43:58.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.390+0000 7fde41600700 1 -- 172.21.15.44:0/3871315251 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fde3c0e2730 con 0x7fde44108850 2024-05-03T22:43:58.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.390+0000 7fde48c00700 1 --2- 172.21.15.44:0/3871315251 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fde2c0b2990 0x7fde2c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:43:58.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.391+0000 7fde48c00700 1 --2- 172.21.15.44:0/3871315251 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fde2c0b2990 0x7fde2c0b4e50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fde4419aa90 tx=0x7fde380079e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:43:58.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.392+0000 7fde41600700 1 -- 172.21.15.44:0/3871315251 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fde3c014030 con 0x7fde44108850 2024-05-03T22:43:58.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:58 smithi060 ceph-mon[31721]: pgmap v493: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:58.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:58 smithi160 ceph-mon[32531]: pgmap v493: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:43:58.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.674+0000 7fde4b600700 1 -- 172.21.15.44:0/3871315251 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde4402e510 con 0x7fde44108850 2024-05-03T22:43:58.677 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.675+0000 7fde41600700 1 -- 172.21.15.44:0/3871315251 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11932 (secure 0 0 0) 0x7fde3c0a9f00 con 0x7fde44108850 2024-05-03T22:43:58.678 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:43:58.678 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2550955759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2550955759},{"type":"v1","addr":"172.21.15.44:6835","nonce":2550955759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3118490782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3118490782},{"type":"v1","addr":"172.21.15.44:6837","nonce":3118490782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T22:40:14.758857+0000","modified":"2024-05-03T22:41:47.427474+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34463,"mds_1":34427,"mds_2":34409,"mds_3":34391,"mds_4":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/1408147232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1408147232},{"type":"v1","addr":"172.21.15.44:6839","nonce":1408147232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14607":{"gid":14607,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/4262223160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":4262223160},{"type":"v1","addr":"172.21.15.44:6841","nonce":4262223160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/1332937382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1332937382},{"type":"v1","addr":"172.21.15.160:6835","nonce":1332937382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/3735287805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3735287805},{"type":"v1","addr":"172.21.15.160:6837","nonce":3735287805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.160:6839/861756806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":861756806},{"type":"v1","addr":"172.21.15.160:6839","nonce":861756806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34391":{"gid":34391,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":41,"addr":"172.21.15.60:6833/153110190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":153110190},{"type":"v1","addr":"172.21.15.60:6833","nonce":153110190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.60:6835/3390425489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3390425489},{"type":"v1","addr":"172.21.15.60:6835","nonce":3390425489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.60:6837/3568217572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3568217572},{"type":"v1","addr":"172.21.15.60:6837","nonce":3568217572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.60:6839/2420093605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2420093605},{"type":"v1","addr":"172.21.15.60:6839","nonce":2420093605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34463,"qdb_cluster":[34463,34427,34409,24493,34391]},"id":1}]} 2024-05-03T22:43:58.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.678+0000 7fde4b600700 1 -- 172.21.15.44:0/3871315251 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fde2c0b2990 msgr2=0x7fde2c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:58.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.678+0000 7fde4b600700 1 --2- 172.21.15.44:0/3871315251 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fde2c0b2990 0x7fde2c0b4e50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fde4419aa90 tx=0x7fde380079e0 comp rx=0 tx=0).stop 2024-05-03T22:43:58.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.678+0000 7fde4b600700 1 -- 172.21.15.44:0/3871315251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde44108850 msgr2=0x7fde44199950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:43:58.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.678+0000 7fde4b600700 1 --2- 172.21.15.44:0/3871315251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde44108850 0x7fde44199950 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00c970 tx=0x7fde3c00cc80 comp rx=0 tx=0).stop 2024-05-03T22:43:58.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.679+0000 7fde4b600700 1 -- 172.21.15.44:0/3871315251 shutdown_connections 2024-05-03T22:43:58.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.679+0000 7fde4b600700 1 --2- 172.21.15.44:0/3871315251 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fde44108850 0x7fde44199950 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:58.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.679+0000 7fde4b600700 1 --2- 172.21.15.44:0/3871315251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde44103750 0x7fde4419f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:58.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.679+0000 7fde4b600700 1 --2- 172.21.15.44:0/3871315251 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fde2c0b2990 0x7fde2c0b4e50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:58.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.679+0000 7fde4b600700 1 --2- 172.21.15.44:0/3871315251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde44104100 0x7fde4419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:43:58.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.679+0000 7fde4b600700 1 -- 172.21.15.44:0/3871315251 >> 172.21.15.44:0/3871315251 conn(0x7fde4407a600 msgr2=0x7fde44107310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:43:58.682 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.679+0000 7fde4b600700 1 -- 172.21.15.44:0/3871315251 shutdown_connections 2024-05-03T22:43:58.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:43:58.679+0000 7fde4b600700 1 -- 172.21.15.44:0/3871315251 wait complete. 2024-05-03T22:43:58.683 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 30 2024-05-03T22:43:59.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:43:59 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3871315251' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:43:59.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:43:59 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3871315251' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:43:59.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:43:59 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3871315251' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:43:59.663 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:44:00.136 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:44:00.457 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:00 smithi044 ceph-mon[28604]: pgmap v494: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:44:00.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:00 smithi060 ceph-mon[31721]: pgmap v494: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:44:00.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:00 smithi160 ceph-mon[32531]: pgmap v494: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:44:02.415 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:02 smithi044 ceph-mon[28604]: pgmap v495: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:44:02.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.446+0000 7fefa1800700 1 -- 172.21.15.44:0/2516016263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef9c10a490 msgr2=0x7fef9c1169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:02.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.446+0000 7fefa1800700 1 --2- 172.21.15.44:0/2516016263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef9c10a490 0x7fef9c1169a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fef9400b0a0 tx=0x7fef9400b3b0 comp rx=0 tx=0).stop 2024-05-03T22:44:02.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.446+0000 7fefa1800700 1 -- 172.21.15.44:0/2516016263 shutdown_connections 2024-05-03T22:44:02.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.446+0000 7fefa1800700 1 --2- 172.21.15.44:0/2516016263 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef9c10a490 0x7fef9c1169a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:02.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.446+0000 7fefa1800700 1 --2- 172.21.15.44:0/2516016263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef9c10fb60 0x7fef9c10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:02.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.446+0000 7fefa1800700 1 --2- 172.21.15.44:0/2516016263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef9c109ad0 0x7fef9c109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:02.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.446+0000 7fefa1800700 1 -- 172.21.15.44:0/2516016263 >> 172.21.15.44:0/2516016263 conn(0x7fef9c076c70 msgr2=0x7fef9c1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:02.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.446+0000 7fefa1800700 1 -- 172.21.15.44:0/2516016263 shutdown_connections 2024-05-03T22:44:02.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.447+0000 7fefa1800700 1 -- 172.21.15.44:0/2516016263 wait complete. 2024-05-03T22:44:02.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.448+0000 7fefa1800700 1 Processor -- start 2024-05-03T22:44:02.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.448+0000 7fefa1800700 1 -- start start 2024-05-03T22:44:02.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.449+0000 7fefa1800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef9c109ad0 0x7fef9c1a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:02.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.449+0000 7fefa1800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef9c10a490 0x7fef9c1a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:02.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.449+0000 7fefa1800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef9c10fb60 0x7fef9c1a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:02.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.449+0000 7fefa1800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fef9c119e30 con 0x7fef9c10a490 2024-05-03T22:44:02.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.449+0000 7fefa1800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fef9c119cb0 con 0x7fef9c10fb60 2024-05-03T22:44:02.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.449+0000 7fefa1800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fef9c119fb0 con 0x7fef9c109ad0 2024-05-03T22:44:02.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.449+0000 7fef9a000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef9c10a490 0x7fef9c1a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:02.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.449+0000 7fef9a000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef9c10a490 0x7fef9c1a0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57942/0 (socket says 172.21.15.44:57942) 2024-05-03T22:44:02.452 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.449+0000 7fef9a000700 1 -- 172.21.15.44:0/1065163135 learned_addr learned my addr 172.21.15.44:0/1065163135 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:02.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.449+0000 7fef9aa00700 1 --2- 172.21.15.44:0/1065163135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef9c109ad0 0x7fef9c1a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:02.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.449+0000 7fef9b400700 1 --2- 172.21.15.44:0/1065163135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef9c10fb60 0x7fef9c1a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:02.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.449+0000 7fef9a000700 1 -- 172.21.15.44:0/1065163135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef9c109ad0 msgr2=0x7fef9c1a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:02.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.450+0000 7fef9a000700 1 --2- 172.21.15.44:0/1065163135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef9c109ad0 0x7fef9c1a01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:02.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.450+0000 7fef9a000700 1 -- 172.21.15.44:0/1065163135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef9c10fb60 msgr2=0x7fef9c1a4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:02.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.450+0000 7fef9a000700 1 --2- 172.21.15.44:0/1065163135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef9c10fb60 0x7fef9c1a4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:02.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.450+0000 7fef9a000700 1 -- 172.21.15.44:0/1065163135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef9c1a51f0 con 0x7fef9c10a490 2024-05-03T22:44:02.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.450+0000 7fef9b400700 1 --2- 172.21.15.44:0/1065163135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef9c10fb60 0x7fef9c1a4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:44:02.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.450+0000 7fef9a000700 1 --2- 172.21.15.44:0/1065163135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef9c10a490 0x7fef9c1a0720 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fef8800d950 tx=0x7fef8800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:02.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.450+0000 7fef93400700 1 -- 172.21.15.44:0/1065163135 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef88016070 con 0x7fef9c10a490 2024-05-03T22:44:02.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.450+0000 7fef93400700 1 -- 172.21.15.44:0/1065163135 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fef88009b40 con 0x7fef9c10a490 2024-05-03T22:44:02.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.450+0000 7fefa1800700 1 -- 172.21.15.44:0/1065163135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef9c1a54e0 con 0x7fef9c10a490 2024-05-03T22:44:02.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.450+0000 7fef93400700 1 -- 172.21.15.44:0/1065163135 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8800f620 con 0x7fef9c10a490 2024-05-03T22:44:02.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.450+0000 7fefa1800700 1 -- 172.21.15.44:0/1065163135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef9c1acd60 con 0x7fef9c10a490 2024-05-03T22:44:02.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.452+0000 7fefa1800700 1 -- 172.21.15.44:0/1065163135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef9c06a190 con 0x7fef9c10a490 2024-05-03T22:44:02.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.455+0000 7fef93400700 1 -- 172.21.15.44:0/1065163135 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fef88019070 con 0x7fef9c10a490 2024-05-03T22:44:02.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.457+0000 7fef93400700 1 --2- 172.21.15.44:0/1065163135 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fef800b2990 0x7fef800b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:02.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.457+0000 7fef93400700 1 -- 172.21.15.44:0/1065163135 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fef880e2780 con 0x7fef9c10a490 2024-05-03T22:44:02.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.458+0000 7fef9aa00700 1 --2- 172.21.15.44:0/1065163135 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fef800b2990 0x7fef800b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:02.460 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.458+0000 7fef9aa00700 1 --2- 172.21.15.44:0/1065163135 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fef800b2990 0x7fef800b4e50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00bbb0 tx=0x7fef8c00b590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:02.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.462+0000 7fef93400700 1 -- 172.21.15.44:0/1065163135 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fef880a9ed0 con 0x7fef9c10a490 2024-05-03T22:44:02.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:02 smithi060 ceph-mon[31721]: pgmap v495: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:44:02.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:02 smithi160 ceph-mon[32531]: pgmap v495: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:44:02.757 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.754+0000 7fefa1800700 1 -- 172.21.15.44:0/1065163135 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef9c02e510 con 0x7fef9c10a490 2024-05-03T22:44:02.759 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.757+0000 7fef93400700 1 -- 172.21.15.44:0/1065163135 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11932 (secure 0 0 0) 0x7fef880a97d0 con 0x7fef9c10a490 2024-05-03T22:44:02.760 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:44:02.760 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2550955759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2550955759},{"type":"v1","addr":"172.21.15.44:6835","nonce":2550955759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3118490782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3118490782},{"type":"v1","addr":"172.21.15.44:6837","nonce":3118490782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T22:40:14.758857+0000","modified":"2024-05-03T22:41:47.427474+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34463,"mds_1":34427,"mds_2":34409,"mds_3":34391,"mds_4":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/1408147232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1408147232},{"type":"v1","addr":"172.21.15.44:6839","nonce":1408147232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14607":{"gid":14607,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/4262223160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":4262223160},{"type":"v1","addr":"172.21.15.44:6841","nonce":4262223160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/1332937382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1332937382},{"type":"v1","addr":"172.21.15.160:6835","nonce":1332937382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/3735287805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3735287805},{"type":"v1","addr":"172.21.15.160:6837","nonce":3735287805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.160:6839/861756806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":861756806},{"type":"v1","addr":"172.21.15.160:6839","nonce":861756806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34391":{"gid":34391,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":41,"addr":"172.21.15.60:6833/153110190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":153110190},{"type":"v1","addr":"172.21.15.60:6833","nonce":153110190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.60:6835/3390425489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3390425489},{"type":"v1","addr":"172.21.15.60:6835","nonce":3390425489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.60:6837/3568217572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3568217572},{"type":"v1","addr":"172.21.15.60:6837","nonce":3568217572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.60:6839/2420093605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2420093605},{"type":"v1","addr":"172.21.15.60:6839","nonce":2420093605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34463,"qdb_cluster":[34463,34427,34409,24493,34391]},"id":1}]} 2024-05-03T22:44:02.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.760+0000 7fefa1800700 1 -- 172.21.15.44:0/1065163135 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fef800b2990 msgr2=0x7fef800b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:02.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.760+0000 7fefa1800700 1 --2- 172.21.15.44:0/1065163135 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fef800b2990 0x7fef800b4e50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fef8c00bbb0 tx=0x7fef8c00b590 comp rx=0 tx=0).stop 2024-05-03T22:44:02.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.760+0000 7fefa1800700 1 -- 172.21.15.44:0/1065163135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef9c10a490 msgr2=0x7fef9c1a0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:02.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.760+0000 7fefa1800700 1 --2- 172.21.15.44:0/1065163135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef9c10a490 0x7fef9c1a0720 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fef8800d950 tx=0x7fef8800dd10 comp rx=0 tx=0).stop 2024-05-03T22:44:02.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.761+0000 7fefa1800700 1 -- 172.21.15.44:0/1065163135 shutdown_connections 2024-05-03T22:44:02.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.761+0000 7fefa1800700 1 --2- 172.21.15.44:0/1065163135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef9c10fb60 0x7fef9c1a4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:02.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.761+0000 7fefa1800700 1 --2- 172.21.15.44:0/1065163135 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fef800b2990 0x7fef800b4e50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:02.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.761+0000 7fefa1800700 1 --2- 172.21.15.44:0/1065163135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef9c109ad0 0x7fef9c1a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:02.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.761+0000 7fefa1800700 1 --2- 172.21.15.44:0/1065163135 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fef9c10a490 0x7fef9c1a0720 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:02.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.761+0000 7fefa1800700 1 -- 172.21.15.44:0/1065163135 >> 172.21.15.44:0/1065163135 conn(0x7fef9c076c70 msgr2=0x7fef9c077190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:02.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.761+0000 7fefa1800700 1 -- 172.21.15.44:0/1065163135 shutdown_connections 2024-05-03T22:44:02.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:02.761+0000 7fefa1800700 1 -- 172.21.15.44:0/1065163135 wait complete. 2024-05-03T22:44:02.765 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 30 2024-05-03T22:44:03.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:03 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1065163135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:44:03.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:03 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1065163135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:44:03.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:03 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1065163135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:44:03.626 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:44:04.119 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:44:04.500 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:04 smithi044 ceph-mon[28604]: pgmap v496: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:04.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:04 smithi060 ceph-mon[31721]: pgmap v496: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:04.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:04 smithi160 ceph-mon[32531]: pgmap v496: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:06.468 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:06 smithi044 ceph-mon[28604]: pgmap v497: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:44:06.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.479+0000 7f4787e00700 1 -- 172.21.15.44:0/1674702568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47880761f0 msgr2=0x7f478810f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:06.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.479+0000 7f4787e00700 1 --2- 172.21.15.44:0/1674702568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47880761f0 0x7f478810f6d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4774009990 tx=0x7f4774009ca0 comp rx=0 tx=0).stop 2024-05-03T22:44:06.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.480+0000 7f4787e00700 1 -- 172.21.15.44:0/1674702568 shutdown_connections 2024-05-03T22:44:06.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.480+0000 7f4787e00700 1 --2- 172.21.15.44:0/1674702568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f478810fc10 0x7f4788112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:06.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.480+0000 7f4787e00700 1 --2- 172.21.15.44:0/1674702568 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47880758d0 0x7f4788075cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:06.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.480+0000 7f4787e00700 1 --2- 172.21.15.44:0/1674702568 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f47880761f0 0x7f478810f6d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:06.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.480+0000 7f4787e00700 1 -- 172.21.15.44:0/1674702568 >> 172.21.15.44:0/1674702568 conn(0x7f47880fef20 msgr2=0x7f4788101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:06.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.480+0000 7f4787e00700 1 -- 172.21.15.44:0/1674702568 shutdown_connections 2024-05-03T22:44:06.483 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.480+0000 7f4787e00700 1 -- 172.21.15.44:0/1674702568 wait complete. 2024-05-03T22:44:06.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.481+0000 7f4787e00700 1 Processor -- start 2024-05-03T22:44:06.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.481+0000 7f4787e00700 1 -- start start 2024-05-03T22:44:06.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.481+0000 7f4787e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47880758d0 0x7f478819bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:06.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.482+0000 7f4787e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47880761f0 0x7f478819c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:06.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.482+0000 7f4787e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f478810fc10 0x7f47881a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:06.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.482+0000 7f4787e00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f4788115930 con 0x7f478810fc10 2024-05-03T22:44:06.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.482+0000 7f4787e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47881157b0 con 0x7f47880761f0 2024-05-03T22:44:06.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.482+0000 7f4787e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4788115ab0 con 0x7f47880758d0 2024-05-03T22:44:06.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.482+0000 7f4787400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f478810fc10 0x7f47881a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.482+0000 7f4787400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f478810fc10 0x7f47881a0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:57962/0 (socket says 172.21.15.44:57962) 2024-05-03T22:44:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.482+0000 7f4787400700 1 -- 172.21.15.44:0/2068625687 learned_addr learned my addr 172.21.15.44:0/2068625687 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.482+0000 7f4786a00700 1 --2- 172.21.15.44:0/2068625687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47880758d0 0x7f478819bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.482+0000 7f4786000700 1 --2- 172.21.15.44:0/2068625687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47880761f0 0x7f478819c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.483+0000 7f4787400700 1 -- 172.21.15.44:0/2068625687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47880758d0 msgr2=0x7f478819bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.483+0000 7f4787400700 1 --2- 172.21.15.44:0/2068625687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47880758d0 0x7f478819bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.483+0000 7f4787400700 1 -- 172.21.15.44:0/2068625687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47880761f0 msgr2=0x7f478819c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.483+0000 7f4787400700 1 --2- 172.21.15.44:0/2068625687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47880761f0 0x7f478819c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:06.486 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.483+0000 7f4787400700 1 -- 172.21.15.44:0/2068625687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47881a0d90 con 0x7f478810fc10 2024-05-03T22:44:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.483+0000 7f4787400700 1 --2- 172.21.15.44:0/2068625687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f478810fc10 0x7f47881a0650 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4780007ee0 tx=0x7f478000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.483+0000 7f477f400700 1 -- 172.21.15.44:0/2068625687 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478000dbd0 con 0x7f478810fc10 2024-05-03T22:44:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.483+0000 7f477f400700 1 -- 172.21.15.44:0/2068625687 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f478000dd70 con 0x7f478810fc10 2024-05-03T22:44:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.483+0000 7f477f400700 1 -- 172.21.15.44:0/2068625687 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47800133f0 con 0x7f478810fc10 2024-05-03T22:44:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.483+0000 7f4787e00700 1 -- 172.21.15.44:0/2068625687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47881a1080 con 0x7f478810fc10 2024-05-03T22:44:06.487 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.484+0000 7f4787e00700 1 -- 172.21.15.44:0/2068625687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47881a8900 con 0x7f478810fc10 2024-05-03T22:44:06.488 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.485+0000 7f4787e00700 1 -- 172.21.15.44:0/2068625687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f478806a190 con 0x7f478810fc10 2024-05-03T22:44:06.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.487+0000 7f477f400700 1 -- 172.21.15.44:0/2068625687 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f478001a020 con 0x7f478810fc10 2024-05-03T22:44:06.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.488+0000 7f477f400700 1 --2- 172.21.15.44:0/2068625687 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f476c0b2990 0x7f476c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:06.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.489+0000 7f477f400700 1 -- 172.21.15.44:0/2068625687 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f47800e1f30 con 0x7f478810fc10 2024-05-03T22:44:06.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.489+0000 7f4786a00700 1 --2- 172.21.15.44:0/2068625687 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f476c0b2990 0x7f476c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:06.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.490+0000 7f4786a00700 1 --2- 172.21.15.44:0/2068625687 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f476c0b2990 0x7f476c0b4e50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4778005950 tx=0x7f47780058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:06.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.493+0000 7f477f400700 1 -- 172.21.15.44:0/2068625687 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f4780010070 con 0x7f478810fc10 2024-05-03T22:44:06.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:06 smithi060 ceph-mon[31721]: pgmap v497: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:44:06.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:06 smithi160 ceph-mon[32531]: pgmap v497: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:44:06.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.746+0000 7f4787e00700 1 -- 172.21.15.44:0/2068625687 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f478819d0e0 con 0x7f478810fc10 2024-05-03T22:44:06.751 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.748+0000 7f477f400700 1 -- 172.21.15.44:0/2068625687 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24819 (secure 0 0 0) 0x7f47800a9680 con 0x7f478810fc10 2024-05-03T22:44:06.751 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:44:06.752 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":89,"fsid":"5b0efdca-099c-11ef-bc97-c7b262605968","created":"2024-05-03T22:28:49.471963+0000","modified":"2024-05-03T22:42:11.407700+0000","last_up_change":"2024-05-03T22:38:41.446244+0000","last_in_change":"2024-05-03T22:38:16.952689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:33:24.956832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:40:05.501996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:40:09.732161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:40:23.052845+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05869397-bdc9-4c38-b1c6-deb466454dd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6803","nonce":4219032560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6805","nonce":4219032560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6809","nonce":4219032560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6807","nonce":4219032560}]},"public_addr":"172.21.15.44:6803/4219032560","cluster_addr":"172.21.15.44:6805/4219032560","heartbeat_back_addr":"172.21.15.44:6809/4219032560","heartbeat_front_addr":"172.21.15.44:6807/4219032560","state":["exists","up"]},{"osd":1,"uuid":"ff61ca27-e36b-41c9-898f-1cd7af1d9db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6801","nonce":563003638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6803","nonce":563003638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6807","nonce":563003638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6805","nonce":563003638}]},"public_addr":"172.21.15.60:6801/563003638","cluster_addr":"172.21.15.60:6803/563003638","heartbeat_back_addr":"172.21.15.60:6807/563003638","heartbeat_front_addr":"172.21.15.60:6805/563003638","state":["exists","up"]},{"osd":2,"uuid":"e58f96dc-3486-452e-85a1-847a0e2c523a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6801","nonce":2524540447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6803","nonce":2524540447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6807","nonce":2524540447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6805","nonce":2524540447}]},"public_addr":"172.21.15.160:6801/2524540447","cluster_addr":"172.21.15.160:6803/2524540447","heartbeat_back_addr":"172.21.15.160:6807/2524540447","heartbeat_front_addr":"172.21.15.160:6805/2524540447","state":["exists","up"]},{"osd":3,"uuid":"75c56c3b-5807-4646-885c-1ef16541ff72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6811","nonce":3298926279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6813","nonce":3298926279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6817","nonce":3298926279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6815","nonce":3298926279}]},"public_addr":"172.21.15.44:6811/3298926279","cluster_addr":"172.21.15.44:6813/3298926279","heartbeat_back_addr":"172.21.15.44:6817/3298926279","heartbeat_front_addr":"172.21.15.44:6815/3298926279","state":["exists","up"]},{"osd":4,"uuid":"a8a322e4-6ca1-4727-8b41-5ff523acc591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6809","nonce":3794821539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6811","nonce":3794821539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6815","nonce":3794821539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6813","nonce":3794821539}]},"public_addr":"172.21.15.60:6809/3794821539","cluster_addr":"172.21.15.60:6811/3794821539","heartbeat_back_addr":"172.21.15.60:6815/3794821539","heartbeat_front_addr":"172.21.15.60:6813/3794821539","state":["exists","up"]},{"osd":5,"uuid":"bc718527-bacd-4d1b-90c6-758cbd859e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6809","nonce":429142335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6811","nonce":429142335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6815","nonce":429142335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6813","nonce":429142335}]},"public_addr":"172.21.15.160:6809/429142335","cluster_addr":"172.21.15.160:6811/429142335","heartbeat_back_addr":"172.21.15.160:6815/429142335","heartbeat_front_addr":"172.21.15.160:6813/429142335","state":["exists","up"]},{"osd":6,"uuid":"f95a1d05-a958-4e5c-a90a-6b0c3d9fad43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6819","nonce":2805326764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6821","nonce":2805326764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6825","nonce":2805326764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6823","nonce":2805326764}]},"public_addr":"172.21.15.44:6819/2805326764","cluster_addr":"172.21.15.44:6821/2805326764","heartbeat_back_addr":"172.21.15.44:6825/2805326764","heartbeat_front_addr":"172.21.15.44:6823/2805326764","state":["exists","up"]},{"osd":7,"uuid":"a515e4be-c607-4f4a-96bb-c3d395d7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6817","nonce":693512829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6819","nonce":693512829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6823","nonce":693512829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6821","nonce":693512829}]},"public_addr":"172.21.15.60:6817/693512829","cluster_addr":"172.21.15.60:6819/693512829","heartbeat_back_addr":"172.21.15.60:6823/693512829","heartbeat_front_addr":"172.21.15.60:6821/693512829","state":["exists","up"]},{"osd":8,"uuid":"717aeffb-6c51-4e4e-8344-fba70ac2c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6817","nonce":2920554498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6819","nonce":2920554498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6823","nonce":2920554498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6821","nonce":2920554498}]},"public_addr":"172.21.15.160:6817/2920554498","cluster_addr":"172.21.15.160:6819/2920554498","heartbeat_back_addr":"172.21.15.160:6823/2920554498","heartbeat_front_addr":"172.21.15.160:6821/2920554498","state":["exists","up"]},{"osd":9,"uuid":"ade31284-1246-42c8-9cee-e60dacc58a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6827","nonce":414763386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6829","nonce":414763386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6833","nonce":414763386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6831","nonce":414763386}]},"public_addr":"172.21.15.44:6827/414763386","cluster_addr":"172.21.15.44:6829/414763386","heartbeat_back_addr":"172.21.15.44:6833/414763386","heartbeat_front_addr":"172.21.15.44:6831/414763386","state":["exists","up"]},{"osd":10,"uuid":"e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6825","nonce":2396062554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6827","nonce":2396062554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6831","nonce":2396062554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6829","nonce":2396062554}]},"public_addr":"172.21.15.60:6825/2396062554","cluster_addr":"172.21.15.60:6827/2396062554","heartbeat_back_addr":"172.21.15.60:6831/2396062554","heartbeat_front_addr":"172.21.15.60:6829/2396062554","state":["exists","up"]},{"osd":11,"uuid":"b6951585-9337-4b5a-a691-e765deb4b825","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6825","nonce":1397967755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6827","nonce":1397967755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6831","nonce":1397967755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6829","nonce":1397967755}]},"public_addr":"172.21.15.160:6825/1397967755","cluster_addr":"172.21.15.160:6827/1397967755","heartbeat_back_addr":"172.21.15.160:6831/1397967755","heartbeat_front_addr":"172.21.15.160:6829/1397967755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:15.012060+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:48.390669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:21.227227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:56.388453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:34:31.079377+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:04.912058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:40.941904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:16.757849+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:51.591794+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:37:29.022917+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:05.506391+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:39.793901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2661810503":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3426728285":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/4246410673":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2328074241":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/1738155460":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3461866265":"2024-05-04T22:30:08.766919+0000","172.21.15.44:6800/950841500":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/950841500":"2024-05-04T22:29:32.846592+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:44:06.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.751+0000 7f4787e00700 1 -- 172.21.15.44:0/2068625687 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f476c0b2990 msgr2=0x7f476c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:06.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.751+0000 7f4787e00700 1 --2- 172.21.15.44:0/2068625687 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f476c0b2990 0x7f476c0b4e50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4778005950 tx=0x7f47780058e0 comp rx=0 tx=0).stop 2024-05-03T22:44:06.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.751+0000 7f4787e00700 1 -- 172.21.15.44:0/2068625687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f478810fc10 msgr2=0x7f47881a0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:06.754 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.751+0000 7f4787e00700 1 --2- 172.21.15.44:0/2068625687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f478810fc10 0x7f47881a0650 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4780007ee0 tx=0x7f478000d3b0 comp rx=0 tx=0).stop 2024-05-03T22:44:06.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.752+0000 7f4787e00700 1 -- 172.21.15.44:0/2068625687 shutdown_connections 2024-05-03T22:44:06.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.752+0000 7f4787e00700 1 --2- 172.21.15.44:0/2068625687 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f478810fc10 0x7f47881a0650 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:06.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.752+0000 7f4787e00700 1 --2- 172.21.15.44:0/2068625687 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f476c0b2990 0x7f476c0b4e50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:06.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.752+0000 7f4787e00700 1 --2- 172.21.15.44:0/2068625687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47880758d0 0x7f478819bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:06.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.752+0000 7f4787e00700 1 --2- 172.21.15.44:0/2068625687 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47880761f0 0x7f478819c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:06.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.752+0000 7f4787e00700 1 -- 172.21.15.44:0/2068625687 >> 172.21.15.44:0/2068625687 conn(0x7f47880fef20 msgr2=0x7f47880ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:06.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.752+0000 7f4787e00700 1 -- 172.21.15.44:0/2068625687 shutdown_connections 2024-05-03T22:44:06.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:06.752+0000 7f4787e00700 1 -- 172.21.15.44:0/2068625687 wait complete. 2024-05-03T22:44:07.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:07 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2068625687' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:44:07.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:07 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2068625687' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:44:07.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:07 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2068625687' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:44:07.639 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:44:08.077 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:44:08.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:08 smithi044 ceph-mon[28604]: pgmap v498: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:08.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:08 smithi060 ceph-mon[31721]: pgmap v498: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:08.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:08 smithi160 ceph-mon[32531]: pgmap v498: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:10.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.353+0000 7f50b8400700 1 -- 172.21.15.44:0/4013643492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b0106080 msgr2=0x7f50b0112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:10.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.354+0000 7f50b8400700 1 --2- 172.21.15.44:0/4013643492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b0106080 0x7f50b0112590 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f50a800b0a0 tx=0x7f50a800b3b0 comp rx=0 tx=0).stop 2024-05-03T22:44:10.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.354+0000 7f50b8400700 1 -- 172.21.15.44:0/4013643492 shutdown_connections 2024-05-03T22:44:10.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.354+0000 7f50b8400700 1 --2- 172.21.15.44:0/4013643492 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b0106080 0x7f50b0112590 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:10.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.354+0000 7f50b8400700 1 --2- 172.21.15.44:0/4013643492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50b010b6c0 0x7f50b010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:10.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.354+0000 7f50b8400700 1 --2- 172.21.15.44:0/4013643492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50b01056c0 0x7f50b0105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:10.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.354+0000 7f50b8400700 1 -- 172.21.15.44:0/4013643492 >> 172.21.15.44:0/4013643492 conn(0x7f50b01011b0 msgr2=0x7f50b01035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:10.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.354+0000 7f50b8400700 1 -- 172.21.15.44:0/4013643492 shutdown_connections 2024-05-03T22:44:10.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.354+0000 7f50b8400700 1 -- 172.21.15.44:0/4013643492 wait complete. 2024-05-03T22:44:10.358 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:10 smithi044 ceph-mon[28604]: pgmap v499: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:44:10.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.355+0000 7f50b8400700 1 Processor -- start 2024-05-03T22:44:10.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.355+0000 7f50b8400700 1 -- start start 2024-05-03T22:44:10.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.356+0000 7f50b8400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50b01056c0 0x7f50b019be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:10.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.356+0000 7f50b8400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50b0106080 0x7f50b019c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:10.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.356+0000 7f50b8400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b010b6c0 0x7f50b01a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:10.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.356+0000 7f50b8400700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f50b0115a70 con 0x7f50b010b6c0 2024-05-03T22:44:10.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.356+0000 7f50b8400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f50b01158f0 con 0x7f50b0106080 2024-05-03T22:44:10.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.356+0000 7f50b8400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f50b0115bf0 con 0x7f50b01056c0 2024-05-03T22:44:10.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.356+0000 7f50b6400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b010b6c0 0x7f50b01a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:10.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.356+0000 7f50b6400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b010b6c0 0x7f50b01a0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55250/0 (socket says 172.21.15.44:55250) 2024-05-03T22:44:10.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.356+0000 7f50b6400700 1 -- 172.21.15.44:0/1464245199 learned_addr learned my addr 172.21.15.44:0/1464245199 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:10.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.356+0000 7f50b5a00700 1 --2- 172.21.15.44:0/1464245199 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50b01056c0 0x7f50b019be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:10.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.357+0000 7f50b5000700 1 --2- 172.21.15.44:0/1464245199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50b0106080 0x7f50b019c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:10.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.357+0000 7f50b6400700 1 -- 172.21.15.44:0/1464245199 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50b01056c0 msgr2=0x7f50b019be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:10.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.357+0000 7f50b6400700 1 --2- 172.21.15.44:0/1464245199 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50b01056c0 0x7f50b019be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:10.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.357+0000 7f50b6400700 1 -- 172.21.15.44:0/1464245199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50b0106080 msgr2=0x7f50b019c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:10.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.357+0000 7f50b6400700 1 --2- 172.21.15.44:0/1464245199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50b0106080 0x7f50b019c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:10.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.357+0000 7f50b6400700 1 -- 172.21.15.44:0/1464245199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b01a0e70 con 0x7f50b010b6c0 2024-05-03T22:44:10.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.357+0000 7f50b5a00700 1 --2- 172.21.15.44:0/1464245199 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50b01056c0 0x7f50b019be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:44:10.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.357+0000 7f50b5000700 1 --2- 172.21.15.44:0/1464245199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50b0106080 0x7f50b019c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:44:10.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.357+0000 7f50b6400700 1 --2- 172.21.15.44:0/1464245199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b010b6c0 0x7f50b01a0730 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f50a80079a0 tx=0x7f50a8007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:10.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.358+0000 7f50ae000700 1 -- 172.21.15.44:0/1464245199 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a8021070 con 0x7f50b010b6c0 2024-05-03T22:44:10.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.358+0000 7f50ae000700 1 -- 172.21.15.44:0/1464245199 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f50a801db20 con 0x7f50b010b6c0 2024-05-03T22:44:10.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.358+0000 7f50b8400700 1 -- 172.21.15.44:0/1464245199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50b01a1100 con 0x7f50b010b6c0 2024-05-03T22:44:10.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.358+0000 7f50ae000700 1 -- 172.21.15.44:0/1464245199 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a801bd90 con 0x7f50b010b6c0 2024-05-03T22:44:10.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.358+0000 7f50b8400700 1 -- 172.21.15.44:0/1464245199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50b01a89e0 con 0x7f50b010b6c0 2024-05-03T22:44:10.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.359+0000 7f50b8400700 1 -- 172.21.15.44:0/1464245199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50b006a190 con 0x7f50b010b6c0 2024-05-03T22:44:10.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.361+0000 7f50ae000700 1 -- 172.21.15.44:0/1464245199 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f50a8024070 con 0x7f50b010b6c0 2024-05-03T22:44:10.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.363+0000 7f50ae000700 1 --2- 172.21.15.44:0/1464245199 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f50980b2910 0x7f50980b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:10.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.363+0000 7f50ae000700 1 -- 172.21.15.44:0/1464245199 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f50a800f020 con 0x7f50b010b6c0 2024-05-03T22:44:10.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.363+0000 7f50b5a00700 1 --2- 172.21.15.44:0/1464245199 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f50980b2910 0x7f50980b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:10.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.364+0000 7f50b5a00700 1 --2- 172.21.15.44:0/1464245199 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f50980b2910 0x7f50980b4dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f50a4005950 tx=0x7f50a40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:10.368 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.366+0000 7f50ae000700 1 -- 172.21.15.44:0/1464245199 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f50a802b020 con 0x7f50b010b6c0 2024-05-03T22:44:10.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:10 smithi060 ceph-mon[31721]: pgmap v499: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:44:10.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:10 smithi160 ceph-mon[32531]: pgmap v499: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:44:10.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.653+0000 7f50b8400700 1 -- 172.21.15.44:0/1464245199 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50b01a8bb0 con 0x7f50b010b6c0 2024-05-03T22:44:10.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.655+0000 7f50ae000700 1 -- 172.21.15.44:0/1464245199 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11932 (secure 0 0 0) 0x7f50a80abb60 con 0x7f50b010b6c0 2024-05-03T22:44:10.658 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:44:10.658 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2550955759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2550955759},{"type":"v1","addr":"172.21.15.44:6835","nonce":2550955759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3118490782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3118490782},{"type":"v1","addr":"172.21.15.44:6837","nonce":3118490782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T22:40:14.758857+0000","modified":"2024-05-03T22:41:47.427474+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34463,"mds_1":34427,"mds_2":34409,"mds_3":34391,"mds_4":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/1408147232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1408147232},{"type":"v1","addr":"172.21.15.44:6839","nonce":1408147232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14607":{"gid":14607,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/4262223160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":4262223160},{"type":"v1","addr":"172.21.15.44:6841","nonce":4262223160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/1332937382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1332937382},{"type":"v1","addr":"172.21.15.160:6835","nonce":1332937382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/3735287805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3735287805},{"type":"v1","addr":"172.21.15.160:6837","nonce":3735287805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.160:6839/861756806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":861756806},{"type":"v1","addr":"172.21.15.160:6839","nonce":861756806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34391":{"gid":34391,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":41,"addr":"172.21.15.60:6833/153110190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":153110190},{"type":"v1","addr":"172.21.15.60:6833","nonce":153110190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.60:6835/3390425489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3390425489},{"type":"v1","addr":"172.21.15.60:6835","nonce":3390425489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.60:6837/3568217572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3568217572},{"type":"v1","addr":"172.21.15.60:6837","nonce":3568217572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.60:6839/2420093605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2420093605},{"type":"v1","addr":"172.21.15.60:6839","nonce":2420093605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34463,"qdb_cluster":[34463,34427,34409,24493,34391]},"id":1}]} 2024-05-03T22:44:10.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.659+0000 7f50b8400700 1 -- 172.21.15.44:0/1464245199 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f50980b2910 msgr2=0x7f50980b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:10.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.659+0000 7f50b8400700 1 --2- 172.21.15.44:0/1464245199 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f50980b2910 0x7f50980b4dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f50a4005950 tx=0x7f50a40058e0 comp rx=0 tx=0).stop 2024-05-03T22:44:10.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.659+0000 7f50b8400700 1 -- 172.21.15.44:0/1464245199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b010b6c0 msgr2=0x7f50b01a0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:10.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.659+0000 7f50b8400700 1 --2- 172.21.15.44:0/1464245199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b010b6c0 0x7f50b01a0730 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f50a80079a0 tx=0x7f50a8007a80 comp rx=0 tx=0).stop 2024-05-03T22:44:10.662 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.660+0000 7f50b8400700 1 -- 172.21.15.44:0/1464245199 shutdown_connections 2024-05-03T22:44:10.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.660+0000 7f50b8400700 1 --2- 172.21.15.44:0/1464245199 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f50b010b6c0 0x7f50b01a0730 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:10.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.660+0000 7f50b8400700 1 --2- 172.21.15.44:0/1464245199 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f50980b2910 0x7f50980b4dd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:10.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.660+0000 7f50b8400700 1 --2- 172.21.15.44:0/1464245199 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f50b01056c0 0x7f50b019be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:10.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.660+0000 7f50b8400700 1 --2- 172.21.15.44:0/1464245199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50b0106080 0x7f50b019c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:10.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.660+0000 7f50b8400700 1 -- 172.21.15.44:0/1464245199 >> 172.21.15.44:0/1464245199 conn(0x7f50b01011b0 msgr2=0x7f50b0101690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:10.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.660+0000 7f50b8400700 1 -- 172.21.15.44:0/1464245199 shutdown_connections 2024-05-03T22:44:10.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:10.660+0000 7f50b8400700 1 -- 172.21.15.44:0/1464245199 wait complete. 2024-05-03T22:44:10.664 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 30 2024-05-03T22:44:11.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:11 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1464245199' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:44:11.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:11 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1464245199' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:44:11.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:11 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1464245199' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:44:11.607 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-03T22:40:14.758857+0000', 'modified': '2024-05-03T22:41:47.427474+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 34463, 'mds_1': 34427, 'mds_2': 34409, 'mds_3': 34391, 'mds_4': 24493}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14595': {'gid': 14595, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6839/1408147232', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6838', 'nonce': 1408147232}, {'type': 'v1', 'addr': '172.21.15.44:6839', 'nonce': 1408147232}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14607': {'gid': 14607, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6841/4262223160', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6840', 'nonce': 4262223160}, {'type': 'v1', 'addr': '172.21.15.44:6841', 'nonce': 4262223160}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6833/2022701378', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6832', 'nonce': 2022701378}, {'type': 'v1', 'addr': '172.21.15.160:6833', 'nonce': 2022701378}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6835/1332937382', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6834', 'nonce': 1332937382}, {'type': 'v1', 'addr': '172.21.15.160:6835', 'nonce': 1332937382}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24478': {'gid': 24478, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6837/3735287805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6836', 'nonce': 3735287805}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 3735287805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24493': {'gid': 24493, 'name': 'i', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 33, 'addr': '172.21.15.160:6839/861756806', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6838', 'nonce': 861756806}, {'type': 'v1', 'addr': '172.21.15.160:6839', 'nonce': 861756806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34391': {'gid': 34391, 'name': 'k', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 41, 'addr': '172.21.15.60:6833/153110190', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6832', 'nonce': 153110190}, {'type': 'v1', 'addr': '172.21.15.60:6833', 'nonce': 153110190}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34409': {'gid': 34409, 'name': 'e', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 36, 'addr': '172.21.15.60:6835/3390425489', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6834', 'nonce': 3390425489}, {'type': 'v1', 'addr': '172.21.15.60:6835', 'nonce': 3390425489}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34427': {'gid': 34427, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 33, 'addr': '172.21.15.60:6837/3568217572', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 3568217572}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 3568217572}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34463': {'gid': 34463, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.60:6839/2420093605', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6838', 'nonce': 2420093605}, {'type': 'v1', 'addr': '172.21.15.60:6839', 'nonce': 2420093605}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34463, 'qdb_cluster': [34463, 34427, 34409, 24493, 34391]} 2024-05-03T22:44:11.607 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-03T22:44:11.607 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell mds.i status 2024-05-03T22:44:12.084 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:44:12.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:12 smithi044 ceph-mon[28604]: pgmap v500: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:44:12.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:12 smithi060 ceph-mon[31721]: pgmap v500: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:44:12.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:12 smithi160 ceph-mon[32531]: pgmap v500: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:44:14.438 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:14 smithi044 ceph-mon[28604]: pgmap v501: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:14.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.443+0000 7fc987e00700 1 -- 172.21.15.44:0/1051594622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc98010fb60 msgr2=0x7fc98010ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:14.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.443+0000 7fc987e00700 1 --2- 172.21.15.44:0/1051594622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc98010fb60 0x7fc98010ff40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc97400b0a0 tx=0x7fc97400b3b0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.444+0000 7fc987e00700 1 -- 172.21.15.44:0/1051594622 shutdown_connections 2024-05-03T22:44:14.446 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.444+0000 7fc987e00700 1 --2- 172.21.15.44:0/1051594622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc98010a490 0x7fc9801169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.444+0000 7fc987e00700 1 --2- 172.21.15.44:0/1051594622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc98010fb60 0x7fc98010ff40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.444+0000 7fc987e00700 1 --2- 172.21.15.44:0/1051594622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc980109ad0 0x7fc980109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.444+0000 7fc987e00700 1 -- 172.21.15.44:0/1051594622 >> 172.21.15.44:0/1051594622 conn(0x7fc980076c70 msgr2=0x7fc9801082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:14.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.444+0000 7fc987e00700 1 -- 172.21.15.44:0/1051594622 shutdown_connections 2024-05-03T22:44:14.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.444+0000 7fc987e00700 1 -- 172.21.15.44:0/1051594622 wait complete. 2024-05-03T22:44:14.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.445+0000 7fc987e00700 1 Processor -- start 2024-05-03T22:44:14.447 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.445+0000 7fc987e00700 1 -- start start 2024-05-03T22:44:14.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.446+0000 7fc987e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc980109ad0 0x7fc9801a02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:14.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.446+0000 7fc987e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc98010a490 0x7fc9801a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:14.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.446+0000 7fc987e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc98010fb60 0x7fc9801a4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:14.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.446+0000 7fc987e00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc980119e40 con 0x7fc98010fb60 2024-05-03T22:44:14.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.446+0000 7fc987e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc980119cc0 con 0x7fc980109ad0 2024-05-03T22:44:14.448 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.446+0000 7fc987e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc980119fc0 con 0x7fc98010a490 2024-05-03T22:44:14.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.446+0000 7fc985e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc98010fb60 0x7fc9801a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:14.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.446+0000 7fc985e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc98010fb60 0x7fc9801a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55274/0 (socket says 172.21.15.44:55274) 2024-05-03T22:44:14.449 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.446+0000 7fc985e00700 1 -- 172.21.15.44:0/390182812 learned_addr learned my addr 172.21.15.44:0/390182812 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.446+0000 7fc984a00700 1 --2- 172.21.15.44:0/390182812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc98010a490 0x7fc9801a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.446+0000 7fc985400700 1 --2- 172.21.15.44:0/390182812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc980109ad0 0x7fc9801a02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.446+0000 7fc985e00700 1 -- 172.21.15.44:0/390182812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc98010a490 msgr2=0x7fc9801a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.446+0000 7fc985e00700 1 --2- 172.21.15.44:0/390182812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc98010a490 0x7fc9801a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.446+0000 7fc985e00700 1 -- 172.21.15.44:0/390182812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc980109ad0 msgr2=0x7fc9801a02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.447+0000 7fc985e00700 1 --2- 172.21.15.44:0/390182812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc980109ad0 0x7fc9801a02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.447+0000 7fc985e00700 1 -- 172.21.15.44:0/390182812 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9801a52e0 con 0x7fc98010fb60 2024-05-03T22:44:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.447+0000 7fc985400700 1 --2- 172.21.15.44:0/390182812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc980109ad0 0x7fc9801a02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:44:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.447+0000 7fc985e00700 1 --2- 172.21.15.44:0/390182812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc98010fb60 0x7fc9801a4ba0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc97800d980 tx=0x7fc97800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:14.450 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.447+0000 7fc97e000700 1 -- 172.21.15.44:0/390182812 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978017070 con 0x7fc98010fb60 2024-05-03T22:44:14.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.447+0000 7fc97e000700 1 -- 172.21.15.44:0/390182812 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fc978009e10 con 0x7fc98010fb60 2024-05-03T22:44:14.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.447+0000 7fc987e00700 1 -- 172.21.15.44:0/390182812 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9801a55d0 con 0x7fc98010fb60 2024-05-03T22:44:14.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.447+0000 7fc97e000700 1 -- 172.21.15.44:0/390182812 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc978005410 con 0x7fc98010fb60 2024-05-03T22:44:14.451 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.447+0000 7fc987e00700 1 -- 172.21.15.44:0/390182812 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9801ace50 con 0x7fc98010fb60 2024-05-03T22:44:14.453 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.451+0000 7fc97e000700 1 -- 172.21.15.44:0/390182812 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc9780055b0 con 0x7fc98010fb60 2024-05-03T22:44:14.454 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.452+0000 7fc9926cdb80 1 Processor -- start 2024-05-03T22:44:14.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.452+0000 7fc9926cdb80 1 -- start start 2024-05-03T22:44:14.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.453+0000 7fc9926cdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cde760 0x556dd2cdeb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:14.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.453+0000 7fc9926cdb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cdf080 0x556dd2cd9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:14.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.453+0000 7fc97e000700 1 --2- 172.21.15.44:0/390182812 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc9680b2990 0x7fc9680b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:14.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.453+0000 7fc9926cdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cda580 0x556dd2cda9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:14.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.453+0000 7fc9926cdb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556dd2c2c9d0 con 0x556dd2cdf080 2024-05-03T22:44:14.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.453+0000 7fc9926cdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556dd2bca710 con 0x556dd2cda580 2024-05-03T22:44:14.455 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.453+0000 7fc9926cdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556dd2c28990 con 0x556dd2cde760 2024-05-03T22:44:14.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.453+0000 7fc97e000700 1 -- 172.21.15.44:0/390182812 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fc9780e2630 con 0x7fc98010fb60 2024-05-03T22:44:14.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.453+0000 7fc985400700 1 --2- 172.21.15.44:0/390182812 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc9680b2990 0x7fc9680b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:14.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.453+0000 7fc984a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cdf080 0x556dd2cd9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:14.456 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.453+0000 7fc985e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cda580 0x556dd2cda9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:14.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.453+0000 7fc984a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cdf080 0x556dd2cd9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55282/0 (socket says 172.21.15.44:55282) 2024-05-03T22:44:14.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.453+0000 7fc984a00700 1 -- 172.21.15.44:0/2146096103 learned_addr learned my addr 172.21.15.44:0/2146096103 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:14.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.454+0000 7fc984a00700 1 --2- 172.21.15.44:0/2146096103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cde760 0x556dd2cdeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:14.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.454+0000 7fc984a00700 1 -- 172.21.15.44:0/2146096103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cde760 msgr2=0x556dd2cdeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:14.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.454+0000 7fc984a00700 1 --2- 172.21.15.44:0/2146096103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cde760 0x556dd2cdeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.454+0000 7fc984a00700 1 -- 172.21.15.44:0/2146096103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cda580 msgr2=0x556dd2cda9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:14.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.454+0000 7fc984a00700 1 --2- 172.21.15.44:0/2146096103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cda580 0x556dd2cda9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.454+0000 7fc984a00700 1 -- 172.21.15.44:0/2146096103 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dd2b79880 con 0x556dd2cdf080 2024-05-03T22:44:14.457 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.454+0000 7fc985400700 1 --2- 172.21.15.44:0/390182812 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc9680b2990 0x7fc9680b4e50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc9740062a0 tx=0x7fc974006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:14.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.454+0000 7fc984a00700 1 --2- 172.21.15.44:0/2146096103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cdf080 0x556dd2cd9f60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0149e0 tx=0x7fc96c00c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66a8e7041b48ceb server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:14.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.455+0000 7fc972a00700 1 -- 172.21.15.44:0/2146096103 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c0142d0 con 0x556dd2cdf080 2024-05-03T22:44:14.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.455+0000 7fc972a00700 1 -- 172.21.15.44:0/2146096103 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fc96c0119d0 con 0x556dd2cdf080 2024-05-03T22:44:14.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.455+0000 7fc972a00700 1 -- 172.21.15.44:0/2146096103 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c012810 con 0x556dd2cdf080 2024-05-03T22:44:14.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.456+0000 7fc9926cdb80 1 -- 172.21.15.44:0/2146096103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cdf080 msgr2=0x556dd2cd9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:14.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.456+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/2146096103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cdf080 0x556dd2cd9f60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0149e0 tx=0x7fc96c00c4f0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.456+0000 7fc9926cdb80 1 -- 172.21.15.44:0/2146096103 shutdown_connections 2024-05-03T22:44:14.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.456+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/2146096103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cda580 0x556dd2cda9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.456+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/2146096103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cde760 0x556dd2cdeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.456+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/2146096103 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cdf080 0x556dd2cd9f60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.456+0000 7fc9926cdb80 1 -- 172.21.15.44:0/2146096103 >> 172.21.15.44:0/2146096103 conn(0x556dd2c08b10 msgr2=0x556dd2cd47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:14.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.456+0000 7fc9926cdb80 1 -- 172.21.15.44:0/2146096103 shutdown_connections 2024-05-03T22:44:14.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.456+0000 7fc9926cdb80 1 -- 172.21.15.44:0/2146096103 wait complete. 2024-05-03T22:44:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.457+0000 7fc9926cdb80 1 -- start start 2024-05-03T22:44:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.457+0000 7fc9926cdb80 1 Processor -- start 2024-05-03T22:44:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.457+0000 7fc9926cdb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 0x556dd2ce5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.457+0000 7fc9926cdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cde760 0x556dd2ce31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.457+0000 7fc9926cdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cdf080 0x556dd2ce3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.457+0000 7fc9926cdb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556dd2ce6bf0 con 0x556dd2cda580 2024-05-03T22:44:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.457+0000 7fc9926cdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556dd2b92ad0 con 0x556dd2cdf080 2024-05-03T22:44:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.457+0000 7fc9926cdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556dd2ce6d70 con 0x556dd2cde760 2024-05-03T22:44:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.457+0000 7fc9926cdb80 10 client.0 _ll_register_callbacks cb 0x556dd2bd3c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:44:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.458+0000 7fc985400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 0x556dd2ce5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.458+0000 7fc985400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 0x556dd2ce5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55292/0 (socket says 172.21.15.44:55292) 2024-05-03T22:44:14.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.458+0000 7fc985400700 1 -- 172.21.15.44:0/2270237410 learned_addr learned my addr 172.21.15.44:0/2270237410 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:14.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.458+0000 7fc985e00700 1 --2- 172.21.15.44:0/2270237410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cdf080 0x556dd2ce3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:14.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.458+0000 7fc984a00700 1 --2- 172.21.15.44:0/2270237410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cde760 0x556dd2ce31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:14.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.458+0000 7fc985400700 1 -- 172.21.15.44:0/2270237410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cde760 msgr2=0x556dd2ce31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:14.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.458+0000 7fc985400700 1 --2- 172.21.15.44:0/2270237410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cde760 0x556dd2ce31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.458+0000 7fc985400700 1 -- 172.21.15.44:0/2270237410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cdf080 msgr2=0x556dd2ce3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:14.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.458+0000 7fc985400700 1 --2- 172.21.15.44:0/2270237410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cdf080 0x556dd2ce3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.458+0000 7fc985400700 1 -- 172.21.15.44:0/2270237410 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dd2bf23d0 con 0x556dd2cda580 2024-05-03T22:44:14.462 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.458+0000 7fc985e00700 1 --2- 172.21.15.44:0/2270237410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cdf080 0x556dd2ce3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:44:14.463 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.459+0000 7fc985400700 1 --2- 172.21.15.44:0/2270237410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 0x556dd2ce5e00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc974015000 tx=0x7fc9740099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d700350d414cedb server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.459+0000 7fc967400700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:44:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.459+0000 7fc967400700 1 -- 172.21.15.44:0/2270237410 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97402c020 con 0x556dd2cda580 2024-05-03T22:44:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.459+0000 7fc967400700 1 -- 172.21.15.44:0/2270237410 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fc97401c640 con 0x556dd2cda580 2024-05-03T22:44:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.459+0000 7fc9926cdb80 1 -- 172.21.15.44:0/2270237410 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc96c0119d0 con 0x556dd2cda580 2024-05-03T22:44:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.459+0000 7fc967400700 1 -- 172.21.15.44:0/2270237410 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc974037050 con 0x556dd2cda580 2024-05-03T22:44:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.459+0000 7fc9926cdb80 10 client.15063 fetch_fsmap learned FSMap version 30 2024-05-03T22:44:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.459+0000 7fc9926cdb80 1 -- 172.21.15.44:0/2270237410 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556dd2cf13a0 con 0x556dd2cda580 2024-05-03T22:44:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.460+0000 7fc967400700 1 -- 172.21.15.44:0/2270237410 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fc96c0119d0 con 0x556dd2cda580 2024-05-03T22:44:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.460+0000 7fc967400700 1 -- 172.21.15.44:0/2270237410 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc974011070 con 0x556dd2cda580 2024-05-03T22:44:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.460+0000 7fc9926cdb80 10 client.15063 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:44:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.460+0000 7fc9926cdb80 10 client.15063 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-03T22:44:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.460+0000 7fc9926cdb80 20 client.15063 populate_metadata read hostname 'smithi044' 2024-05-03T22:44:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.460+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/2270237410 >> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] conn(0x556dd2cf3a80 0x556dd2cf4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:14.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.460+0000 7fc9926cdb80 4 client.15063 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:44:14.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.460+0000 7fc9926cdb80 1 -- 172.21.15.44:0/2270237410 --> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556dd2ca7180 con 0x556dd2cf3a80 2024-05-03T22:44:14.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.461+0000 7fc984a00700 1 --2- 172.21.15.44:0/2270237410 >> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] conn(0x556dd2cf3a80 0x556dd2cf4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:14.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.462+0000 7fc984a00700 1 --2- 172.21.15.44:0/2270237410 >> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] conn(0x556dd2cf3a80 0x556dd2cf4ef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6dd103a9b34c8462 server_cookie=eb6ce7bac8132f08 in_seq=0 out_seq=0 2024-05-03T22:44:14.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.462+0000 7fc967400700 10 client.15063 ms_handle_connect on v2:172.21.15.160:6838/861756806 2024-05-03T22:44:14.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.464+0000 7fc967400700 1 -- 172.21.15.44:0/2270237410 <== mds.4 v2:172.21.15.160:6838/861756806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556dd2ca7180 con 0x556dd2cf3a80 2024-05-03T22:44:14.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.464+0000 7fc967400700 10 client.15063 handle_command_reply: tid=0 2024-05-03T22:44:14.466 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.464+0000 7fc9926cdb80 1 client.15063 shutdown 2024-05-03T22:44:14.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.464+0000 7fc9926cdb80 1 -- 172.21.15.44:0/2270237410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 msgr2=0x556dd2ce5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:14.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.464+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/2270237410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 0x556dd2ce5e00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc974015000 tx=0x7fc9740099e0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.464+0000 7fc9926cdb80 1 -- 172.21.15.44:0/2270237410 shutdown_connections 2024-05-03T22:44:14.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.464+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/2270237410 >> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] conn(0x556dd2cf3a80 0x556dd2cf4ef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.464+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/2270237410 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cdf080 0x556dd2ce3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.464+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/2270237410 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 0x556dd2ce5e00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.464+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/2270237410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cde760 0x556dd2ce31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.464+0000 7fc967400700 0 client.15063 ms_handle_reset on v2:172.21.15.160:6838/861756806 2024-05-03T22:44:14.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.464+0000 7fc9926cdb80 1 -- 172.21.15.44:0/2270237410 >> 172.21.15.44:0/2270237410 conn(0x556dd2c08b10 msgr2=0x556dd2cdfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:14.467 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.464+0000 7fc9926cdb80 1 -- 172.21.15.44:0/2270237410 shutdown_connections 2024-05-03T22:44:14.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.464+0000 7fc9926cdb80 1 -- 172.21.15.44:0/2270237410 wait complete. 2024-05-03T22:44:14.468 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.465+0000 7fc9926cdb80 20 client.15063 trim_cache size 0 max 16384 2024-05-03T22:44:14.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.488+0000 7fc9926cdb80 1 Processor -- start 2024-05-03T22:44:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.488+0000 7fc9926cdb80 1 -- start start 2024-05-03T22:44:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.489+0000 7fc9926cdb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 0x556dd2cddc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.489+0000 7fc9926cdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cde760 0x556dd2cd4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.489+0000 7fc9926cdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cdf080 0x556dd2cef740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.489+0000 7fc9926cdb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556dd2cf3230 con 0x556dd2cda580 2024-05-03T22:44:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.489+0000 7fc9926cdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556dd2cf3900 con 0x556dd2cde760 2024-05-03T22:44:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.489+0000 7fc9926cdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556dd2cf3fd0 con 0x556dd2cdf080 2024-05-03T22:44:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.489+0000 7fc985400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 0x556dd2cddc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.489+0000 7fc985400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 0x556dd2cddc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55304/0 (socket says 172.21.15.44:55304) 2024-05-03T22:44:14.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.489+0000 7fc985400700 1 -- 172.21.15.44:0/185144295 learned_addr learned my addr 172.21.15.44:0/185144295 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:14.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.490+0000 7fc984a00700 1 --2- 172.21.15.44:0/185144295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cde760 0x556dd2cd4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:14.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.490+0000 7fc985e00700 1 --2- 172.21.15.44:0/185144295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cdf080 0x556dd2cef740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:14.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.490+0000 7fc985400700 1 -- 172.21.15.44:0/185144295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cdf080 msgr2=0x556dd2cef740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:14.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.490+0000 7fc985400700 1 --2- 172.21.15.44:0/185144295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cdf080 0x556dd2cef740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.490+0000 7fc985400700 1 -- 172.21.15.44:0/185144295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cde760 msgr2=0x556dd2cd4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:14.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.490+0000 7fc985400700 1 --2- 172.21.15.44:0/185144295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cde760 0x556dd2cd4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.490+0000 7fc985400700 1 -- 172.21.15.44:0/185144295 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dd2ccf750 con 0x556dd2cda580 2024-05-03T22:44:14.493 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.490+0000 7fc985400700 1 --2- 172.21.15.44:0/185144295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 0x556dd2cddc30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc974009810 tx=0x7fc974004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebec88283c32b99 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:14.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.490+0000 7fc972000700 1 -- 172.21.15.44:0/185144295 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97402c070 con 0x556dd2cda580 2024-05-03T22:44:14.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.490+0000 7fc972000700 1 -- 172.21.15.44:0/185144295 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fc974023070 con 0x556dd2cda580 2024-05-03T22:44:14.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.490+0000 7fc972000700 1 -- 172.21.15.44:0/185144295 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974029450 con 0x556dd2cda580 2024-05-03T22:44:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.491+0000 7fc9926cdb80 1 -- 172.21.15.44:0/185144295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 msgr2=0x556dd2cddc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.491+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/185144295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 0x556dd2cddc30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc974009810 tx=0x7fc974004f90 comp rx=0 tx=0).stop 2024-05-03T22:44:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.491+0000 7fc9926cdb80 1 -- 172.21.15.44:0/185144295 shutdown_connections 2024-05-03T22:44:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.491+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/185144295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cdf080 0x556dd2cef740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.491+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/185144295 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 0x556dd2cddc30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.491+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/185144295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cde760 0x556dd2cd4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.491+0000 7fc9926cdb80 1 -- 172.21.15.44:0/185144295 >> 172.21.15.44:0/185144295 conn(0x556dd2c08b10 msgr2=0x556dd2cef030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.491+0000 7fc9926cdb80 1 -- 172.21.15.44:0/185144295 shutdown_connections 2024-05-03T22:44:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.491+0000 7fc9926cdb80 1 -- 172.21.15.44:0/185144295 wait complete. 2024-05-03T22:44:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.492+0000 7fc9926cdb80 1 -- start start 2024-05-03T22:44:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.492+0000 7fc9926cdb80 1 Processor -- start 2024-05-03T22:44:14.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.492+0000 7fc9926cdb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 0x556dd2cfd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:14.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.492+0000 7fc9926cdb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cde760 0x556dd2cfda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:14.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.493+0000 7fc9926cdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cdf080 0x556dd2cfe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:14.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.493+0000 7fc9926cdb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556dd2cf4d70 con 0x556dd2cda580 2024-05-03T22:44:14.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.493+0000 7fc9926cdb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556dd2cf46a0 con 0x556dd2cde760 2024-05-03T22:44:14.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.493+0000 7fc9926cdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556dd2cf5440 con 0x556dd2cdf080 2024-05-03T22:44:14.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.493+0000 7fc9926cdb80 10 client.0 _ll_register_callbacks cb 0x556dd2bd3c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:44:14.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.493+0000 7fc985400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 0x556dd2cfd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:14.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.493+0000 7fc985400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 0x556dd2cfd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55320/0 (socket says 172.21.15.44:55320) 2024-05-03T22:44:14.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.493+0000 7fc985400700 1 -- 172.21.15.44:0/1880335355 learned_addr learned my addr 172.21.15.44:0/1880335355 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:14.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.493+0000 7fc984a00700 1 --2- 172.21.15.44:0/1880335355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cde760 0x556dd2cfda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:14.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.493+0000 7fc985e00700 1 --2- 172.21.15.44:0/1880335355 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cdf080 0x556dd2cfe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:14.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.493+0000 7fc985400700 1 -- 172.21.15.44:0/1880335355 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cdf080 msgr2=0x556dd2cfe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:14.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.493+0000 7fc985400700 1 --2- 172.21.15.44:0/1880335355 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cdf080 0x556dd2cfe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.493+0000 7fc985400700 1 -- 172.21.15.44:0/1880335355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cde760 msgr2=0x556dd2cfda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:14.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.493+0000 7fc985400700 1 --2- 172.21.15.44:0/1880335355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cde760 0x556dd2cfda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.493+0000 7fc985400700 1 -- 172.21.15.44:0/1880335355 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dd2cfe8d0 con 0x556dd2cda580 2024-05-03T22:44:14.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.493+0000 7fc984a00700 1 --2- 172.21.15.44:0/1880335355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cde760 0x556dd2cfda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.494+0000 7fc985400700 1 --2- 172.21.15.44:0/1880335355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 0x556dd2cfd540 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc974005550 tx=0x7fc974005930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f9e7619ba61ba7 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.494+0000 7fc967400700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.494+0000 7fc967400700 1 -- 172.21.15.44:0/1880335355 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974040070 con 0x556dd2cda580 2024-05-03T22:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.494+0000 7fc967400700 1 -- 172.21.15.44:0/1880335355 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fc97403c890 con 0x556dd2cda580 2024-05-03T22:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.494+0000 7fc9926cdb80 1 -- 172.21.15.44:0/1880335355 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc974023070 con 0x556dd2cda580 2024-05-03T22:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.494+0000 7fc967400700 1 -- 172.21.15.44:0/1880335355 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc97402c070 con 0x556dd2cda580 2024-05-03T22:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.494+0000 7fc9926cdb80 10 client.15069 fetch_fsmap learned FSMap version 30 2024-05-03T22:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.494+0000 7fc9926cdb80 1 -- 172.21.15.44:0/1880335355 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556dd2ce00e0 con 0x556dd2cda580 2024-05-03T22:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.495+0000 7fc967400700 1 -- 172.21.15.44:0/1880335355 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fc974023070 con 0x556dd2cda580 2024-05-03T22:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.495+0000 7fc967400700 1 -- 172.21.15.44:0/1880335355 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fc97403a070 con 0x556dd2cda580 2024-05-03T22:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.495+0000 7fc9926cdb80 10 client.15069 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.495+0000 7fc9926cdb80 10 client.15069 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-03T22:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.495+0000 7fc9926cdb80 20 client.15069 populate_metadata read hostname 'smithi044' 2024-05-03T22:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.495+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/1880335355 >> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] conn(0x556dd2d64380 0x556dd2d63090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:14.499 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.495+0000 7fc9926cdb80 4 client.15069 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:44:14.500 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.495+0000 7fc9926cdb80 1 -- 172.21.15.44:0/1880335355 --> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] -- command(tid 0: {"prefix": "status"}) -- 0x556dd2c3a3b0 con 0x556dd2d64380 2024-05-03T22:44:14.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.496+0000 7fc984a00700 1 --2- 172.21.15.44:0/1880335355 >> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] conn(0x556dd2d64380 0x556dd2d63090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:14.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.497+0000 7fc984a00700 1 --2- 172.21.15.44:0/1880335355 >> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] conn(0x556dd2d64380 0x556dd2d63090 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b79204a64899551e server_cookie=d728f3272646ed1c in_seq=0 out_seq=0 2024-05-03T22:44:14.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.497+0000 7fc967400700 10 client.15069 ms_handle_connect on v2:172.21.15.160:6838/861756806 2024-05-03T22:44:14.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.498+0000 7fc967400700 1 -- 172.21.15.44:0/1880335355 <== mds.4 v2:172.21.15.160:6838/861756806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x556dd2c3a3b0 con 0x556dd2d64380 2024-05-03T22:44:14.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.498+0000 7fc967400700 10 client.15069 handle_command_reply: tid=0 2024-05-03T22:44:14.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.498+0000 7fc9926cdb80 1 client.15069 shutdown 2024-05-03T22:44:14.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.498+0000 7fc9926cdb80 1 -- 172.21.15.44:0/1880335355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 msgr2=0x556dd2cfd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:14.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.498+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/1880335355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 0x556dd2cfd540 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc974005550 tx=0x7fc974005930 comp rx=0 tx=0).stop 2024-05-03T22:44:14.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.498+0000 7fc9926cdb80 1 -- 172.21.15.44:0/1880335355 shutdown_connections 2024-05-03T22:44:14.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.498+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/1880335355 >> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] conn(0x556dd2d64380 0x556dd2d63090 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.498+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/1880335355 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556dd2cdf080 0x556dd2cfe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.498+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/1880335355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556dd2cda580 0x556dd2cfd540 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.498+0000 7fc9926cdb80 1 --2- 172.21.15.44:0/1880335355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556dd2cde760 0x556dd2cfda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.498+0000 7fc967400700 0 client.15069 ms_handle_reset on v2:172.21.15.160:6838/861756806 2024-05-03T22:44:14.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.498+0000 7fc9926cdb80 1 -- 172.21.15.44:0/1880335355 >> 172.21.15.44:0/1880335355 conn(0x556dd2c08b10 msgr2=0x556dd2cddab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:14.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.498+0000 7fc9926cdb80 1 -- 172.21.15.44:0/1880335355 shutdown_connections 2024-05-03T22:44:14.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.498+0000 7fc9926cdb80 1 -- 172.21.15.44:0/1880335355 wait complete. 2024-05-03T22:44:14.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.499+0000 7fc9926cdb80 20 client.15069 trim_cache size 0 max 16384 2024-05-03T22:44:14.502 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-03T22:44:14.502 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "5b0efdca-099c-11ef-bc97-c7b262605968", 2024-05-03T22:44:14.502 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 4, 2024-05-03T22:44:14.503 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 24493, 2024-05-03T22:44:14.503 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-05-03T22:44:14.503 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-05-03T22:44:14.503 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-05-03T22:44:14.503 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 153.29554667900001, 2024-05-03T22:44:14.503 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 30, 2024-05-03T22:44:14.503 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 89, 2024-05-03T22:44:14.503 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 87, 2024-05-03T22:44:14.503 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 278.06042900699998 2024-05-03T22:44:14.503 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-03T22:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.499+0000 7fc987e00700 1 -- 172.21.15.44:0/390182812 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc9680b2990 msgr2=0x7fc9680b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.499+0000 7fc987e00700 1 --2- 172.21.15.44:0/390182812 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc9680b2990 0x7fc9680b4e50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc9740062a0 tx=0x7fc974006210 comp rx=0 tx=0).stop 2024-05-03T22:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.499+0000 7fc987e00700 1 -- 172.21.15.44:0/390182812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc98010fb60 msgr2=0x7fc9801a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.499+0000 7fc987e00700 1 --2- 172.21.15.44:0/390182812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc98010fb60 0x7fc9801a4ba0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc97800d980 tx=0x7fc97800dd40 comp rx=0 tx=0).stop 2024-05-03T22:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.499+0000 7fc987e00700 1 -- 172.21.15.44:0/390182812 shutdown_connections 2024-05-03T22:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.499+0000 7fc987e00700 1 --2- 172.21.15.44:0/390182812 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc98010fb60 0x7fc9801a4ba0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.499+0000 7fc987e00700 1 --2- 172.21.15.44:0/390182812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc980109ad0 0x7fc9801a02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.499+0000 7fc987e00700 1 --2- 172.21.15.44:0/390182812 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc9680b2990 0x7fc9680b4e50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.499+0000 7fc987e00700 1 --2- 172.21.15.44:0/390182812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc98010a490 0x7fc9801a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.499+0000 7fc987e00700 1 -- 172.21.15.44:0/390182812 >> 172.21.15.44:0/390182812 conn(0x7fc980076c70 msgr2=0x7fc980077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.500+0000 7fc987e00700 1 -- 172.21.15.44:0/390182812 shutdown_connections 2024-05-03T22:44:14.504 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:14.500+0000 7fc987e00700 1 -- 172.21.15.44:0/390182812 wait complete. 2024-05-03T22:44:14.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:14 smithi060 ceph-mon[31721]: pgmap v501: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:14.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:14 smithi160 ceph-mon[32531]: pgmap v501: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:15.538 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell mds.k status 2024-05-03T22:44:16.021 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:44:16.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:16 smithi044 ceph-mon[28604]: pgmap v502: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:44:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:16 smithi060 ceph-mon[31721]: pgmap v502: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:44:16.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:16 smithi160 ceph-mon[32531]: pgmap v502: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:44:18.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.300+0000 7fd1a3e00700 1 -- 172.21.15.44:0/3642854565 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd19c075ff0 msgr2=0x7fd19c114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:18.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.300+0000 7fd1a3e00700 1 --2- 172.21.15.44:0/3642854565 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd19c075ff0 0x7fd19c114130 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd188009990 tx=0x7fd188009ca0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.300+0000 7fd1a3e00700 1 -- 172.21.15.44:0/3642854565 shutdown_connections 2024-05-03T22:44:18.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.300+0000 7fd1a3e00700 1 --2- 172.21.15.44:0/3642854565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd19c114670 0x7fd19c116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.300+0000 7fd1a3e00700 1 --2- 172.21.15.44:0/3642854565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd19c0756d0 0x7fd19c075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.300+0000 7fd1a3e00700 1 --2- 172.21.15.44:0/3642854565 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd19c075ff0 0x7fd19c114130 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.300+0000 7fd1a3e00700 1 -- 172.21.15.44:0/3642854565 >> 172.21.15.44:0/3642854565 conn(0x7fd19c07a600 msgr2=0x7fd19c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:18.302 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.300+0000 7fd1a3e00700 1 -- 172.21.15.44:0/3642854565 shutdown_connections 2024-05-03T22:44:18.303 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.300+0000 7fd1a3e00700 1 -- 172.21.15.44:0/3642854565 wait complete. 2024-05-03T22:44:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.301+0000 7fd1a3e00700 1 Processor -- start 2024-05-03T22:44:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.301+0000 7fd1a3e00700 1 -- start start 2024-05-03T22:44:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.301+0000 7fd1a3e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd19c0756d0 0x7fd19c1a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.301+0000 7fd1a3e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd19c075ff0 0x7fd19c1a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.302+0000 7fd1a3e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd19c114670 0x7fd19c1a4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:18.304 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.302+0000 7fd1a3e00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c119e10 con 0x7fd19c114670 2024-05-03T22:44:18.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.302+0000 7fd1a3e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c119c90 con 0x7fd19c0756d0 2024-05-03T22:44:18.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.302+0000 7fd1a3e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd19c119f90 con 0x7fd19c075ff0 2024-05-03T22:44:18.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.302+0000 7fd1a1e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd19c114670 0x7fd19c1a4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:18.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.302+0000 7fd1a1e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd19c114670 0x7fd19c1a4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55336/0 (socket says 172.21.15.44:55336) 2024-05-03T22:44:18.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.302+0000 7fd1a1e00700 1 -- 172.21.15.44:0/4214206413 learned_addr learned my addr 172.21.15.44:0/4214206413 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:18.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.302+0000 7fd1a1400700 1 --2- 172.21.15.44:0/4214206413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd19c0756d0 0x7fd19c1a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:18.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.302+0000 7fd1a0a00700 1 --2- 172.21.15.44:0/4214206413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd19c075ff0 0x7fd19c1a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:18.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.302+0000 7fd1a1e00700 1 -- 172.21.15.44:0/4214206413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd19c075ff0 msgr2=0x7fd19c1a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:18.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.302+0000 7fd1a1e00700 1 --2- 172.21.15.44:0/4214206413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd19c075ff0 0x7fd19c1a0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.302+0000 7fd1a1e00700 1 -- 172.21.15.44:0/4214206413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd19c0756d0 msgr2=0x7fd19c1a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:18.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.302+0000 7fd1a1e00700 1 --2- 172.21.15.44:0/4214206413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd19c0756d0 0x7fd19c1a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.302+0000 7fd1a1e00700 1 -- 172.21.15.44:0/4214206413 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd19c1a5230 con 0x7fd19c114670 2024-05-03T22:44:18.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.302+0000 7fd1a1400700 1 --2- 172.21.15.44:0/4214206413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd19c0756d0 0x7fd19c1a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:44:18.305 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.303+0000 7fd1a1e00700 1 --2- 172.21.15.44:0/4214206413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd19c114670 0x7fd19c1a4af0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd1940094f0 tx=0x7fd194007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:18.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.303+0000 7fd19a000700 1 -- 172.21.15.44:0/4214206413 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd194004db0 con 0x7fd19c114670 2024-05-03T22:44:18.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.303+0000 7fd19a000700 1 -- 172.21.15.44:0/4214206413 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fd19400db60 con 0x7fd19c114670 2024-05-03T22:44:18.306 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.303+0000 7fd1a3e00700 1 -- 172.21.15.44:0/4214206413 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd19c1a5520 con 0x7fd19c114670 2024-05-03T22:44:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.303+0000 7fd19a000700 1 -- 172.21.15.44:0/4214206413 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd194015400 con 0x7fd19c114670 2024-05-03T22:44:18.307 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.303+0000 7fd1a3e00700 1 -- 172.21.15.44:0/4214206413 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd19c1acda0 con 0x7fd19c114670 2024-05-03T22:44:18.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.307+0000 7fd19a000700 1 -- 172.21.15.44:0/4214206413 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd194005020 con 0x7fd19c114670 2024-05-03T22:44:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.308+0000 7fd1ae7eab80 1 Processor -- start 2024-05-03T22:44:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.309+0000 7fd19a000700 1 --2- 172.21.15.44:0/4214206413 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd1840b2990 0x7fd1840b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.309+0000 7fd1ae7eab80 1 -- start start 2024-05-03T22:44:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.309+0000 7fd19a000700 1 -- 172.21.15.44:0/4214206413 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fd1940e2250 con 0x7fd19c114670 2024-05-03T22:44:18.310 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.309+0000 7fd1ae7eab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b104498e0 0x563b10449cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:18.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.309+0000 7fd1ae7eab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b1044a200 0x563b10443ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.309+0000 7fd1ae7eab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b10444500 0x563b10444980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.309+0000 7fd1ae7eab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563b103969d0 con 0x563b10444500 2024-05-03T22:44:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.309+0000 7fd1ae7eab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563b10334710 con 0x563b104498e0 2024-05-03T22:44:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.309+0000 7fd1ae7eab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x563b10392990 con 0x563b1044a200 2024-05-03T22:44:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.309+0000 7fd1a0a00700 1 --2- 172.21.15.44:0/4214206413 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd1840b2990 0x7fd1840b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.310+0000 7fd1a1e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b10444500 0x563b10444980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.310+0000 7fd1a1e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b10444500 0x563b10444980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55342/0 (socket says 172.21.15.44:55342) 2024-05-03T22:44:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.310+0000 7fd1a1e00700 1 -- 172.21.15.44:0/420324977 learned_addr learned my addr 172.21.15.44:0/420324977 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.310+0000 7fd1a1400700 1 --2- 172.21.15.44:0/420324977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b104498e0 0x563b10449cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.310+0000 7fd1a0a00700 1 --2- 172.21.15.44:0/420324977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b1044a200 0x563b10443ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:18.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.310+0000 7fd1a1e00700 1 -- 172.21.15.44:0/420324977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b1044a200 msgr2=0x563b10443ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.310+0000 7fd1a1e00700 1 --2- 172.21.15.44:0/420324977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b1044a200 0x563b10443ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.310+0000 7fd1a1e00700 1 -- 172.21.15.44:0/420324977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b104498e0 msgr2=0x563b10449cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.310+0000 7fd1a1e00700 1 --2- 172.21.15.44:0/420324977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b104498e0 0x563b10449cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.310+0000 7fd1a1e00700 1 -- 172.21.15.44:0/420324977 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b102e3880 con 0x563b10444500 2024-05-03T22:44:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.310+0000 7fd1a0a00700 1 --2- 172.21.15.44:0/4214206413 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd1840b2990 0x7fd1840b4e50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd188005cd0 tx=0x7fd188005c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:18.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.311+0000 7fd1a1e00700 1 --2- 172.21.15.44:0/420324977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b10444500 0x563b10444980 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd1940df790 tx=0x7fd194091050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1be7f4a3c365c7d server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.311+0000 7fd18ea00700 1 -- 172.21.15.44:0/420324977 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1940a9a00 con 0x563b10444500 2024-05-03T22:44:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.311+0000 7fd18ea00700 1 -- 172.21.15.44:0/420324977 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fd1940a9300 con 0x563b10444500 2024-05-03T22:44:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.311+0000 7fd18ea00700 1 -- 172.21.15.44:0/420324977 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1940b1cd0 con 0x563b10444500 2024-05-03T22:44:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.312+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/420324977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b10444500 msgr2=0x563b10444980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.312+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/420324977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b10444500 0x563b10444980 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd1940df790 tx=0x7fd194091050 comp rx=0 tx=0).stop 2024-05-03T22:44:18.314 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.312+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/420324977 shutdown_connections 2024-05-03T22:44:18.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.312+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/420324977 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b10444500 0x563b10444980 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.312+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/420324977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b104498e0 0x563b10449cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.312+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/420324977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b1044a200 0x563b10443ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.312+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/420324977 >> 172.21.15.44:0/420324977 conn(0x563b103bc680 msgr2=0x563b1043e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:18.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.312+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/420324977 shutdown_connections 2024-05-03T22:44:18.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.312+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/420324977 wait complete. 2024-05-03T22:44:18.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.313+0000 7fd1ae7eab80 1 -- start start 2024-05-03T22:44:18.315 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.313+0000 7fd1ae7eab80 1 Processor -- start 2024-05-03T22:44:18.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.313+0000 7fd1ae7eab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b10444500 0x563b1044fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:18.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.313+0000 7fd1ae7eab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b104498e0 0x563b1044d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:18.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.313+0000 7fd1ae7eab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b1044a200 0x563b1044d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:18.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.313+0000 7fd1ae7eab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563b10450cb0 con 0x563b1044a200 2024-05-03T22:44:18.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.313+0000 7fd1ae7eab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563b102fcad0 con 0x563b10444500 2024-05-03T22:44:18.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.313+0000 7fd1ae7eab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x563b10450e30 con 0x563b104498e0 2024-05-03T22:44:18.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.313+0000 7fd1ae7eab80 10 client.0 _ll_register_callbacks cb 0x563b1033dc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:44:18.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.314+0000 7fd1a1e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b1044a200 0x563b1044d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:18.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.314+0000 7fd1a1e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b1044a200 0x563b1044d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55348/0 (socket says 172.21.15.44:55348) 2024-05-03T22:44:18.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.314+0000 7fd1a1e00700 1 -- 172.21.15.44:0/346806341 learned_addr learned my addr 172.21.15.44:0/346806341 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:18.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.314+0000 7fd1a1400700 1 --2- 172.21.15.44:0/346806341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b10444500 0x563b1044fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:18.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.314+0000 7fd1a0a00700 1 --2- 172.21.15.44:0/346806341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b104498e0 0x563b1044d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:18.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.314+0000 7fd1a1e00700 1 -- 172.21.15.44:0/346806341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b104498e0 msgr2=0x563b1044d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:18.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.314+0000 7fd1a1e00700 1 --2- 172.21.15.44:0/346806341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b104498e0 0x563b1044d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.314+0000 7fd1a1e00700 1 -- 172.21.15.44:0/346806341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b10444500 msgr2=0x563b1044fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:18.318 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.314+0000 7fd1a1e00700 1 --2- 172.21.15.44:0/346806341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b10444500 0x563b1044fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.314+0000 7fd1a1e00700 1 -- 172.21.15.44:0/346806341 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b1035c3d0 con 0x563b1044a200 2024-05-03T22:44:18.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.314+0000 7fd1a1400700 1 --2- 172.21.15.44:0/346806341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b10444500 0x563b1044fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:44:18.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.314+0000 7fd1a1e00700 1 --2- 172.21.15.44:0/346806341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b1044a200 0x563b1044d720 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd1940a8fb0 tx=0x7fd1940dfc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76fde53651b47eb server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:18.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.315+0000 7fd183400700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:44:18.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.315+0000 7fd183400700 1 -- 172.21.15.44:0/346806341 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1940c3060 con 0x563b1044a200 2024-05-03T22:44:18.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.315+0000 7fd183400700 1 -- 172.21.15.44:0/346806341 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fd1940a58f0 con 0x563b1044a200 2024-05-03T22:44:18.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.315+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/346806341 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd1940a9300 con 0x563b1044a200 2024-05-03T22:44:18.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.315+0000 7fd183400700 1 -- 172.21.15.44:0/346806341 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd1940b1ee0 con 0x563b1044a200 2024-05-03T22:44:18.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.315+0000 7fd1ae7eab80 10 client.15081 fetch_fsmap learned FSMap version 30 2024-05-03T22:44:18.319 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.315+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/346806341 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563b1045b440 con 0x563b1044a200 2024-05-03T22:44:18.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.315+0000 7fd183400700 1 -- 172.21.15.44:0/346806341 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fd1940a9300 con 0x563b1044a200 2024-05-03T22:44:18.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.316+0000 7fd183400700 1 -- 172.21.15.44:0/346806341 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd194012070 con 0x563b1044a200 2024-05-03T22:44:18.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.316+0000 7fd1ae7eab80 10 client.15081 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:44:18.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.316+0000 7fd1ae7eab80 10 client.15081 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-03T22:44:18.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.316+0000 7fd1ae7eab80 20 client.15081 populate_metadata read hostname 'smithi044' 2024-05-03T22:44:18.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.316+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/346806341 >> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] conn(0x563b1045c790 0x563b1045e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:18.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.316+0000 7fd1ae7eab80 4 client.15081 mds_command: new command op to 34391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:44:18.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.316+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/346806341 --> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b10410fa0 con 0x563b1045c790 2024-05-03T22:44:18.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.317+0000 7fd1a1400700 1 --2- 172.21.15.44:0/346806341 >> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] conn(0x563b1045c790 0x563b1045e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:18.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.318+0000 7fd1a1400700 1 --2- 172.21.15.44:0/346806341 >> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] conn(0x563b1045c790 0x563b1045e8d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=eb9ce840e638299b server_cookie=bde8e49e1252014f in_seq=0 out_seq=0 2024-05-03T22:44:18.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.318+0000 7fd183400700 10 client.15081 ms_handle_connect on v2:172.21.15.60:6832/153110190 2024-05-03T22:44:18.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.320+0000 7fd183400700 1 -- 172.21.15.44:0/346806341 <== mds.3 v2:172.21.15.60:6832/153110190 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563b10410fa0 con 0x563b1045c790 2024-05-03T22:44:18.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.320+0000 7fd183400700 10 client.15081 handle_command_reply: tid=0 2024-05-03T22:44:18.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.320+0000 7fd1ae7eab80 1 client.15081 shutdown 2024-05-03T22:44:18.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.320+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/346806341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b1044a200 msgr2=0x563b1044d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:18.322 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.320+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/346806341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b1044a200 0x563b1044d720 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd1940a8fb0 tx=0x7fd1940dfc70 comp rx=0 tx=0).stop 2024-05-03T22:44:18.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.321+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/346806341 shutdown_connections 2024-05-03T22:44:18.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.321+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/346806341 >> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] conn(0x563b1045c790 0x563b1045e8d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.321+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/346806341 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b1044a200 0x563b1044d720 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.323 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.321+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/346806341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b10444500 0x563b1044fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.321+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/346806341 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b104498e0 0x563b1044d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.321+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/346806341 >> 172.21.15.44:0/346806341 conn(0x563b103bc680 msgr2=0x563b10439360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:18.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.321+0000 7fd183400700 0 client.15081 ms_handle_reset on v2:172.21.15.60:6832/153110190 2024-05-03T22:44:18.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.321+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/346806341 shutdown_connections 2024-05-03T22:44:18.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.321+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/346806341 wait complete. 2024-05-03T22:44:18.324 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.321+0000 7fd1ae7eab80 20 client.15081 trim_cache size 0 max 16384 2024-05-03T22:44:18.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.345+0000 7fd1ae7eab80 1 Processor -- start 2024-05-03T22:44:18.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.345+0000 7fd1ae7eab80 1 -- start start 2024-05-03T22:44:18.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.345+0000 7fd1ae7eab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b10444500 0x563b10443ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:18.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.345+0000 7fd1ae7eab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b104498e0 0x563b10467d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:18.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.345+0000 7fd1ae7eab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b1044a200 0x563b10468270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:18.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.345+0000 7fd1ae7eab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563b1045cc10 con 0x563b10444500 2024-05-03T22:44:18.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.345+0000 7fd1ae7eab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563b1045d2e0 con 0x563b104498e0 2024-05-03T22:44:18.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.345+0000 7fd1ae7eab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x563b1045d9b0 con 0x563b1044a200 2024-05-03T22:44:18.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.345+0000 7fd1a1400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b10444500 0x563b10443ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:18.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.346+0000 7fd1a1400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b10444500 0x563b10443ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55350/0 (socket says 172.21.15.44:55350) 2024-05-03T22:44:18.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.346+0000 7fd1a1400700 1 -- 172.21.15.44:0/3262832801 learned_addr learned my addr 172.21.15.44:0/3262832801 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:18.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.346+0000 7fd1a0a00700 1 --2- 172.21.15.44:0/3262832801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b104498e0 0x563b10467d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:18.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.346+0000 7fd1a1e00700 1 --2- 172.21.15.44:0/3262832801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b1044a200 0x563b10468270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:18.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.346+0000 7fd1a1400700 1 -- 172.21.15.44:0/3262832801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b1044a200 msgr2=0x563b10468270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:18.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.346+0000 7fd1a1400700 1 --2- 172.21.15.44:0/3262832801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b1044a200 0x563b10468270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.346+0000 7fd1a1400700 1 -- 172.21.15.44:0/3262832801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b104498e0 msgr2=0x563b10467d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:18.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.346+0000 7fd1a1400700 1 --2- 172.21.15.44:0/3262832801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b104498e0 0x563b10467d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.346+0000 7fd1a1400700 1 -- 172.21.15.44:0/3262832801 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b1044fa80 con 0x563b10444500 2024-05-03T22:44:18.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.346+0000 7fd1a1e00700 1 --2- 172.21.15.44:0/3262832801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b1044a200 0x563b10468270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:44:18.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.346+0000 7fd1a1400700 1 --2- 172.21.15.44:0/3262832801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b10444500 0x563b10443ee0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd190005d60 tx=0x7fd190008530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fdc759c85eabf50 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:18.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.347+0000 7fd18e000700 1 -- 172.21.15.44:0/3262832801 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd190013c00 con 0x563b10444500 2024-05-03T22:44:18.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.347+0000 7fd18e000700 1 -- 172.21.15.44:0/3262832801 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fd190004520 con 0x563b10444500 2024-05-03T22:44:18.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.347+0000 7fd18e000700 1 -- 172.21.15.44:0/3262832801 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd190003680 con 0x563b10444500 2024-05-03T22:44:18.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.347+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/3262832801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b10444500 msgr2=0x563b10443ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:18.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.347+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/3262832801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b10444500 0x563b10443ee0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd190005d60 tx=0x7fd190008530 comp rx=0 tx=0).stop 2024-05-03T22:44:18.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.348+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/3262832801 shutdown_connections 2024-05-03T22:44:18.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.348+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/3262832801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b1044a200 0x563b10468270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.348+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/3262832801 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b10444500 0x563b10443ee0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.348+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/3262832801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b104498e0 0x563b10467d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.348+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/3262832801 >> 172.21.15.44:0/3262832801 conn(0x563b103bc680 msgr2=0x563b10438300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:18.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.348+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/3262832801 shutdown_connections 2024-05-03T22:44:18.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.348+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/3262832801 wait complete. 2024-05-03T22:44:18.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.348+0000 7fd1ae7eab80 1 -- start start 2024-05-03T22:44:18.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.349+0000 7fd1ae7eab80 1 Processor -- start 2024-05-03T22:44:18.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.349+0000 7fd1ae7eab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b10444500 0x563b10467d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:18.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.349+0000 7fd1ae7eab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b104498e0 0x563b10468290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:18.359 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.349+0000 7fd1ae7eab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b1044a200 0x563b10462d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:18.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.349+0000 7fd1ae7eab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x563b1045e750 con 0x563b104498e0 2024-05-03T22:44:18.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.349+0000 7fd1ae7eab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563b1045e080 con 0x563b1044a200 2024-05-03T22:44:18.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.349+0000 7fd1ae7eab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x563b1045ee20 con 0x563b10444500 2024-05-03T22:44:18.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.349+0000 7fd1ae7eab80 10 client.0 _ll_register_callbacks cb 0x563b1033dc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:44:18.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.349+0000 7fd1a0a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b104498e0 0x563b10468290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:18.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.349+0000 7fd1a0a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b104498e0 0x563b10468290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55354/0 (socket says 172.21.15.44:55354) 2024-05-03T22:44:18.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.350+0000 7fd1a0a00700 1 -- 172.21.15.44:0/1719842064 learned_addr learned my addr 172.21.15.44:0/1719842064 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:18.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.350+0000 7fd1a1400700 1 --2- 172.21.15.44:0/1719842064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b10444500 0x563b10467d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:18.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.350+0000 7fd1a1e00700 1 --2- 172.21.15.44:0/1719842064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b1044a200 0x563b10462d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:18.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.350+0000 7fd1a0a00700 1 -- 172.21.15.44:0/1719842064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b10444500 msgr2=0x563b10467d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:18.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.350+0000 7fd1a0a00700 1 --2- 172.21.15.44:0/1719842064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b10444500 0x563b10467d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.350+0000 7fd1a0a00700 1 -- 172.21.15.44:0/1719842064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b1044a200 msgr2=0x563b10462d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:18.361 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.350+0000 7fd1a0a00700 1 --2- 172.21.15.44:0/1719842064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b1044a200 0x563b10462d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.350+0000 7fd1a0a00700 1 -- 172.21.15.44:0/1719842064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b10463540 con 0x563b104498e0 2024-05-03T22:44:18.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.350+0000 7fd1a0a00700 1 --2- 172.21.15.44:0/1719842064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b104498e0 0x563b10468290 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd188000c00 tx=0x7fd188009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fcc2a876ac96d00 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:18.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.350+0000 7fd183400700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:44:18.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.351+0000 7fd183400700 1 -- 172.21.15.44:0/1719842064 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd188035060 con 0x563b104498e0 2024-05-03T22:44:18.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.351+0000 7fd183400700 1 -- 172.21.15.44:0/1719842064 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fd188021070 con 0x563b104498e0 2024-05-03T22:44:18.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.351+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/1719842064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd190004520 con 0x563b104498e0 2024-05-03T22:44:18.362 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.351+0000 7fd183400700 1 -- 172.21.15.44:0/1719842064 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd18803c050 con 0x563b104498e0 2024-05-03T22:44:18.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.351+0000 7fd1ae7eab80 10 client.15087 fetch_fsmap learned FSMap version 30 2024-05-03T22:44:18.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.351+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/1719842064 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563b104c9300 con 0x563b104498e0 2024-05-03T22:44:18.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.351+0000 7fd183400700 1 -- 172.21.15.44:0/1719842064 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fd190004520 con 0x563b104498e0 2024-05-03T22:44:18.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.352+0000 7fd183400700 1 -- 172.21.15.44:0/1719842064 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fd188027cb0 con 0x563b104498e0 2024-05-03T22:44:18.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.352+0000 7fd1ae7eab80 10 client.15087 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:44:18.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.352+0000 7fd1ae7eab80 10 client.15087 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-03T22:44:18.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.352+0000 7fd1ae7eab80 20 client.15087 populate_metadata read hostname 'smithi044' 2024-05-03T22:44:18.363 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.352+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/1719842064 >> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] conn(0x563b104cdf50 0x563b104ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:18.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.352+0000 7fd1ae7eab80 4 client.15087 mds_command: new command op to 34391 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:44:18.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.352+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/1719842064 --> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] -- command(tid 0: {"prefix": "status"}) -- 0x563b103a43b0 con 0x563b104cdf50 2024-05-03T22:44:18.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.353+0000 7fd1a1400700 1 --2- 172.21.15.44:0/1719842064 >> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] conn(0x563b104cdf50 0x563b104ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:18.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.353+0000 7fd1a1400700 1 --2- 172.21.15.44:0/1719842064 >> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] conn(0x563b104cdf50 0x563b104ccc60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1dfe6ea0de28bdf5 server_cookie=e3afaa9c3518e0c7 in_seq=0 out_seq=0 2024-05-03T22:44:18.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.353+0000 7fd183400700 10 client.15087 ms_handle_connect on v2:172.21.15.60:6832/153110190 2024-05-03T22:44:18.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.354+0000 7fd183400700 1 -- 172.21.15.44:0/1719842064 <== mds.3 v2:172.21.15.60:6832/153110190 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x563b103a43b0 con 0x563b104cdf50 2024-05-03T22:44:18.364 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.354+0000 7fd183400700 10 client.15087 handle_command_reply: tid=0 2024-05-03T22:44:18.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.354+0000 7fd1ae7eab80 1 client.15087 shutdown 2024-05-03T22:44:18.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.355+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/1719842064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b104498e0 msgr2=0x563b10468290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:18.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.355+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/1719842064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b104498e0 0x563b10468290 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd188000c00 tx=0x7fd188009ca0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.355+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/1719842064 shutdown_connections 2024-05-03T22:44:18.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.355+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/1719842064 >> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] conn(0x563b104cdf50 0x563b104ccc60 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.365 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.355+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/1719842064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b1044a200 0x563b10462d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.355+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/1719842064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563b10444500 0x563b10467d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.355+0000 7fd1ae7eab80 1 --2- 172.21.15.44:0/1719842064 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x563b104498e0 0x563b10468290 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.355+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/1719842064 >> 172.21.15.44:0/1719842064 conn(0x563b103bc680 msgr2=0x563b10438ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:18.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.355+0000 7fd183400700 0 client.15087 ms_handle_reset on v2:172.21.15.60:6832/153110190 2024-05-03T22:44:18.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.355+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/1719842064 shutdown_connections 2024-05-03T22:44:18.366 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.355+0000 7fd1ae7eab80 1 -- 172.21.15.44:0/1719842064 wait complete. 2024-05-03T22:44:18.367 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.355+0000 7fd1ae7eab80 20 client.15087 trim_cache size 0 max 16384 2024-05-03T22:44:18.367 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-03T22:44:18.367 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "5b0efdca-099c-11ef-bc97-c7b262605968", 2024-05-03T22:44:18.367 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 3, 2024-05-03T22:44:18.368 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 34391, 2024-05-03T22:44:18.368 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-05-03T22:44:18.368 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-05-03T22:44:18.368 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-05-03T22:44:18.368 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 158.17520322199999, 2024-05-03T22:44:18.368 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 30, 2024-05-03T22:44:18.368 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 89, 2024-05-03T22:44:18.368 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 87, 2024-05-03T22:44:18.369 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 314.34725015499998 2024-05-03T22:44:18.369 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-03T22:44:18.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.356+0000 7fd1a3e00700 1 -- 172.21.15.44:0/4214206413 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd1840b2990 msgr2=0x7fd1840b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:18.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.356+0000 7fd1a3e00700 1 --2- 172.21.15.44:0/4214206413 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd1840b2990 0x7fd1840b4e50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd188005cd0 tx=0x7fd188005c40 comp rx=0 tx=0).stop 2024-05-03T22:44:18.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.356+0000 7fd1a3e00700 1 -- 172.21.15.44:0/4214206413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd19c114670 msgr2=0x7fd19c1a4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:18.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.356+0000 7fd1a3e00700 1 --2- 172.21.15.44:0/4214206413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd19c114670 0x7fd19c1a4af0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd1940094f0 tx=0x7fd194007f90 comp rx=0 tx=0).stop 2024-05-03T22:44:18.370 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.356+0000 7fd1a3e00700 1 -- 172.21.15.44:0/4214206413 shutdown_connections 2024-05-03T22:44:18.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.356+0000 7fd1a3e00700 1 --2- 172.21.15.44:0/4214206413 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fd19c114670 0x7fd19c1a4af0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.356+0000 7fd1a3e00700 1 --2- 172.21.15.44:0/4214206413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd19c0756d0 0x7fd19c1a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.356+0000 7fd1a3e00700 1 --2- 172.21.15.44:0/4214206413 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fd1840b2990 0x7fd1840b4e50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.356+0000 7fd1a3e00700 1 --2- 172.21.15.44:0/4214206413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd19c075ff0 0x7fd19c1a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:18.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.356+0000 7fd1a3e00700 1 -- 172.21.15.44:0/4214206413 >> 172.21.15.44:0/4214206413 conn(0x7fd19c07a600 msgr2=0x7fd19c1133c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:18.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.356+0000 7fd1a3e00700 1 -- 172.21.15.44:0/4214206413 shutdown_connections 2024-05-03T22:44:18.371 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:18.356+0000 7fd1a3e00700 1 -- 172.21.15.44:0/4214206413 wait complete. 2024-05-03T22:44:18.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:18 smithi044 ceph-mon[28604]: pgmap v503: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:18.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:18 smithi060 ceph-mon[31721]: pgmap v503: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:18.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:18 smithi160 ceph-mon[32531]: pgmap v503: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:19.331 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell mds.e status 2024-05-03T22:44:19.817 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:44:20.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:20 smithi044 ceph-mon[28604]: pgmap v504: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:44:20.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:20 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:44:20.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:20 smithi060 ceph-mon[31721]: pgmap v504: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:44:20.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:20 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:44:20.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:20 smithi160 ceph-mon[32531]: pgmap v504: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:44:20.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:20 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:44:22.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.139+0000 7f885d000700 1 -- 172.21.15.44:0/2425185913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8858106080 msgr2=0x7f8858112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:22.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.139+0000 7f885d000700 1 --2- 172.21.15.44:0/2425185913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8858106080 0x7f8858112590 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f885000b0a0 tx=0x7f885000b3b0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.139+0000 7f885d000700 1 -- 172.21.15.44:0/2425185913 shutdown_connections 2024-05-03T22:44:22.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.139+0000 7f885d000700 1 --2- 172.21.15.44:0/2425185913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8858106080 0x7f8858112590 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.139+0000 7f885d000700 1 --2- 172.21.15.44:0/2425185913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f885810b6c0 0x7f885810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.142 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.139+0000 7f885d000700 1 --2- 172.21.15.44:0/2425185913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88581056c0 0x7f8858105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.139+0000 7f885d000700 1 -- 172.21.15.44:0/2425185913 >> 172.21.15.44:0/2425185913 conn(0x7f88581011b0 msgr2=0x7f88581035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:22.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.140+0000 7f885d000700 1 -- 172.21.15.44:0/2425185913 shutdown_connections 2024-05-03T22:44:22.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.140+0000 7f885d000700 1 -- 172.21.15.44:0/2425185913 wait complete. 2024-05-03T22:44:22.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.141+0000 7f885d000700 1 Processor -- start 2024-05-03T22:44:22.143 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.141+0000 7f885d000700 1 -- start start 2024-05-03T22:44:22.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.141+0000 7f885d000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88581056c0 0x7f885819be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:22.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.141+0000 7f885d000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8858106080 0x7f885819c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:22.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.141+0000 7f885d000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f885810b6c0 0x7f88581a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:22.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.141+0000 7f885d000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f8858115a70 con 0x7f8858106080 2024-05-03T22:44:22.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.141+0000 7f885d000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f88581158f0 con 0x7f885810b6c0 2024-05-03T22:44:22.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.141+0000 7f885d000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8858115bf0 con 0x7f88581056c0 2024-05-03T22:44:22.144 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.142+0000 7f884fe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8858106080 0x7f885819c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:22.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.142+0000 7f884fe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8858106080 0x7f885819c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55884/0 (socket says 172.21.15.44:55884) 2024-05-03T22:44:22.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.142+0000 7f884fe00700 1 -- 172.21.15.44:0/1329652309 learned_addr learned my addr 172.21.15.44:0/1329652309 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:22.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.142+0000 7f8855e00700 1 --2- 172.21.15.44:0/1329652309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88581056c0 0x7f885819be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:22.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.142+0000 7f8856800700 1 --2- 172.21.15.44:0/1329652309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f885810b6c0 0x7f88581a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:22.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.142+0000 7f884fe00700 1 -- 172.21.15.44:0/1329652309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88581056c0 msgr2=0x7f885819be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:22.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.142+0000 7f884fe00700 1 --2- 172.21.15.44:0/1329652309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88581056c0 0x7f885819be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.142+0000 7f884fe00700 1 -- 172.21.15.44:0/1329652309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f885810b6c0 msgr2=0x7f88581a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:22.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.142+0000 7f884fe00700 1 --2- 172.21.15.44:0/1329652309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f885810b6c0 0x7f88581a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.142+0000 7f884fe00700 1 -- 172.21.15.44:0/1329652309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88581a0e70 con 0x7f8858106080 2024-05-03T22:44:22.145 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.143+0000 7f884fe00700 1 --2- 172.21.15.44:0/1329652309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8858106080 0x7f885819c3a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f884000d980 tx=0x7f884000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:22.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.143+0000 7f884ea00700 1 -- 172.21.15.44:0/1329652309 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8840016070 con 0x7f8858106080 2024-05-03T22:44:22.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.143+0000 7f884ea00700 1 -- 172.21.15.44:0/1329652309 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f8840004d00 con 0x7f8858106080 2024-05-03T22:44:22.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.143+0000 7f885d000700 1 -- 172.21.15.44:0/1329652309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88581a1160 con 0x7f8858106080 2024-05-03T22:44:22.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.143+0000 7f884ea00700 1 -- 172.21.15.44:0/1329652309 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88400055f0 con 0x7f8858106080 2024-05-03T22:44:22.146 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.143+0000 7f885d000700 1 -- 172.21.15.44:0/1329652309 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88581a89e0 con 0x7f8858106080 2024-05-03T22:44:22.149 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.148+0000 7f884ea00700 1 -- 172.21.15.44:0/1329652309 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f8840004750 con 0x7f8858106080 2024-05-03T22:44:22.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.148+0000 7f88678dab80 1 Processor -- start 2024-05-03T22:44:22.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.149+0000 7f88678dab80 1 -- start start 2024-05-03T22:44:22.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.149+0000 7f88678dab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b807760 0x55d14b807b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:22.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.149+0000 7f88678dab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b808080 0x55d14b802f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:22.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.149+0000 7f88678dab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b803580 0x55d14b8039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:22.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.149+0000 7f88678dab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d14b7559d0 con 0x55d14b807760 2024-05-03T22:44:22.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.149+0000 7f88678dab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d14b6f3710 con 0x55d14b808080 2024-05-03T22:44:22.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.149+0000 7f88678dab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d14b751990 con 0x55d14b803580 2024-05-03T22:44:22.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.149+0000 7f8856800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b807760 0x55d14b807b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:22.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.150+0000 7f8856800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b807760 0x55d14b807b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55890/0 (socket says 172.21.15.44:55890) 2024-05-03T22:44:22.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.150+0000 7f8856800700 1 -- 172.21.15.44:0/1097358696 learned_addr learned my addr 172.21.15.44:0/1097358696 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:22.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.150+0000 7f8855e00700 1 --2- 172.21.15.44:0/1097358696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b808080 0x55d14b802f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:22.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.150+0000 7f884fe00700 1 --2- 172.21.15.44:0/1097358696 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b803580 0x55d14b8039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:22.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.150+0000 7f8856800700 1 -- 172.21.15.44:0/1097358696 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b803580 msgr2=0x55d14b8039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:22.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.150+0000 7f8856800700 1 --2- 172.21.15.44:0/1097358696 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b803580 0x55d14b8039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.150+0000 7f8856800700 1 -- 172.21.15.44:0/1097358696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b808080 msgr2=0x55d14b802f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:22.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.150+0000 7f8856800700 1 --2- 172.21.15.44:0/1097358696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b808080 0x55d14b802f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.150+0000 7f8856800700 1 -- 172.21.15.44:0/1097358696 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d14b6a2880 con 0x55d14b807760 2024-05-03T22:44:22.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.151+0000 7f884ea00700 1 --2- 172.21.15.44:0/1329652309 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f883c0b2910 0x7f883c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:22.153 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.151+0000 7f8856800700 1 --2- 172.21.15.44:0/1097358696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b807760 0x55d14b807b40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8850015000 tx=0x7f8850009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77595ef93b99eb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:22.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.151+0000 7f884ea00700 1 -- 172.21.15.44:0/1329652309 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f88400e25c0 con 0x7f8858106080 2024-05-03T22:44:22.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.151+0000 7f8847400700 1 -- 172.21.15.44:0/1097358696 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8850020070 con 0x55d14b807760 2024-05-03T22:44:22.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.151+0000 7f8855e00700 1 --2- 172.21.15.44:0/1329652309 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f883c0b2910 0x7f883c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:22.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.151+0000 7f8847400700 1 -- 172.21.15.44:0/1097358696 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f8850009350 con 0x55d14b807760 2024-05-03T22:44:22.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.151+0000 7f8847400700 1 -- 172.21.15.44:0/1097358696 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8850007e30 con 0x55d14b807760 2024-05-03T22:44:22.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.152+0000 7f88678dab80 1 -- 172.21.15.44:0/1097358696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b807760 msgr2=0x55d14b807b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:22.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.152+0000 7f88678dab80 1 --2- 172.21.15.44:0/1097358696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b807760 0x55d14b807b40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8850015000 tx=0x7f8850009e20 comp rx=0 tx=0).stop 2024-05-03T22:44:22.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.152+0000 7f8855e00700 1 --2- 172.21.15.44:0/1329652309 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f883c0b2910 0x7f883c0b4dd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8848005950 tx=0x7f884800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:22.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.152+0000 7f88678dab80 1 -- 172.21.15.44:0/1097358696 shutdown_connections 2024-05-03T22:44:22.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.152+0000 7f88678dab80 1 --2- 172.21.15.44:0/1097358696 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b803580 0x55d14b8039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.152+0000 7f88678dab80 1 --2- 172.21.15.44:0/1097358696 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b807760 0x55d14b807b40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.152+0000 7f88678dab80 1 --2- 172.21.15.44:0/1097358696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b808080 0x55d14b802f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.152+0000 7f88678dab80 1 -- 172.21.15.44:0/1097358696 >> 172.21.15.44:0/1097358696 conn(0x55d14b731b10 msgr2=0x55d14b7fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:22.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.152+0000 7f88678dab80 1 -- 172.21.15.44:0/1097358696 shutdown_connections 2024-05-03T22:44:22.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.152+0000 7f88678dab80 1 -- 172.21.15.44:0/1097358696 wait complete. 2024-05-03T22:44:22.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.153+0000 7f88678dab80 1 -- start start 2024-05-03T22:44:22.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.153+0000 7f88678dab80 1 Processor -- start 2024-05-03T22:44:22.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.154+0000 7f88678dab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b803580 0x55d14b80ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:22.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.154+0000 7f88678dab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b807760 0x55d14b80c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:22.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.154+0000 7f88678dab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b808080 0x55d14b80c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:22.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.154+0000 7f88678dab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d14b80fbf0 con 0x55d14b808080 2024-05-03T22:44:22.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.154+0000 7f88678dab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d14b6bbad0 con 0x55d14b803580 2024-05-03T22:44:22.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.154+0000 7f88678dab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d14b80fd70 con 0x55d14b807760 2024-05-03T22:44:22.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.154+0000 7f88678dab80 10 client.0 _ll_register_callbacks cb 0x55d14b6fcc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:44:22.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.154+0000 7f8856800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b808080 0x55d14b80c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:22.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.154+0000 7f8856800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b808080 0x55d14b80c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55894/0 (socket says 172.21.15.44:55894) 2024-05-03T22:44:22.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.154+0000 7f8856800700 1 -- 172.21.15.44:0/3415504157 learned_addr learned my addr 172.21.15.44:0/3415504157 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:22.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.155+0000 7f8855e00700 1 --2- 172.21.15.44:0/3415504157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b803580 0x55d14b80ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:22.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.155+0000 7f884fe00700 1 --2- 172.21.15.44:0/3415504157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b807760 0x55d14b80c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:22.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.155+0000 7f8856800700 1 -- 172.21.15.44:0/3415504157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b807760 msgr2=0x55d14b80c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:22.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.155+0000 7f8856800700 1 --2- 172.21.15.44:0/3415504157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b807760 0x55d14b80c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.155+0000 7f8856800700 1 -- 172.21.15.44:0/3415504157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b803580 msgr2=0x55d14b80ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:22.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.155+0000 7f8856800700 1 --2- 172.21.15.44:0/3415504157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b803580 0x55d14b80ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.155+0000 7f8856800700 1 -- 172.21.15.44:0/3415504157 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d14b71b3d0 con 0x55d14b808080 2024-05-03T22:44:22.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.155+0000 7f8856800700 1 --2- 172.21.15.44:0/3415504157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b808080 0x55d14b80c760 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8850009a20 tx=0x7f885000b060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fee31c2de52f6d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:22.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.155+0000 7f883be00700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:44:22.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.155+0000 7f883be00700 1 -- 172.21.15.44:0/3415504157 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8850020040 con 0x55d14b808080 2024-05-03T22:44:22.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.156+0000 7f883be00700 1 -- 172.21.15.44:0/3415504157 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f8850003c10 con 0x55d14b808080 2024-05-03T22:44:22.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.156+0000 7f88678dab80 1 -- 172.21.15.44:0/3415504157 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8850009350 con 0x55d14b808080 2024-05-03T22:44:22.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.156+0000 7f883be00700 1 -- 172.21.15.44:0/3415504157 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8850036050 con 0x55d14b808080 2024-05-03T22:44:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.156+0000 7f88678dab80 10 client.15099 fetch_fsmap learned FSMap version 30 2024-05-03T22:44:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.156+0000 7f88678dab80 1 -- 172.21.15.44:0/3415504157 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d14b81a420 con 0x55d14b808080 2024-05-03T22:44:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.156+0000 7f883be00700 1 -- 172.21.15.44:0/3415504157 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f8850009350 con 0x55d14b808080 2024-05-03T22:44:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.156+0000 7f883be00700 1 -- 172.21.15.44:0/3415504157 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8850011070 con 0x55d14b808080 2024-05-03T22:44:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.157+0000 7f88678dab80 10 client.15099 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:44:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.157+0000 7f88678dab80 10 client.15099 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-03T22:44:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.157+0000 7f88678dab80 20 client.15099 populate_metadata read hostname 'smithi044' 2024-05-03T22:44:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.157+0000 7f88678dab80 1 --2- 172.21.15.44:0/3415504157 >> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] conn(0x55d14b81b770 0x55d14b81d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.157+0000 7f88678dab80 4 client.15099 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:44:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.157+0000 7f88678dab80 1 -- 172.21.15.44:0/3415504157 --> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d14b7d0180 con 0x55d14b81b770 2024-05-03T22:44:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.157+0000 7f8855e00700 1 --2- 172.21.15.44:0/3415504157 >> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] conn(0x55d14b81b770 0x55d14b81d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.158+0000 7f8855e00700 1 --2- 172.21.15.44:0/3415504157 >> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] conn(0x55d14b81b770 0x55d14b81d950 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e2438232f3273452 server_cookie=2369eb79701da399 in_seq=0 out_seq=0 2024-05-03T22:44:22.160 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.158+0000 7f883be00700 10 client.15099 ms_handle_connect on v2:172.21.15.60:6834/3390425489 2024-05-03T22:44:22.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.159+0000 7f883be00700 1 -- 172.21.15.44:0/3415504157 <== mds.2 v2:172.21.15.60:6834/3390425489 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d14b7d0180 con 0x55d14b81b770 2024-05-03T22:44:22.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.159+0000 7f883be00700 10 client.15099 handle_command_reply: tid=0 2024-05-03T22:44:22.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.159+0000 7f88678dab80 1 client.15099 shutdown 2024-05-03T22:44:22.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.160+0000 7f88678dab80 1 -- 172.21.15.44:0/3415504157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b808080 msgr2=0x55d14b80c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:22.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.160+0000 7f88678dab80 1 --2- 172.21.15.44:0/3415504157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b808080 0x55d14b80c760 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8850009a20 tx=0x7f885000b060 comp rx=0 tx=0).stop 2024-05-03T22:44:22.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.160+0000 7f88678dab80 1 -- 172.21.15.44:0/3415504157 shutdown_connections 2024-05-03T22:44:22.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.160+0000 7f88678dab80 1 --2- 172.21.15.44:0/3415504157 >> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] conn(0x55d14b81b770 0x55d14b81d950 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.160+0000 7f88678dab80 1 --2- 172.21.15.44:0/3415504157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b808080 0x55d14b80c760 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.160+0000 7f88678dab80 1 --2- 172.21.15.44:0/3415504157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b803580 0x55d14b80ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.160+0000 7f88678dab80 1 --2- 172.21.15.44:0/3415504157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b807760 0x55d14b80c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.160+0000 7f88678dab80 1 -- 172.21.15.44:0/3415504157 >> 172.21.15.44:0/3415504157 conn(0x55d14b731b10 msgr2=0x55d14b808d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:22.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.160+0000 7f883be00700 0 client.15099 ms_handle_reset on v2:172.21.15.60:6834/3390425489 2024-05-03T22:44:22.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.160+0000 7f88678dab80 1 -- 172.21.15.44:0/3415504157 shutdown_connections 2024-05-03T22:44:22.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.160+0000 7f88678dab80 1 -- 172.21.15.44:0/3415504157 wait complete. 2024-05-03T22:44:22.163 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.160+0000 7f88678dab80 20 client.15099 trim_cache size 0 max 16384 2024-05-03T22:44:22.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.183+0000 7f88678dab80 1 Processor -- start 2024-05-03T22:44:22.185 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.184+0000 7f88678dab80 1 -- start start 2024-05-03T22:44:22.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.184+0000 7f88678dab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b803580 0x55d14b7ff4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:22.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.184+0000 7f88678dab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b807760 0x55d14b806c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:22.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.184+0000 7f88678dab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b808080 0x55d14b818740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:22.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.184+0000 7f88678dab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d14b81bc90 con 0x55d14b803580 2024-05-03T22:44:22.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.184+0000 7f88678dab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d14b81c360 con 0x55d14b807760 2024-05-03T22:44:22.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.184+0000 7f88678dab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d14b81ca30 con 0x55d14b808080 2024-05-03T22:44:22.186 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.184+0000 7f8855e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b803580 0x55d14b7ff4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.184+0000 7f8855e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b803580 0x55d14b7ff4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55902/0 (socket says 172.21.15.44:55902) 2024-05-03T22:44:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.184+0000 7f8855e00700 1 -- 172.21.15.44:0/221537279 learned_addr learned my addr 172.21.15.44:0/221537279 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.184+0000 7f884fe00700 1 --2- 172.21.15.44:0/221537279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b807760 0x55d14b806c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.185+0000 7f8856800700 1 --2- 172.21.15.44:0/221537279 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b808080 0x55d14b818740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.185+0000 7f8855e00700 1 -- 172.21.15.44:0/221537279 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b808080 msgr2=0x55d14b818740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.185+0000 7f8855e00700 1 --2- 172.21.15.44:0/221537279 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b808080 0x55d14b818740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.185+0000 7f8855e00700 1 -- 172.21.15.44:0/221537279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b807760 msgr2=0x55d14b806c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.185+0000 7f8855e00700 1 --2- 172.21.15.44:0/221537279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b807760 0x55d14b806c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.187 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.185+0000 7f8855e00700 1 -- 172.21.15.44:0/221537279 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d14b7ff240 con 0x55d14b803580 2024-05-03T22:44:22.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.185+0000 7f8855e00700 1 --2- 172.21.15.44:0/221537279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b803580 0x55d14b7ff4a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f884800b8b0 tx=0x7f8848019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e07c4e1bffeaa07f server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:22.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.186+0000 7f8846a00700 1 -- 172.21.15.44:0/221537279 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884802f070 con 0x55d14b803580 2024-05-03T22:44:22.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.186+0000 7f8846a00700 1 -- 172.21.15.44:0/221537279 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f884802a9b0 con 0x55d14b803580 2024-05-03T22:44:22.188 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.186+0000 7f8846a00700 1 -- 172.21.15.44:0/221537279 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884801e710 con 0x55d14b803580 2024-05-03T22:44:22.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.186+0000 7f88678dab80 1 -- 172.21.15.44:0/221537279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b803580 msgr2=0x55d14b7ff4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:22.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.186+0000 7f88678dab80 1 --2- 172.21.15.44:0/221537279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b803580 0x55d14b7ff4a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f884800b8b0 tx=0x7f8848019000 comp rx=0 tx=0).stop 2024-05-03T22:44:22.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.187+0000 7f88678dab80 1 -- 172.21.15.44:0/221537279 shutdown_connections 2024-05-03T22:44:22.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.187+0000 7f88678dab80 1 --2- 172.21.15.44:0/221537279 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b808080 0x55d14b818740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.187+0000 7f88678dab80 1 --2- 172.21.15.44:0/221537279 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b803580 0x55d14b7ff4a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.187+0000 7f88678dab80 1 --2- 172.21.15.44:0/221537279 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b807760 0x55d14b806c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.187+0000 7f88678dab80 1 -- 172.21.15.44:0/221537279 >> 172.21.15.44:0/221537279 conn(0x55d14b731b10 msgr2=0x55d14b818030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:22.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.187+0000 7f88678dab80 1 -- 172.21.15.44:0/221537279 shutdown_connections 2024-05-03T22:44:22.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.187+0000 7f88678dab80 1 -- 172.21.15.44:0/221537279 wait complete. 2024-05-03T22:44:22.189 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.187+0000 7f88678dab80 1 -- start start 2024-05-03T22:44:22.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.187+0000 7f88678dab80 1 Processor -- start 2024-05-03T22:44:22.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.188+0000 7f88678dab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b803580 0x55d14b826d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:22.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.188+0000 7f88678dab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b807760 0x55d14b827290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:22.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.188+0000 7f88678dab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b808080 0x55d14b8210c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:22.191 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.188+0000 7f88678dab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55d14b81d7d0 con 0x55d14b803580 2024-05-03T22:44:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.188+0000 7f88678dab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d14b81d100 con 0x55d14b808080 2024-05-03T22:44:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.188+0000 7f88678dab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55d14b81dea0 con 0x55d14b807760 2024-05-03T22:44:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.188+0000 7f88678dab80 10 client.0 _ll_register_callbacks cb 0x55d14b6fcc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:44:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.188+0000 7f8855e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b803580 0x55d14b826d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.188+0000 7f8855e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b803580 0x55d14b826d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55906/0 (socket says 172.21.15.44:55906) 2024-05-03T22:44:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.188+0000 7f8855e00700 1 -- 172.21.15.44:0/690202642 learned_addr learned my addr 172.21.15.44:0/690202642 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.189+0000 7f8856800700 1 --2- 172.21.15.44:0/690202642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b808080 0x55d14b8210c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.189+0000 7f884fe00700 1 --2- 172.21.15.44:0/690202642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b807760 0x55d14b827290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.189+0000 7f8855e00700 1 -- 172.21.15.44:0/690202642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b807760 msgr2=0x55d14b827290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.189+0000 7f8855e00700 1 --2- 172.21.15.44:0/690202642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b807760 0x55d14b827290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.189+0000 7f8855e00700 1 -- 172.21.15.44:0/690202642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b808080 msgr2=0x55d14b8210c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:22.192 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.189+0000 7f8855e00700 1 --2- 172.21.15.44:0/690202642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b808080 0x55d14b8210c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.189+0000 7f8855e00700 1 -- 172.21.15.44:0/690202642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d14b81e8b0 con 0x55d14b803580 2024-05-03T22:44:22.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.189+0000 7f884fe00700 1 --2- 172.21.15.44:0/690202642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b807760 0x55d14b827290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:44:22.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.189+0000 7f8855e00700 1 --2- 172.21.15.44:0/690202642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b803580 0x55d14b826d50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f884802d040 tx=0x7f8848003f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb95c7c2be880982 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:22.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.189+0000 7f883be00700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:44:22.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.190+0000 7f883be00700 1 -- 172.21.15.44:0/690202642 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884802f070 con 0x55d14b803580 2024-05-03T22:44:22.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.190+0000 7f883be00700 1 -- 172.21.15.44:0/690202642 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f884802a6e0 con 0x55d14b803580 2024-05-03T22:44:22.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.190+0000 7f88678dab80 1 -- 172.21.15.44:0/690202642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f884802a9b0 con 0x55d14b803580 2024-05-03T22:44:22.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.190+0000 7f883be00700 1 -- 172.21.15.44:0/690202642 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f8848043050 con 0x55d14b803580 2024-05-03T22:44:22.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.190+0000 7f88678dab80 10 client.15105 fetch_fsmap learned FSMap version 30 2024-05-03T22:44:22.193 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.190+0000 7f88678dab80 1 -- 172.21.15.44:0/690202642 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d14b7ff050 con 0x55d14b803580 2024-05-03T22:44:22.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.190+0000 7f883be00700 1 -- 172.21.15.44:0/690202642 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f884802a9b0 con 0x55d14b803580 2024-05-03T22:44:22.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.190+0000 7f883be00700 1 -- 172.21.15.44:0/690202642 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f8848035c30 con 0x55d14b803580 2024-05-03T22:44:22.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.191+0000 7f88678dab80 10 client.15105 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:44:22.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.191+0000 7f88678dab80 10 client.15105 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-03T22:44:22.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.191+0000 7f88678dab80 20 client.15105 populate_metadata read hostname 'smithi044' 2024-05-03T22:44:22.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.191+0000 7f88678dab80 1 --2- 172.21.15.44:0/690202642 >> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] conn(0x55d14b88c920 0x55d14b88b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:22.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.191+0000 7f88678dab80 4 client.15105 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:44:22.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.191+0000 7f88678dab80 1 -- 172.21.15.44:0/690202642 --> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] -- command(tid 0: {"prefix": "status"}) -- 0x55d14b7633b0 con 0x55d14b88c920 2024-05-03T22:44:22.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.191+0000 7f884fe00700 1 --2- 172.21.15.44:0/690202642 >> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] conn(0x55d14b88c920 0x55d14b88b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:22.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.192+0000 7f884fe00700 1 --2- 172.21.15.44:0/690202642 >> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] conn(0x55d14b88c920 0x55d14b88b630 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=172f892d06f00771 server_cookie=5df6d443f7f98ea3 in_seq=0 out_seq=0 2024-05-03T22:44:22.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.192+0000 7f883be00700 10 client.15105 ms_handle_connect on v2:172.21.15.60:6834/3390425489 2024-05-03T22:44:22.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.192+0000 7f883be00700 1 -- 172.21.15.44:0/690202642 <== mds.2 v2:172.21.15.60:6834/3390425489 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55d14b7633b0 con 0x55d14b88c920 2024-05-03T22:44:22.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.192+0000 7f883be00700 10 client.15105 handle_command_reply: tid=0 2024-05-03T22:44:22.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.192+0000 7f88678dab80 1 client.15105 shutdown 2024-05-03T22:44:22.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.192+0000 7f88678dab80 1 -- 172.21.15.44:0/690202642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b803580 msgr2=0x55d14b826d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:22.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.192+0000 7f88678dab80 1 --2- 172.21.15.44:0/690202642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b803580 0x55d14b826d50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f884802d040 tx=0x7f8848003f20 comp rx=0 tx=0).stop 2024-05-03T22:44:22.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.193+0000 7f88678dab80 1 -- 172.21.15.44:0/690202642 shutdown_connections 2024-05-03T22:44:22.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.193+0000 7f88678dab80 1 --2- 172.21.15.44:0/690202642 >> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] conn(0x55d14b88c920 0x55d14b88b630 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.193+0000 7f88678dab80 1 --2- 172.21.15.44:0/690202642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d14b808080 0x55d14b8210c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.196 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.193+0000 7f88678dab80 1 --2- 172.21.15.44:0/690202642 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55d14b803580 0x55d14b826d50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.193+0000 7f88678dab80 1 --2- 172.21.15.44:0/690202642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d14b807760 0x55d14b827290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.193+0000 7f88678dab80 1 -- 172.21.15.44:0/690202642 >> 172.21.15.44:0/690202642 conn(0x55d14b731b10 msgr2=0x55d14b8188c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:22.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.193+0000 7f883be00700 0 client.15105 ms_handle_reset on v2:172.21.15.60:6834/3390425489 2024-05-03T22:44:22.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.193+0000 7f88678dab80 1 -- 172.21.15.44:0/690202642 shutdown_connections 2024-05-03T22:44:22.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.193+0000 7f88678dab80 1 -- 172.21.15.44:0/690202642 wait complete. 2024-05-03T22:44:22.197 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.193+0000 7f88678dab80 20 client.15105 trim_cache size 0 max 16384 2024-05-03T22:44:22.197 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-03T22:44:22.197 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "5b0efdca-099c-11ef-bc97-c7b262605968", 2024-05-03T22:44:22.197 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 2, 2024-05-03T22:44:22.197 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 34409, 2024-05-03T22:44:22.197 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-05-03T22:44:22.198 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-05-03T22:44:22.198 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-05-03T22:44:22.198 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 163.02735926, 2024-05-03T22:44:22.198 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 30, 2024-05-03T22:44:22.198 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 89, 2024-05-03T22:44:22.198 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 87, 2024-05-03T22:44:22.198 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 302.41978485200002 2024-05-03T22:44:22.198 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-03T22:44:22.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.194+0000 7f885d000700 1 -- 172.21.15.44:0/1329652309 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f883c0b2910 msgr2=0x7f883c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:22.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.194+0000 7f885d000700 1 --2- 172.21.15.44:0/1329652309 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f883c0b2910 0x7f883c0b4dd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8848005950 tx=0x7f884800b410 comp rx=0 tx=0).stop 2024-05-03T22:44:22.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.194+0000 7f885d000700 1 -- 172.21.15.44:0/1329652309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8858106080 msgr2=0x7f885819c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:22.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.194+0000 7f885d000700 1 --2- 172.21.15.44:0/1329652309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8858106080 0x7f885819c3a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f884000d980 tx=0x7f884000dc90 comp rx=0 tx=0).stop 2024-05-03T22:44:22.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.194+0000 7f885d000700 1 -- 172.21.15.44:0/1329652309 shutdown_connections 2024-05-03T22:44:22.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.194+0000 7f885d000700 1 --2- 172.21.15.44:0/1329652309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f885810b6c0 0x7f88581a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.194+0000 7f885d000700 1 --2- 172.21.15.44:0/1329652309 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f883c0b2910 0x7f883c0b4dd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.194+0000 7f885d000700 1 --2- 172.21.15.44:0/1329652309 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88581056c0 0x7f885819be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.194+0000 7f885d000700 1 --2- 172.21.15.44:0/1329652309 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f8858106080 0x7f885819c3a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:22.199 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.194+0000 7f885d000700 1 -- 172.21.15.44:0/1329652309 >> 172.21.15.44:0/1329652309 conn(0x7f88581011b0 msgr2=0x7f8858101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:22.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.194+0000 7f885d000700 1 -- 172.21.15.44:0/1329652309 shutdown_connections 2024-05-03T22:44:22.200 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:22.194+0000 7f885d000700 1 -- 172.21.15.44:0/1329652309 wait complete. 2024-05-03T22:44:22.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:22 smithi044 ceph-mon[28604]: pgmap v505: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:44:22.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:22 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:44:22.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:22 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:44:22.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:22 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:44:22.569 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:22 smithi160 ceph-mon[32531]: pgmap v505: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:44:22.569 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:22 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:44:22.569 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:22 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:44:22.569 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:22 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:44:22.757 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:22 smithi060 ceph-mon[31721]: pgmap v505: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:44:22.757 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:22 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:44:22.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:22 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:44:22.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:22 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:44:23.214 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell mds.h status 2024-05-03T22:44:23.699 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:44:24.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:24 smithi044 ceph-mon[28604]: pgmap v506: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:24 smithi060 ceph-mon[31721]: pgmap v506: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:24.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:24 smithi160 ceph-mon[32531]: pgmap v506: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:25.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.958+0000 7f1e73000700 1 -- 172.21.15.44:0/844200574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c109530 msgr2=0x7f1e6c109910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:25.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.958+0000 7f1e73000700 1 --2- 172.21.15.44:0/844200574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c109530 0x7f1e6c109910 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009990 tx=0x7f1e5c009ca0 comp rx=0 tx=0).stop 2024-05-03T22:44:25.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.958+0000 7f1e73000700 1 -- 172.21.15.44:0/844200574 shutdown_connections 2024-05-03T22:44:25.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.958+0000 7f1e73000700 1 --2- 172.21.15.44:0/844200574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e6c06c530 0x7f1e6c110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:25.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.958+0000 7f1e73000700 1 --2- 172.21.15.44:0/844200574 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c109530 0x7f1e6c109910 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:25.960 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.958+0000 7f1e73000700 1 --2- 172.21.15.44:0/844200574 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e6c06bb70 0x7f1e6c06bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:25.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.958+0000 7f1e73000700 1 -- 172.21.15.44:0/844200574 >> 172.21.15.44:0/844200574 conn(0x7f1e6c079350 msgr2=0x7f1e6c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:25.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.958+0000 7f1e73000700 1 -- 172.21.15.44:0/844200574 shutdown_connections 2024-05-03T22:44:25.961 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.959+0000 7f1e73000700 1 -- 172.21.15.44:0/844200574 wait complete. 2024-05-03T22:44:25.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.960+0000 7f1e73000700 1 Processor -- start 2024-05-03T22:44:25.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.960+0000 7f1e73000700 1 -- start start 2024-05-03T22:44:25.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.960+0000 7f1e73000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e6c06bb70 0x7f1e6c102850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:25.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.960+0000 7f1e73000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c06c530 0x7f1e6c102d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:25.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.960+0000 7f1e73000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e6c109530 0x7f1e6c1032d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:25.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.960+0000 7f1e73000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6c1137a0 con 0x7f1e6c06c530 2024-05-03T22:44:25.962 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.960+0000 7f1e73000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6c113620 con 0x7f1e6c109530 2024-05-03T22:44:25.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.960+0000 7f1e73000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6c113920 con 0x7f1e6c06bb70 2024-05-03T22:44:25.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.961+0000 7f1e6b400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c06c530 0x7f1e6c102d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:25.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.961+0000 7f1e6b400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c06c530 0x7f1e6c102d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55922/0 (socket says 172.21.15.44:55922) 2024-05-03T22:44:25.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.961+0000 7f1e6b400700 1 -- 172.21.15.44:0/388415500 learned_addr learned my addr 172.21.15.44:0/388415500 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:25.963 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.961+0000 7f1e6be00700 1 --2- 172.21.15.44:0/388415500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e6c06bb70 0x7f1e6c102850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:25.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.961+0000 7f1e71000700 1 --2- 172.21.15.44:0/388415500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e6c109530 0x7f1e6c1032d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:25.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.961+0000 7f1e6b400700 1 -- 172.21.15.44:0/388415500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e6c06bb70 msgr2=0x7f1e6c102850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:25.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.961+0000 7f1e6b400700 1 --2- 172.21.15.44:0/388415500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e6c06bb70 0x7f1e6c102850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:25.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.961+0000 7f1e6b400700 1 -- 172.21.15.44:0/388415500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e6c109530 msgr2=0x7f1e6c1032d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:25.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.961+0000 7f1e6b400700 1 --2- 172.21.15.44:0/388415500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e6c109530 0x7f1e6c1032d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:25.964 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.961+0000 7f1e6b400700 1 -- 172.21.15.44:0/388415500 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e6c1a8160 con 0x7f1e6c06c530 2024-05-03T22:44:25.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.961+0000 7f1e6be00700 1 --2- 172.21.15.44:0/388415500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e6c06bb70 0x7f1e6c102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:44:25.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.962+0000 7f1e6b400700 1 --2- 172.21.15.44:0/388415500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c06c530 0x7f1e6c102d90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1e5800d980 tx=0x7f1e5800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:25.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.962+0000 7f1e68c00700 1 -- 172.21.15.44:0/388415500 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e58017070 con 0x7f1e6c06c530 2024-05-03T22:44:25.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.962+0000 7f1e68c00700 1 -- 172.21.15.44:0/388415500 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f1e58004d00 con 0x7f1e6c06c530 2024-05-03T22:44:25.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.962+0000 7f1e68c00700 1 -- 172.21.15.44:0/388415500 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e58005540 con 0x7f1e6c06c530 2024-05-03T22:44:25.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.962+0000 7f1e73000700 1 -- 172.21.15.44:0/388415500 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e6c1a8450 con 0x7f1e6c06c530 2024-05-03T22:44:25.965 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.962+0000 7f1e73000700 1 -- 172.21.15.44:0/388415500 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e6c1a8940 con 0x7f1e6c06c530 2024-05-03T22:44:25.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.967+0000 7f1e68c00700 1 -- 172.21.15.44:0/388415500 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f1e58004750 con 0x7f1e6c06c530 2024-05-03T22:44:25.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.967+0000 7f1e7d939b80 1 Processor -- start 2024-05-03T22:44:25.968 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.967+0000 7f1e7d939b80 1 -- start start 2024-05-03T22:44:25.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.967+0000 7f1e7d939b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbd760 0x55ff43fbdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:25.969 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.967+0000 7f1e7d939b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbe080 0x55ff43fb8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:25.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.968+0000 7f1e7d939b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 0x55ff43fb99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:25.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.968+0000 7f1e7d939b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ff43f0b9d0 con 0x55ff43fbe080 2024-05-03T22:44:25.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.968+0000 7f1e7d939b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ff43ea9710 con 0x55ff43fbd760 2024-05-03T22:44:25.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.968+0000 7f1e7d939b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55ff43f07990 con 0x55ff43fb9580 2024-05-03T22:44:25.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.968+0000 7f1e6be00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbe080 0x55ff43fb8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:25.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.968+0000 7f1e6be00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbe080 0x55ff43fb8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55938/0 (socket says 172.21.15.44:55938) 2024-05-03T22:44:25.970 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.968+0000 7f1e6be00700 1 -- 172.21.15.44:0/653315944 learned_addr learned my addr 172.21.15.44:0/653315944 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:25.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.968+0000 7f1e71000700 1 --2- 172.21.15.44:0/653315944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbd760 0x55ff43fbdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:25.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.968+0000 7f1e6b400700 1 --2- 172.21.15.44:0/653315944 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 0x55ff43fb99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:25.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.969+0000 7f1e6be00700 1 -- 172.21.15.44:0/653315944 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 msgr2=0x55ff43fb99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:25.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.969+0000 7f1e6be00700 1 --2- 172.21.15.44:0/653315944 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 0x55ff43fb99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:25.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.969+0000 7f1e6be00700 1 -- 172.21.15.44:0/653315944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbd760 msgr2=0x55ff43fbdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:25.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.969+0000 7f1e6be00700 1 --2- 172.21.15.44:0/653315944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbd760 0x55ff43fbdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:25.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.969+0000 7f1e6be00700 1 -- 172.21.15.44:0/653315944 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff43e58880 con 0x55ff43fbe080 2024-05-03T22:44:25.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.969+0000 7f1e68c00700 1 --2- 172.21.15.44:0/388415500 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1e500b2990 0x7f1e500b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:25.976 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.969+0000 7f1e6be00700 1 --2- 172.21.15.44:0/653315944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbe080 0x55ff43fb8f60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c005c90 tx=0x7f1e5c009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d60a1833096c35d server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:25.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.969+0000 7f1e68c00700 1 -- 172.21.15.44:0/388415500 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f1e580e2780 con 0x7f1e6c06c530 2024-05-03T22:44:25.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.969+0000 7f1e71000700 1 --2- 172.21.15.44:0/388415500 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1e500b2990 0x7f1e500b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:25.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.969+0000 7f1e61600700 1 -- 172.21.15.44:0/653315944 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c027070 con 0x55ff43fbe080 2024-05-03T22:44:25.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.969+0000 7f1e61600700 1 -- 172.21.15.44:0/653315944 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f1e5c0050d0 con 0x55ff43fbe080 2024-05-03T22:44:25.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.969+0000 7f1e61600700 1 -- 172.21.15.44:0/653315944 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c00bcd0 con 0x55ff43fbe080 2024-05-03T22:44:25.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.970+0000 7f1e7d939b80 1 -- 172.21.15.44:0/653315944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbe080 msgr2=0x55ff43fb8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:25.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.970+0000 7f1e71000700 1 --2- 172.21.15.44:0/388415500 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1e500b2990 0x7f1e500b4e50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009cb0 tx=0x7f1e64009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:25.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.970+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/653315944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbe080 0x55ff43fb8f60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c005c90 tx=0x7f1e5c009ee0 comp rx=0 tx=0).stop 2024-05-03T22:44:25.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.970+0000 7f1e7d939b80 1 -- 172.21.15.44:0/653315944 shutdown_connections 2024-05-03T22:44:25.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.970+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/653315944 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 0x55ff43fb99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:25.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.970+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/653315944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbd760 0x55ff43fbdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:25.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.970+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/653315944 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbe080 0x55ff43fb8f60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:25.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.970+0000 7f1e7d939b80 1 -- 172.21.15.44:0/653315944 >> 172.21.15.44:0/653315944 conn(0x55ff43ee7b10 msgr2=0x55ff43fb37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:25.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.971+0000 7f1e7d939b80 1 -- 172.21.15.44:0/653315944 shutdown_connections 2024-05-03T22:44:25.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.971+0000 7f1e7d939b80 1 -- 172.21.15.44:0/653315944 wait complete. 2024-05-03T22:44:25.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.971+0000 7f1e7d939b80 1 -- start start 2024-05-03T22:44:25.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.971+0000 7f1e7d939b80 1 Processor -- start 2024-05-03T22:44:25.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.972+0000 7f1e7d939b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 0x55ff43fc4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:25.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.972+0000 7f1e7d939b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbd760 0x55ff43fc21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:25.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.972+0000 7f1e7d939b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbe080 0x55ff43fc2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:25.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.972+0000 7f1e7d939b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ff43fc5bf0 con 0x55ff43fbd760 2024-05-03T22:44:25.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.972+0000 7f1e7d939b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ff43e71ad0 con 0x55ff43fbe080 2024-05-03T22:44:25.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.972+0000 7f1e7d939b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55ff43fc5d70 con 0x55ff43fb9580 2024-05-03T22:44:25.978 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.972+0000 7f1e7d939b80 10 client.0 _ll_register_callbacks cb 0x55ff43eb2c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:44:25.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.972+0000 7f1e6b400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbd760 0x55ff43fc21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:25.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.972+0000 7f1e6b400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbd760 0x55ff43fc21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55950/0 (socket says 172.21.15.44:55950) 2024-05-03T22:44:25.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.972+0000 7f1e6b400700 1 -- 172.21.15.44:0/1681045421 learned_addr learned my addr 172.21.15.44:0/1681045421 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:25.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.972+0000 7f1e6be00700 1 --2- 172.21.15.44:0/1681045421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 0x55ff43fc4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:25.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.973+0000 7f1e71000700 1 --2- 172.21.15.44:0/1681045421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbe080 0x55ff43fc2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:25.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.973+0000 7f1e6b400700 1 -- 172.21.15.44:0/1681045421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 msgr2=0x55ff43fc4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:25.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.973+0000 7f1e6b400700 1 --2- 172.21.15.44:0/1681045421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 0x55ff43fc4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:25.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.973+0000 7f1e6b400700 1 -- 172.21.15.44:0/1681045421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbe080 msgr2=0x55ff43fc2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:25.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.973+0000 7f1e6b400700 1 --2- 172.21.15.44:0/1681045421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbe080 0x55ff43fc2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:25.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.973+0000 7f1e6b400700 1 -- 172.21.15.44:0/1681045421 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff43ed13d0 con 0x55ff43fbd760 2024-05-03T22:44:25.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.973+0000 7f1e71000700 1 --2- 172.21.15.44:0/1681045421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbe080 0x55ff43fc2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:44:25.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.973+0000 7f1e6b400700 1 --2- 172.21.15.44:0/1681045421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbd760 0x55ff43fc21e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1e580a5850 tx=0x7f1e580a9120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa57b11a1d295d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:25.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.973+0000 7f1e56000700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:44:25.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.973+0000 7f1e56000700 1 -- 172.21.15.44:0/1681045421 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e58009c60 con 0x55ff43fbd760 2024-05-03T22:44:25.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.973+0000 7f1e56000700 1 -- 172.21.15.44:0/1681045421 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f1e580056e0 con 0x55ff43fbd760 2024-05-03T22:44:25.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.974+0000 7f1e7d939b80 1 -- 172.21.15.44:0/1681045421 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e5c0050d0 con 0x55ff43fbd760 2024-05-03T22:44:25.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.974+0000 7f1e56000700 1 -- 172.21.15.44:0/1681045421 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1e580a92e0 con 0x55ff43fbd760 2024-05-03T22:44:25.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.974+0000 7f1e7d939b80 10 client.15117 fetch_fsmap learned FSMap version 30 2024-05-03T22:44:25.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.974+0000 7f1e7d939b80 1 -- 172.21.15.44:0/1681045421 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ff43fd0440 con 0x55ff43fbd760 2024-05-03T22:44:25.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.974+0000 7f1e56000700 1 -- 172.21.15.44:0/1681045421 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f1e5c0050d0 con 0x55ff43fbd760 2024-05-03T22:44:25.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.974+0000 7f1e56000700 1 -- 172.21.15.44:0/1681045421 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f1e580a9a30 con 0x55ff43fbd760 2024-05-03T22:44:25.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.974+0000 7f1e7d939b80 10 client.15117 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:44:25.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.974+0000 7f1e7d939b80 10 client.15117 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-03T22:44:25.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.975+0000 7f1e7d939b80 20 client.15117 populate_metadata read hostname 'smithi044' 2024-05-03T22:44:25.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.975+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/1681045421 >> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] conn(0x55ff43fd2a40 0x55ff43fd3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:25.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.975+0000 7f1e7d939b80 4 client.15117 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:44:25.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.975+0000 7f1e7d939b80 1 -- 172.21.15.44:0/1681045421 --> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff43f86180 con 0x55ff43fd2a40 2024-05-03T22:44:25.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.975+0000 7f1e6be00700 1 --2- 172.21.15.44:0/1681045421 >> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] conn(0x55ff43fd2a40 0x55ff43fd3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:25.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.976+0000 7f1e6be00700 1 --2- 172.21.15.44:0/1681045421 >> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] conn(0x55ff43fd2a40 0x55ff43fd3eb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=88f5552c21827abf server_cookie=b94165f58416e4ae in_seq=0 out_seq=0 2024-05-03T22:44:25.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.976+0000 7f1e56000700 10 client.15117 ms_handle_connect on v2:172.21.15.60:6836/3568217572 2024-05-03T22:44:25.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.979+0000 7f1e56000700 1 -- 172.21.15.44:0/1681045421 <== mds.1 v2:172.21.15.60:6836/3568217572 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ff43f86180 con 0x55ff43fd2a40 2024-05-03T22:44:25.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.979+0000 7f1e56000700 10 client.15117 handle_command_reply: tid=0 2024-05-03T22:44:25.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.979+0000 7f1e7d939b80 1 client.15117 shutdown 2024-05-03T22:44:25.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.979+0000 7f1e7d939b80 1 -- 172.21.15.44:0/1681045421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbd760 msgr2=0x55ff43fc21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:25.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.979+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/1681045421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbd760 0x55ff43fc21e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1e580a5850 tx=0x7f1e580a9120 comp rx=0 tx=0).stop 2024-05-03T22:44:25.982 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.979+0000 7f1e7d939b80 1 -- 172.21.15.44:0/1681045421 shutdown_connections 2024-05-03T22:44:25.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.979+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/1681045421 >> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] conn(0x55ff43fd2a40 0x55ff43fd3eb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:25.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.979+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/1681045421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbe080 0x55ff43fc2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:25.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.979+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/1681045421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 0x55ff43fc4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:25.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.979+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/1681045421 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbd760 0x55ff43fc21e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:25.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.979+0000 7f1e7d939b80 1 -- 172.21.15.44:0/1681045421 >> 172.21.15.44:0/1681045421 conn(0x55ff43ee7b10 msgr2=0x55ff43fbedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:25.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.979+0000 7f1e56000700 0 client.15117 ms_handle_reset on v2:172.21.15.60:6836/3568217572 2024-05-03T22:44:25.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.979+0000 7f1e7d939b80 1 -- 172.21.15.44:0/1681045421 shutdown_connections 2024-05-03T22:44:25.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.979+0000 7f1e7d939b80 1 -- 172.21.15.44:0/1681045421 wait complete. 2024-05-03T22:44:25.983 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:25.980+0000 7f1e7d939b80 20 client.15117 trim_cache size 0 max 16384 2024-05-03T22:44:26.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.003+0000 7f1e7d939b80 1 Processor -- start 2024-05-03T22:44:26.004 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.003+0000 7f1e7d939b80 1 -- start start 2024-05-03T22:44:26.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.003+0000 7f1e7d939b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 0x55ff43fc2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:26.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.003+0000 7f1e7d939b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbd760 0x55ff43fb9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:26.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.003+0000 7f1e7d939b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbe080 0x55ff43fb3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:26.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.003+0000 7f1e7d939b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ff43fd21f0 con 0x55ff43fbe080 2024-05-03T22:44:26.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.003+0000 7f1e7d939b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ff43fd28c0 con 0x55ff43fbd760 2024-05-03T22:44:26.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.003+0000 7f1e7d939b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55ff43fd2f90 con 0x55ff43fb9580 2024-05-03T22:44:26.005 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.004+0000 7f1e71000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbe080 0x55ff43fb3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:26.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.004+0000 7f1e71000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbe080 0x55ff43fb3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55962/0 (socket says 172.21.15.44:55962) 2024-05-03T22:44:26.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.004+0000 7f1e71000700 1 -- 172.21.15.44:0/962028946 learned_addr learned my addr 172.21.15.44:0/962028946 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:26.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.004+0000 7f1e6be00700 1 --2- 172.21.15.44:0/962028946 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 0x55ff43fc2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:26.006 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.004+0000 7f1e6b400700 1 --2- 172.21.15.44:0/962028946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbd760 0x55ff43fb9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:26.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.004+0000 7f1e71000700 1 -- 172.21.15.44:0/962028946 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 msgr2=0x55ff43fc2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:26.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.004+0000 7f1e71000700 1 --2- 172.21.15.44:0/962028946 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 0x55ff43fc2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:26.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.004+0000 7f1e71000700 1 -- 172.21.15.44:0/962028946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbd760 msgr2=0x55ff43fb9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:26.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.004+0000 7f1e71000700 1 --2- 172.21.15.44:0/962028946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbd760 0x55ff43fb9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:26.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.004+0000 7f1e71000700 1 -- 172.21.15.44:0/962028946 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff43fb44c0 con 0x55ff43fbe080 2024-05-03T22:44:26.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.004+0000 7f1e6b400700 1 --2- 172.21.15.44:0/962028946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbd760 0x55ff43fb9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:44:26.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.005+0000 7f1e71000700 1 --2- 172.21.15.44:0/962028946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbe080 0x55ff43fb3610 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1e640165d0 tx=0x7f1e64014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48711da252ddc7bb server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:26.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.005+0000 7f1e60c00700 1 -- 172.21.15.44:0/962028946 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6401d030 con 0x55ff43fbe080 2024-05-03T22:44:26.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.005+0000 7f1e60c00700 1 -- 172.21.15.44:0/962028946 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f1e6401e040 con 0x55ff43fbe080 2024-05-03T22:44:26.007 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.005+0000 7f1e60c00700 1 -- 172.21.15.44:0/962028946 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e64005790 con 0x55ff43fbe080 2024-05-03T22:44:26.009 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.006+0000 7f1e7d939b80 1 -- 172.21.15.44:0/962028946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbe080 msgr2=0x55ff43fb3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:26.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.006+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/962028946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbe080 0x55ff43fb3610 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1e640165d0 tx=0x7f1e64014000 comp rx=0 tx=0).stop 2024-05-03T22:44:26.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.006+0000 7f1e7d939b80 1 -- 172.21.15.44:0/962028946 shutdown_connections 2024-05-03T22:44:26.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.006+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/962028946 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbe080 0x55ff43fb3610 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:26.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.006+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/962028946 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 0x55ff43fc2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:26.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.006+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/962028946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbd760 0x55ff43fb9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:26.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.006+0000 7f1e7d939b80 1 -- 172.21.15.44:0/962028946 >> 172.21.15.44:0/962028946 conn(0x55ff43ee7b10 msgr2=0x55ff43fc0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:26.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.006+0000 7f1e7d939b80 1 -- 172.21.15.44:0/962028946 shutdown_connections 2024-05-03T22:44:26.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.006+0000 7f1e7d939b80 1 -- 172.21.15.44:0/962028946 wait complete. 2024-05-03T22:44:26.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.006+0000 7f1e7d939b80 1 -- start start 2024-05-03T22:44:26.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.007+0000 7f1e7d939b80 1 Processor -- start 2024-05-03T22:44:26.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.007+0000 7f1e7d939b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 0x55ff43fb6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:26.010 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.007+0000 7f1e7d939b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbd760 0x55ff43fb70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:26.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.007+0000 7f1e7d939b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbe080 0x55ff43fb7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:26.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.007+0000 7f1e7d939b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55ff43fd3d30 con 0x55ff43fbd760 2024-05-03T22:44:26.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.007+0000 7f1e7d939b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ff43fd3660 con 0x55ff43fbe080 2024-05-03T22:44:26.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.007+0000 7f1e7d939b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55ff43fd4400 con 0x55ff43fb9580 2024-05-03T22:44:26.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.007+0000 7f1e7d939b80 10 client.0 _ll_register_callbacks cb 0x55ff43eb2c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:44:26.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.008+0000 7f1e6b400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbd760 0x55ff43fb70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:26.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.008+0000 7f1e6b400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbd760 0x55ff43fb70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55970/0 (socket says 172.21.15.44:55970) 2024-05-03T22:44:26.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.008+0000 7f1e6b400700 1 -- 172.21.15.44:0/268013942 learned_addr learned my addr 172.21.15.44:0/268013942 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:26.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.008+0000 7f1e71000700 1 --2- 172.21.15.44:0/268013942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbe080 0x55ff43fb7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:26.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.008+0000 7f1e6be00700 1 --2- 172.21.15.44:0/268013942 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 0x55ff43fb6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:26.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.008+0000 7f1e6b400700 1 -- 172.21.15.44:0/268013942 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 msgr2=0x55ff43fb6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:26.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.008+0000 7f1e6b400700 1 --2- 172.21.15.44:0/268013942 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 0x55ff43fb6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:26.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.008+0000 7f1e6b400700 1 -- 172.21.15.44:0/268013942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbe080 msgr2=0x55ff43fb7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:26.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.008+0000 7f1e6b400700 1 --2- 172.21.15.44:0/268013942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbe080 0x55ff43fb7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:26.011 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.008+0000 7f1e6b400700 1 -- 172.21.15.44:0/268013942 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff43fdb910 con 0x55ff43fbd760 2024-05-03T22:44:26.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.008+0000 7f1e6b400700 1 --2- 172.21.15.44:0/268013942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbd760 0x55ff43fb70e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1e580a6a40 tx=0x7f1e580913d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7b16df364b7aa6 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:26.012 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.008+0000 7f1e56000700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:44:26.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.009+0000 7f1e56000700 1 -- 172.21.15.44:0/268013942 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e580c2020 con 0x55ff43fbd760 2024-05-03T22:44:26.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.009+0000 7f1e56000700 1 -- 172.21.15.44:0/268013942 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f1e580a5dc0 con 0x55ff43fbd760 2024-05-03T22:44:26.013 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.009+0000 7f1e7d939b80 1 -- 172.21.15.44:0/268013942 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e6401e040 con 0x55ff43fbd760 2024-05-03T22:44:26.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.009+0000 7f1e56000700 1 -- 172.21.15.44:0/268013942 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f1e58009c60 con 0x55ff43fbd760 2024-05-03T22:44:26.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.009+0000 7f1e7d939b80 10 client.15123 fetch_fsmap learned FSMap version 30 2024-05-03T22:44:26.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.009+0000 7f1e7d939b80 1 -- 172.21.15.44:0/268013942 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ff4403e2f0 con 0x55ff43fbd760 2024-05-03T22:44:26.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.009+0000 7f1e56000700 1 -- 172.21.15.44:0/268013942 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f1e6401e040 con 0x55ff43fbd760 2024-05-03T22:44:26.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.009+0000 7f1e56000700 1 -- 172.21.15.44:0/268013942 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f1e580aab00 con 0x55ff43fbd760 2024-05-03T22:44:26.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.010+0000 7f1e7d939b80 10 client.15123 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:44:26.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.010+0000 7f1e7d939b80 10 client.15123 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-03T22:44:26.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.010+0000 7f1e7d939b80 20 client.15123 populate_metadata read hostname 'smithi044' 2024-05-03T22:44:26.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.010+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/268013942 >> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] conn(0x55ff44042ea0 0x55ff44041bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:26.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.010+0000 7f1e7d939b80 4 client.15123 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:44:26.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.010+0000 7f1e7d939b80 1 -- 172.21.15.44:0/268013942 --> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] -- command(tid 0: {"prefix": "status"}) -- 0x55ff43f193b0 con 0x55ff44042ea0 2024-05-03T22:44:26.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.010+0000 7f1e6be00700 1 --2- 172.21.15.44:0/268013942 >> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] conn(0x55ff44042ea0 0x55ff44041bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:26.014 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.011+0000 7f1e6be00700 1 --2- 172.21.15.44:0/268013942 >> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] conn(0x55ff44042ea0 0x55ff44041bb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b94f0050fe0255af server_cookie=fa48749beca15bf5 in_seq=0 out_seq=0 2024-05-03T22:44:26.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.011+0000 7f1e56000700 10 client.15123 ms_handle_connect on v2:172.21.15.60:6836/3568217572 2024-05-03T22:44:26.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.012+0000 7f1e56000700 1 -- 172.21.15.44:0/268013942 <== mds.1 v2:172.21.15.60:6836/3568217572 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ff43f193b0 con 0x55ff44042ea0 2024-05-03T22:44:26.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.012+0000 7f1e56000700 10 client.15123 handle_command_reply: tid=0 2024-05-03T22:44:26.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.012+0000 7f1e7d939b80 1 client.15123 shutdown 2024-05-03T22:44:26.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.012+0000 7f1e7d939b80 1 -- 172.21.15.44:0/268013942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbd760 msgr2=0x55ff43fb70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:26.015 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.012+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/268013942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbd760 0x55ff43fb70e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1e580a6a40 tx=0x7f1e580913d0 comp rx=0 tx=0).stop 2024-05-03T22:44:26.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.012+0000 7f1e7d939b80 1 -- 172.21.15.44:0/268013942 shutdown_connections 2024-05-03T22:44:26.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.012+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/268013942 >> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] conn(0x55ff44042ea0 0x55ff44041bb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:26.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.012+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/268013942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ff43fbe080 0x55ff43fb7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:26.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.012+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/268013942 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff43fb9580 0x55ff43fb6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:26.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.012+0000 7f1e7d939b80 1 --2- 172.21.15.44:0/268013942 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55ff43fbd760 0x55ff43fb70e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:26.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.012+0000 7f1e7d939b80 1 -- 172.21.15.44:0/268013942 >> 172.21.15.44:0/268013942 conn(0x55ff43ee7b10 msgr2=0x55ff43fbc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:26.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.012+0000 7f1e56000700 0 client.15123 ms_handle_reset on v2:172.21.15.60:6836/3568217572 2024-05-03T22:44:26.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.013+0000 7f1e7d939b80 1 -- 172.21.15.44:0/268013942 shutdown_connections 2024-05-03T22:44:26.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.013+0000 7f1e7d939b80 1 -- 172.21.15.44:0/268013942 wait complete. 2024-05-03T22:44:26.016 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.013+0000 7f1e7d939b80 20 client.15123 trim_cache size 0 max 16384 2024-05-03T22:44:26.017 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-03T22:44:26.017 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "5b0efdca-099c-11ef-bc97-c7b262605968", 2024-05-03T22:44:26.017 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 1, 2024-05-03T22:44:26.017 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 34427, 2024-05-03T22:44:26.017 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-05-03T22:44:26.017 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-05-03T22:44:26.017 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-05-03T22:44:26.017 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 167.85996694599999, 2024-05-03T22:44:26.017 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 30, 2024-05-03T22:44:26.017 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 89, 2024-05-03T22:44:26.017 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 87, 2024-05-03T22:44:26.018 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 293.748756324 2024-05-03T22:44:26.018 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-03T22:44:26.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.013+0000 7f1e73000700 1 -- 172.21.15.44:0/388415500 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1e500b2990 msgr2=0x7f1e500b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:26.018 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.013+0000 7f1e73000700 1 --2- 172.21.15.44:0/388415500 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1e500b2990 0x7f1e500b4e50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009cb0 tx=0x7f1e64009040 comp rx=0 tx=0).stop 2024-05-03T22:44:26.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.013+0000 7f1e73000700 1 -- 172.21.15.44:0/388415500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c06c530 msgr2=0x7f1e6c102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:26.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.013+0000 7f1e73000700 1 --2- 172.21.15.44:0/388415500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c06c530 0x7f1e6c102d90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1e5800d980 tx=0x7f1e5800dd40 comp rx=0 tx=0).stop 2024-05-03T22:44:26.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.014+0000 7f1e73000700 1 -- 172.21.15.44:0/388415500 shutdown_connections 2024-05-03T22:44:26.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.014+0000 7f1e73000700 1 --2- 172.21.15.44:0/388415500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e6c109530 0x7f1e6c1032d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:26.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.014+0000 7f1e73000700 1 --2- 172.21.15.44:0/388415500 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f1e500b2990 0x7f1e500b4e50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:26.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.014+0000 7f1e73000700 1 --2- 172.21.15.44:0/388415500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e6c06bb70 0x7f1e6c102850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:26.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.014+0000 7f1e73000700 1 --2- 172.21.15.44:0/388415500 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f1e6c06c530 0x7f1e6c102d90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:26.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.014+0000 7f1e73000700 1 -- 172.21.15.44:0/388415500 >> 172.21.15.44:0/388415500 conn(0x7f1e6c079350 msgr2=0x7f1e6c1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:26.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.014+0000 7f1e73000700 1 -- 172.21.15.44:0/388415500 shutdown_connections 2024-05-03T22:44:26.019 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:26.014+0000 7f1e73000700 1 -- 172.21.15.44:0/388415500 wait complete. 2024-05-03T22:44:26.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:26 smithi044 ceph-mon[28604]: pgmap v507: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:44:26.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:26 smithi060 ceph-mon[31721]: pgmap v507: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:44:26.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:26 smithi160 ceph-mon[32531]: pgmap v507: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:44:27.001 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-03T22:44:27.470 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:44:28.664 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:28 smithi044 ceph-mon[28604]: pgmap v508: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:28.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:28 smithi060 ceph-mon[31721]: pgmap v508: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:28.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:28 smithi160 ceph-mon[32531]: pgmap v508: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:29.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.819+0000 7f3f83600700 1 -- 172.21.15.44:0/543156297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c103750 msgr2=0x7f3f7c103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:29.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.819+0000 7f3f83600700 1 --2- 172.21.15.44:0/543156297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c103750 0x7f3f7c103b30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0099c0 tx=0x7f3f6c009cd0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.820+0000 7f3f83600700 1 -- 172.21.15.44:0/543156297 shutdown_connections 2024-05-03T22:44:29.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.820+0000 7f3f83600700 1 --2- 172.21.15.44:0/543156297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f7c108850 0x7f3f7c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.820+0000 7f3f83600700 1 --2- 172.21.15.44:0/543156297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c103750 0x7f3f7c103b30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.820+0000 7f3f83600700 1 --2- 172.21.15.44:0/543156297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f7c104100 0x7f3f7c108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.820+0000 7f3f83600700 1 -- 172.21.15.44:0/543156297 >> 172.21.15.44:0/543156297 conn(0x7f3f7c07a600 msgr2=0x7f3f7c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:29.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.820+0000 7f3f83600700 1 -- 172.21.15.44:0/543156297 shutdown_connections 2024-05-03T22:44:29.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.820+0000 7f3f83600700 1 -- 172.21.15.44:0/543156297 wait complete. 2024-05-03T22:44:29.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.821+0000 7f3f83600700 1 Processor -- start 2024-05-03T22:44:29.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.821+0000 7f3f83600700 1 -- start start 2024-05-03T22:44:29.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.821+0000 7f3f83600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f7c103750 0x7f3f7c19f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:29.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.822+0000 7f3f83600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f7c104100 0x7f3f7c19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:29.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.822+0000 7f3f83600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c108850 0x7f3f7c1999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:29.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.822+0000 7f3f83600700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c113760 con 0x7f3f7c108850 2024-05-03T22:44:29.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.822+0000 7f3f83600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c1135e0 con 0x7f3f7c104100 2024-05-03T22:44:29.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.822+0000 7f3f83600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7c1138e0 con 0x7f3f7c103750 2024-05-03T22:44:29.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.822+0000 7f3f81600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c108850 0x7f3f7c1999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:29.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.822+0000 7f3f81600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c108850 0x7f3f7c1999c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:55992/0 (socket says 172.21.15.44:55992) 2024-05-03T22:44:29.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.822+0000 7f3f81600700 1 -- 172.21.15.44:0/2664797297 learned_addr learned my addr 172.21.15.44:0/2664797297 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:29.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.822+0000 7f3f80c00700 1 --2- 172.21.15.44:0/2664797297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f7c103750 0x7f3f7c19f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:29.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.822+0000 7f3f73e00700 1 --2- 172.21.15.44:0/2664797297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f7c104100 0x7f3f7c19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:29.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.823+0000 7f3f81600700 1 -- 172.21.15.44:0/2664797297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f7c103750 msgr2=0x7f3f7c19f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:29.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.823+0000 7f3f81600700 1 --2- 172.21.15.44:0/2664797297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f7c103750 0x7f3f7c19f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.823+0000 7f3f81600700 1 -- 172.21.15.44:0/2664797297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f7c104100 msgr2=0x7f3f7c19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:29.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.823+0000 7f3f81600700 1 --2- 172.21.15.44:0/2664797297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f7c104100 0x7f3f7c19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.823+0000 7f3f81600700 1 -- 172.21.15.44:0/2664797297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7c19a120 con 0x7f3f7c108850 2024-05-03T22:44:29.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.823+0000 7f3f73e00700 1 --2- 172.21.15.44:0/2664797297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f7c104100 0x7f3f7c19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:44:29.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.823+0000 7f3f80c00700 1 --2- 172.21.15.44:0/2664797297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f7c103750 0x7f3f7c19f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:44:29.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.823+0000 7f3f81600700 1 --2- 172.21.15.44:0/2664797297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c108850 0x7f3f7c1999c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3f74007d70 tx=0x7f3f7400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:29.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.823+0000 7f3f7a000700 1 -- 172.21.15.44:0/2664797297 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7401e070 con 0x7f3f7c108850 2024-05-03T22:44:29.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.823+0000 7f3f83600700 1 -- 172.21.15.44:0/2664797297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f7c19a410 con 0x7f3f7c108850 2024-05-03T22:44:29.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.823+0000 7f3f7a000700 1 -- 172.21.15.44:0/2664797297 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f3f7400ad40 con 0x7f3f7c108850 2024-05-03T22:44:29.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.823+0000 7f3f7a000700 1 -- 172.21.15.44:0/2664797297 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f740198a0 con 0x7f3f7c108850 2024-05-03T22:44:29.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.824+0000 7f3f83600700 1 -- 172.21.15.44:0/2664797297 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f7c0756d0 con 0x7f3f7c108850 2024-05-03T22:44:29.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.827+0000 7f3f7a000700 1 -- 172.21.15.44:0/2664797297 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3f74021070 con 0x7f3f7c108850 2024-05-03T22:44:29.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.829+0000 7f3f8df2ab80 1 Processor -- start 2024-05-03T22:44:29.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.829+0000 7f3f7a000700 1 --2- 172.21.15.44:0/2664797297 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f3f600b2990 0x7f3f600b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:29.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.829+0000 7f3f8df2ab80 1 -- start start 2024-05-03T22:44:29.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.829+0000 7f3f7a000700 1 -- 172.21.15.44:0/2664797297 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f3f740e60f0 con 0x7f3f7c108850 2024-05-03T22:44:29.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.829+0000 7f3f73e00700 1 --2- 172.21.15.44:0/2664797297 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f3f600b2990 0x7f3f600b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:29.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.830+0000 7f3f8df2ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb68e0 0x555fd4cb6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:29.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.830+0000 7f3f8df2ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb7200 0x555fd4cb0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:29.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.830+0000 7f3f8df2ab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb1500 0x555fd4cb1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:29.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.830+0000 7f3f8df2ab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555fd4c039d0 con 0x555fd4cb1500 2024-05-03T22:44:29.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.830+0000 7f3f8df2ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555fd4ba1710 con 0x555fd4cb68e0 2024-05-03T22:44:29.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.830+0000 7f3f8df2ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555fd4bff990 con 0x555fd4cb7200 2024-05-03T22:44:29.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.830+0000 7f3f81600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb1500 0x555fd4cb1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:29.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.830+0000 7f3f81600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb1500 0x555fd4cb1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45238/0 (socket says 172.21.15.44:45238) 2024-05-03T22:44:29.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.830+0000 7f3f81600700 1 -- 172.21.15.44:0/2410564736 learned_addr learned my addr 172.21.15.44:0/2410564736 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:29.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.830+0000 7f3f73e00700 1 --2- 172.21.15.44:0/2664797297 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f3f600b2990 0x7f3f600b4e50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3f64005950 tx=0x7f3f640058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:29.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.830+0000 7f3f80c00700 1 --2- 172.21.15.44:0/2410564736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb68e0 0x555fd4cb6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:29.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.830+0000 7f3f73e00700 1 --2- 172.21.15.44:0/2410564736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb7200 0x555fd4cb0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:29.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.831+0000 7f3f81600700 1 -- 172.21.15.44:0/2410564736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb7200 msgr2=0x555fd4cb0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:29.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.831+0000 7f3f81600700 1 --2- 172.21.15.44:0/2410564736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb7200 0x555fd4cb0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.831+0000 7f3f81600700 1 -- 172.21.15.44:0/2410564736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb68e0 msgr2=0x555fd4cb6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:29.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.831+0000 7f3f81600700 1 --2- 172.21.15.44:0/2410564736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb68e0 0x555fd4cb6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.831+0000 7f3f81600700 1 -- 172.21.15.44:0/2410564736 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fd4b50880 con 0x555fd4cb1500 2024-05-03T22:44:29.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.831+0000 7f3f81600700 1 --2- 172.21.15.44:0/2410564736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb1500 0x555fd4cb1980 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3f740a92d0 tx=0x7f3f740ac9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46e4b3bb8648bad server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:29.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.831+0000 7f3f72000700 1 -- 172.21.15.44:0/2410564736 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f740ad950 con 0x555fd4cb1500 2024-05-03T22:44:29.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.831+0000 7f3f72000700 1 -- 172.21.15.44:0/2410564736 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f3f740ad250 con 0x555fd4cb1500 2024-05-03T22:44:29.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.831+0000 7f3f72000700 1 -- 172.21.15.44:0/2410564736 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f740b1120 con 0x555fd4cb1500 2024-05-03T22:44:29.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.832+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2410564736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb1500 msgr2=0x555fd4cb1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:29.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.832+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/2410564736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb1500 0x555fd4cb1980 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3f740a92d0 tx=0x7f3f740ac9c0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.832+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2410564736 shutdown_connections 2024-05-03T22:44:29.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.832+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/2410564736 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb1500 0x555fd4cb1980 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.832+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/2410564736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb68e0 0x555fd4cb6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.832+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/2410564736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb7200 0x555fd4cb0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.832+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2410564736 >> 172.21.15.44:0/2410564736 conn(0x555fd4c29680 msgr2=0x555fd4cab8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:29.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.832+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2410564736 shutdown_connections 2024-05-03T22:44:29.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.832+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2410564736 wait complete. 2024-05-03T22:44:29.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.833+0000 7f3f8df2ab80 1 -- start start 2024-05-03T22:44:29.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.833+0000 7f3f8df2ab80 1 Processor -- start 2024-05-03T22:44:29.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.834+0000 7f3f8df2ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb1500 0x555fd4cbcea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:29.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.834+0000 7f3f8df2ab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb68e0 0x555fd4cba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:29.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.834+0000 7f3f8df2ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb7200 0x555fd4cba780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:29.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.834+0000 7f3f8df2ab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555fd4cbdcb0 con 0x555fd4cb68e0 2024-05-03T22:44:29.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.834+0000 7f3f8df2ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555fd4b69ad0 con 0x555fd4cb7200 2024-05-03T22:44:29.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.834+0000 7f3f8df2ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555fd4cbde30 con 0x555fd4cb1500 2024-05-03T22:44:29.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.834+0000 7f3f8df2ab80 10 client.0 _ll_register_callbacks cb 0x555fd4baac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:44:29.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.834+0000 7f3f73e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb68e0 0x555fd4cba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:29.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.834+0000 7f3f73e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb68e0 0x555fd4cba240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45240/0 (socket says 172.21.15.44:45240) 2024-05-03T22:44:29.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.834+0000 7f3f73e00700 1 -- 172.21.15.44:0/2040112356 learned_addr learned my addr 172.21.15.44:0/2040112356 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:29.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.835+0000 7f3f81600700 1 --2- 172.21.15.44:0/2040112356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb7200 0x555fd4cba780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:29.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.835+0000 7f3f80c00700 1 --2- 172.21.15.44:0/2040112356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb1500 0x555fd4cbcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:29.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.835+0000 7f3f73e00700 1 -- 172.21.15.44:0/2040112356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb1500 msgr2=0x555fd4cbcea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:29.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.835+0000 7f3f73e00700 1 --2- 172.21.15.44:0/2040112356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb1500 0x555fd4cbcea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.835+0000 7f3f73e00700 1 -- 172.21.15.44:0/2040112356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb7200 msgr2=0x555fd4cba780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:29.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.835+0000 7f3f73e00700 1 --2- 172.21.15.44:0/2040112356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb7200 0x555fd4cba780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.835+0000 7f3f73e00700 1 -- 172.21.15.44:0/2040112356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fd4bc93d0 con 0x555fd4cb68e0 2024-05-03T22:44:29.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.835+0000 7f3f81600700 1 --2- 172.21.15.44:0/2040112356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb7200 0x555fd4cba780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:44:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.835+0000 7f3f73e00700 1 --2- 172.21.15.44:0/2040112356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb68e0 0x555fd4cba240 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400ffd0 tx=0x7f3f64004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d810b75c02ac82b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.836+0000 7f3f6aa00700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:44:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.836+0000 7f3f6aa00700 1 -- 172.21.15.44:0/2040112356 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f64028670 con 0x555fd4cb68e0 2024-05-03T22:44:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.836+0000 7f3f6aa00700 1 -- 172.21.15.44:0/2040112356 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f3f64028810 con 0x555fd4cb68e0 2024-05-03T22:44:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.836+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2040112356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f740ad250 con 0x555fd4cb68e0 2024-05-03T22:44:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.836+0000 7f3f6aa00700 1 -- 172.21.15.44:0/2040112356 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3f64031050 con 0x555fd4cb68e0 2024-05-03T22:44:29.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.836+0000 7f3f8df2ab80 10 client.15135 fetch_fsmap learned FSMap version 30 2024-05-03T22:44:29.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.836+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2040112356 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555fd4cc84d0 con 0x555fd4cb68e0 2024-05-03T22:44:29.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.837+0000 7f3f6aa00700 1 -- 172.21.15.44:0/2040112356 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f3f740ad250 con 0x555fd4cb68e0 2024-05-03T22:44:29.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.837+0000 7f3f6aa00700 1 -- 172.21.15.44:0/2040112356 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3f6401e550 con 0x555fd4cb68e0 2024-05-03T22:44:29.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.837+0000 7f3f8df2ab80 10 client.15135 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:44:29.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.837+0000 7f3f8df2ab80 10 client.15135 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-03T22:44:29.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.837+0000 7f3f8df2ab80 20 client.15135 populate_metadata read hostname 'smithi044' 2024-05-03T22:44:29.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.837+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/2040112356 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x555fd4ccab00 0x555fd4ccbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:29.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.837+0000 7f3f8df2ab80 4 client.15135 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:44:29.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.837+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2040112356 --> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555fd4c7dfa0 con 0x555fd4ccab00 2024-05-03T22:44:29.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.838+0000 7f3f80c00700 1 --2- 172.21.15.44:0/2040112356 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x555fd4ccab00 0x555fd4ccbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:29.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.839+0000 7f3f80c00700 1 --2- 172.21.15.44:0/2040112356 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x555fd4ccab00 0x555fd4ccbf70 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd4e1aa0d037789f server_cookie=9fa6831f5b3d74e9 in_seq=0 out_seq=0 2024-05-03T22:44:29.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.839+0000 7f3f6aa00700 10 client.15135 ms_handle_connect on v2:172.21.15.60:6838/2420093605 2024-05-03T22:44:29.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.841+0000 7f3f6aa00700 1 -- 172.21.15.44:0/2040112356 <== mds.0 v2:172.21.15.60:6838/2420093605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555fd4c7dfa0 con 0x555fd4ccab00 2024-05-03T22:44:29.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.841+0000 7f3f6aa00700 10 client.15135 handle_command_reply: tid=0 2024-05-03T22:44:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.841+0000 7f3f8df2ab80 1 client.15135 shutdown 2024-05-03T22:44:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.842+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2040112356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb68e0 msgr2=0x555fd4cba240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.842+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/2040112356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb68e0 0x555fd4cba240 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400ffd0 tx=0x7f3f64004750 comp rx=0 tx=0).stop 2024-05-03T22:44:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.842+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2040112356 shutdown_connections 2024-05-03T22:44:29.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.842+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/2040112356 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x555fd4ccab00 0x555fd4ccbf70 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.842+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/2040112356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb7200 0x555fd4cba780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.842+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/2040112356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb1500 0x555fd4cbcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.842+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/2040112356 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb68e0 0x555fd4cba240 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.842+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2040112356 >> 172.21.15.44:0/2040112356 conn(0x555fd4c29680 msgr2=0x555fd4ca6360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:29.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.842+0000 7f3f6aa00700 0 client.15135 ms_handle_reset on v2:172.21.15.60:6838/2420093605 2024-05-03T22:44:29.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.842+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2040112356 shutdown_connections 2024-05-03T22:44:29.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.842+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2040112356 wait complete. 2024-05-03T22:44:29.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.842+0000 7f3f8df2ab80 20 client.15135 trim_cache size 0 max 16384 2024-05-03T22:44:29.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.865+0000 7f3f8df2ab80 1 Processor -- start 2024-05-03T22:44:29.867 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.866+0000 7f3f8df2ab80 1 -- start start 2024-05-03T22:44:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.866+0000 7f3f8df2ab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb1500 0x555fd4cb0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.866+0000 7f3f8df2ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb68e0 0x555fd4cb43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.866+0000 7f3f8df2ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb7200 0x555fd4cb4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.866+0000 7f3f8df2ab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555fd4cca2b0 con 0x555fd4cb1500 2024-05-03T22:44:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.866+0000 7f3f8df2ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555fd4cca980 con 0x555fd4cb68e0 2024-05-03T22:44:29.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.866+0000 7f3f8df2ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555fd4ccb050 con 0x555fd4cb7200 2024-05-03T22:44:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.866+0000 7f3f80c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb1500 0x555fd4cb0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.866+0000 7f3f80c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb1500 0x555fd4cb0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45252/0 (socket says 172.21.15.44:45252) 2024-05-03T22:44:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.866+0000 7f3f80c00700 1 -- 172.21.15.44:0/3346289949 learned_addr learned my addr 172.21.15.44:0/3346289949 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:29.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.867+0000 7f3f73e00700 1 --2- 172.21.15.44:0/3346289949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb68e0 0x555fd4cb43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:29.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.867+0000 7f3f81600700 1 --2- 172.21.15.44:0/3346289949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb7200 0x555fd4cb4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:29.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.867+0000 7f3f80c00700 1 -- 172.21.15.44:0/3346289949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb7200 msgr2=0x555fd4cb4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:29.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.867+0000 7f3f80c00700 1 --2- 172.21.15.44:0/3346289949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb7200 0x555fd4cb4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.867+0000 7f3f80c00700 1 -- 172.21.15.44:0/3346289949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb68e0 msgr2=0x555fd4cb43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:29.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.867+0000 7f3f80c00700 1 --2- 172.21.15.44:0/3346289949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb68e0 0x555fd4cb43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.867+0000 7f3f80c00700 1 -- 172.21.15.44:0/3346289949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fd4ca3e10 con 0x555fd4cb1500 2024-05-03T22:44:29.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.867+0000 7f3f73e00700 1 --2- 172.21.15.44:0/3346289949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb68e0 0x555fd4cb43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:44:29.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.867+0000 7f3f81600700 1 --2- 172.21.15.44:0/3346289949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb7200 0x555fd4cb4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:44:29.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.867+0000 7f3f80c00700 1 --2- 172.21.15.44:0/3346289949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb1500 0x555fd4cb0ee0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0098e0 tx=0x7f3f6c01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5264ba675cbdf3a server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:29.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.868+0000 7f3f71600700 1 -- 172.21.15.44:0/3346289949 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0050b0 con 0x555fd4cb1500 2024-05-03T22:44:29.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.868+0000 7f3f71600700 1 -- 172.21.15.44:0/3346289949 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f3f6c029070 con 0x555fd4cb1500 2024-05-03T22:44:29.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.868+0000 7f3f71600700 1 -- 172.21.15.44:0/3346289949 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c02a170 con 0x555fd4cb1500 2024-05-03T22:44:29.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.868+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/3346289949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb1500 msgr2=0x555fd4cb0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:29.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.868+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/3346289949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb1500 0x555fd4cb0ee0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0098e0 tx=0x7f3f6c01a040 comp rx=0 tx=0).stop 2024-05-03T22:44:29.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.869+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/3346289949 shutdown_connections 2024-05-03T22:44:29.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.869+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/3346289949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb7200 0x555fd4cb4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.869+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/3346289949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb1500 0x555fd4cb0ee0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.869+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/3346289949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb68e0 0x555fd4cb43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.869+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/3346289949 >> 172.21.15.44:0/3346289949 conn(0x555fd4c29680 msgr2=0x555fd4ca5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:29.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.869+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/3346289949 shutdown_connections 2024-05-03T22:44:29.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.869+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/3346289949 wait complete. 2024-05-03T22:44:29.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.869+0000 7f3f8df2ab80 1 -- start start 2024-05-03T22:44:29.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.870+0000 7f3f8df2ab80 1 Processor -- start 2024-05-03T22:44:29.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.870+0000 7f3f8df2ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb1500 0x555fd4cd55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:29.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.870+0000 7f3f8df2ab80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb68e0 0x555fd4cd03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:29.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.870+0000 7f3f8df2ab80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb7200 0x555fd4cd08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.870+0000 7f3f8df2ab80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555fd4ccbdf0 con 0x555fd4cb7200 2024-05-03T22:44:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.870+0000 7f3f8df2ab80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555fd4ccb720 con 0x555fd4cb68e0 2024-05-03T22:44:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.870+0000 7f3f8df2ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555fd4ccc4c0 con 0x555fd4cb1500 2024-05-03T22:44:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.870+0000 7f3f8df2ab80 10 client.0 _ll_register_callbacks cb 0x555fd4baac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:44:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.871+0000 7f3f81600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb7200 0x555fd4cd08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.871+0000 7f3f81600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb7200 0x555fd4cd08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45268/0 (socket says 172.21.15.44:45268) 2024-05-03T22:44:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.871+0000 7f3f81600700 1 -- 172.21.15.44:0/2254267315 learned_addr learned my addr 172.21.15.44:0/2254267315 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.871+0000 7f3f80c00700 1 --2- 172.21.15.44:0/2254267315 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb1500 0x555fd4cd55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:29.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.871+0000 7f3f73e00700 1 --2- 172.21.15.44:0/2254267315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb68e0 0x555fd4cd03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:29.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.871+0000 7f3f81600700 1 -- 172.21.15.44:0/2254267315 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb1500 msgr2=0x555fd4cd55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:29.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.871+0000 7f3f81600700 1 --2- 172.21.15.44:0/2254267315 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb1500 0x555fd4cd55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.871+0000 7f3f81600700 1 -- 172.21.15.44:0/2254267315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb68e0 msgr2=0x555fd4cd03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:44:29.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.871+0000 7f3f81600700 1 --2- 172.21.15.44:0/2254267315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb68e0 0x555fd4cd03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.871+0000 7f3f81600700 1 -- 172.21.15.44:0/2254267315 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fd4cc70d0 con 0x555fd4cb7200 2024-05-03T22:44:29.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.871+0000 7f3f81600700 1 --2- 172.21.15.44:0/2254267315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb7200 0x555fd4cd08e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x555fd4cb1ec0 tx=0x7f3f74011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec55cc3e3857ddf server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.871+0000 7f3f6aa00700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:44:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.872+0000 7f3f6aa00700 1 -- 172.21.15.44:0/2254267315 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f740ad250 con 0x555fd4cb7200 2024-05-03T22:44:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.872+0000 7f3f6aa00700 1 -- 172.21.15.44:0/2254267315 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f3f740b1330 con 0x555fd4cb7200 2024-05-03T22:44:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.872+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2254267315 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f6c029070 con 0x555fd4cb7200 2024-05-03T22:44:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.872+0000 7f3f6aa00700 1 -- 172.21.15.44:0/2254267315 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3f740ad950 con 0x555fd4cb7200 2024-05-03T22:44:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.872+0000 7f3f8df2ab80 10 client.15141 fetch_fsmap learned FSMap version 30 2024-05-03T22:44:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.872+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2254267315 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555fd4d36940 con 0x555fd4cb7200 2024-05-03T22:44:29.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.872+0000 7f3f6aa00700 1 -- 172.21.15.44:0/2254267315 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f3f6c029070 con 0x555fd4cb7200 2024-05-03T22:44:29.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.872+0000 7f3f6aa00700 1 -- 172.21.15.44:0/2254267315 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f3f74004ad0 con 0x555fd4cb7200 2024-05-03T22:44:29.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.872+0000 7f3f8df2ab80 10 client.15141 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:44:29.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.873+0000 7f3f8df2ab80 10 client.15141 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-03T22:44:29.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.873+0000 7f3f8df2ab80 20 client.15141 populate_metadata read hostname 'smithi044' 2024-05-03T22:44:29.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.873+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/2254267315 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x555fd4d3aef0 0x555fd4d39c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:29.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.873+0000 7f3f8df2ab80 4 client.15141 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:44:29.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.873+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2254267315 --> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] -- command(tid 0: {"prefix": "status"}) -- 0x555fd4c113b0 con 0x555fd4d3aef0 2024-05-03T22:44:29.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.873+0000 7f3f80c00700 1 --2- 172.21.15.44:0/2254267315 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x555fd4d3aef0 0x555fd4d39c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:29.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.874+0000 7f3f80c00700 1 --2- 172.21.15.44:0/2254267315 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x555fd4d3aef0 0x555fd4d39c00 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=597e3556f3c8528b server_cookie=cae7a6a5b1403cf5 in_seq=0 out_seq=0 2024-05-03T22:44:29.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.874+0000 7f3f6aa00700 10 client.15141 ms_handle_connect on v2:172.21.15.60:6838/2420093605 2024-05-03T22:44:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.875+0000 7f3f6aa00700 1 -- 172.21.15.44:0/2254267315 <== mds.0 v2:172.21.15.60:6838/2420093605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555fd4c113b0 con 0x555fd4d3aef0 2024-05-03T22:44:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.875+0000 7f3f6aa00700 10 client.15141 handle_command_reply: tid=0 2024-05-03T22:44:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.875+0000 7f3f8df2ab80 1 client.15141 shutdown 2024-05-03T22:44:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.875+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2254267315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb7200 msgr2=0x555fd4cd08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.875+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/2254267315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb7200 0x555fd4cd08e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x555fd4cb1ec0 tx=0x7f3f74011d80 comp rx=0 tx=0).stop 2024-05-03T22:44:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.875+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2254267315 shutdown_connections 2024-05-03T22:44:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.875+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/2254267315 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x555fd4d3aef0 0x555fd4d39c00 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.875+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/2254267315 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555fd4cb7200 0x555fd4cd08e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.875+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/2254267315 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555fd4cb1500 0x555fd4cd55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.875+0000 7f3f6aa00700 0 client.15141 ms_handle_reset on v2:172.21.15.60:6838/2420093605 2024-05-03T22:44:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.875+0000 7f3f8df2ab80 1 --2- 172.21.15.44:0/2254267315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555fd4cb68e0 0x555fd4cd03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.875+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2254267315 >> 172.21.15.44:0/2254267315 conn(0x555fd4c29680 msgr2=0x555fd4cb43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.875+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2254267315 shutdown_connections 2024-05-03T22:44:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.876+0000 7f3f8df2ab80 1 -- 172.21.15.44:0/2254267315 wait complete. 2024-05-03T22:44:29.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.876+0000 7f3f8df2ab80 20 client.15141 trim_cache size 0 max 16384 2024-05-03T22:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-03T22:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "5b0efdca-099c-11ef-bc97-c7b262605968", 2024-05-03T22:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-05-03T22:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 34463, 2024-05-03T22:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-05-03T22:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-05-03T22:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-05-03T22:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 255.05794354099999, 2024-05-03T22:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 30, 2024-05-03T22:44:29.882 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 89, 2024-05-03T22:44:29.883 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 87, 2024-05-03T22:44:29.883 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 278.11466887900002 2024-05-03T22:44:29.883 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-03T22:44:29.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.876+0000 7f3f83600700 1 -- 172.21.15.44:0/2664797297 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f3f600b2990 msgr2=0x7f3f600b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:29.883 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.876+0000 7f3f83600700 1 --2- 172.21.15.44:0/2664797297 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f3f600b2990 0x7f3f600b4e50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3f64005950 tx=0x7f3f640058e0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.876+0000 7f3f83600700 1 -- 172.21.15.44:0/2664797297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c108850 msgr2=0x7f3f7c1999c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:29.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.876+0000 7f3f83600700 1 --2- 172.21.15.44:0/2664797297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c108850 0x7f3f7c1999c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3f74007d70 tx=0x7f3f7400a340 comp rx=0 tx=0).stop 2024-05-03T22:44:29.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.876+0000 7f3f83600700 1 -- 172.21.15.44:0/2664797297 shutdown_connections 2024-05-03T22:44:29.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.876+0000 7f3f83600700 1 --2- 172.21.15.44:0/2664797297 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3f7c108850 0x7f3f7c1999c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.876+0000 7f3f83600700 1 --2- 172.21.15.44:0/2664797297 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f3f600b2990 0x7f3f600b4e50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.876+0000 7f3f83600700 1 --2- 172.21.15.44:0/2664797297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f7c103750 0x7f3f7c19f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.876+0000 7f3f83600700 1 --2- 172.21.15.44:0/2664797297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f7c104100 0x7f3f7c19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:29.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.876+0000 7f3f83600700 1 -- 172.21.15.44:0/2664797297 >> 172.21.15.44:0/2664797297 conn(0x7f3f7c07a600 msgr2=0x7f3f7c1016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:29.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.877+0000 7f3f83600700 1 -- 172.21.15.44:0/2664797297 shutdown_connections 2024-05-03T22:44:29.884 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:29.877+0000 7f3f83600700 1 -- 172.21.15.44:0/2664797297 wait complete. 2024-05-03T22:44:30.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:30 smithi044 ceph-mon[28604]: pgmap v509: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:44:30.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:30 smithi060 ceph-mon[31721]: pgmap v509: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:44:30.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:30 smithi160 ceph-mon[32531]: pgmap v509: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:44:30.981 INFO:tasks.cephadm:Setup complete, yielding 2024-05-03T22:44:30.981 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-03T22:44:30.991 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi044.front.sepia.ceph.com 2024-05-03T22:44:30.992 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- bash -c 'ceph orch status' 2024-05-03T22:44:31.466 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:44:32.637 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:32 smithi044 ceph-mon[28604]: pgmap v510: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:44:32.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:32 smithi060 ceph-mon[31721]: pgmap v510: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:44:32.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:32 smithi160 ceph-mon[32531]: pgmap v510: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:44:33.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.815+0000 7f003fe00700 1 -- 172.21.15.44:0/720025518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00381046f0 msgr2=0x7f0038104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:33.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.815+0000 7f003fe00700 1 --2- 172.21.15.44:0/720025518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00381046f0 0x7f0038104b50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f00240099c0 tx=0x7f0024009cd0 comp rx=0 tx=0).stop 2024-05-03T22:44:33.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.816+0000 7f003fe00700 1 -- 172.21.15.44:0/720025518 shutdown_connections 2024-05-03T22:44:33.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.816+0000 7f003fe00700 1 --2- 172.21.15.44:0/720025518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0038105090 0x7f003810b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:33.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.816+0000 7f003fe00700 1 --2- 172.21.15.44:0/720025518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00381034f0 0x7f0038103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:33.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.816+0000 7f003fe00700 1 --2- 172.21.15.44:0/720025518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f00381046f0 0x7f0038104b50 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:33.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.816+0000 7f003fe00700 1 -- 172.21.15.44:0/720025518 >> 172.21.15.44:0/720025518 conn(0x7f00380fea90 msgr2=0x7f0038100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:33.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.816+0000 7f003fe00700 1 -- 172.21.15.44:0/720025518 shutdown_connections 2024-05-03T22:44:33.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.816+0000 7f003fe00700 1 -- 172.21.15.44:0/720025518 wait complete. 2024-05-03T22:44:33.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.817+0000 7f003fe00700 1 Processor -- start 2024-05-03T22:44:33.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.817+0000 7f003fe00700 1 -- start start 2024-05-03T22:44:33.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.817+0000 7f003fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00381034f0 0x7f0038077240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:33.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.817+0000 7f003fe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00381046f0 0x7f0038075890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:33.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.817+0000 7f003fe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0038105090 0x7f0038075dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:33.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.817+0000 7f003fe00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f003810f110 con 0x7f0038105090 2024-05-03T22:44:33.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.817+0000 7f003fe00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f003810ef90 con 0x7f00381034f0 2024-05-03T22:44:33.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.817+0000 7f003fe00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f003810f290 con 0x7f00381046f0 2024-05-03T22:44:33.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.818+0000 7f003de00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0038105090 0x7f0038075dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:33.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.818+0000 7f003de00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0038105090 0x7f0038075dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45282/0 (socket says 172.21.15.44:45282) 2024-05-03T22:44:33.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.818+0000 7f003de00700 1 -- 172.21.15.44:0/12509217 learned_addr learned my addr 172.21.15.44:0/12509217 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:33.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.818+0000 7f003d400700 1 --2- 172.21.15.44:0/12509217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00381034f0 0x7f0038077240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:33.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.818+0000 7f003ca00700 1 --2- 172.21.15.44:0/12509217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00381046f0 0x7f0038075890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:33.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.818+0000 7f003de00700 1 -- 172.21.15.44:0/12509217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00381046f0 msgr2=0x7f0038075890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:33.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.818+0000 7f003de00700 1 --2- 172.21.15.44:0/12509217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00381046f0 0x7f0038075890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:33.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.818+0000 7f003de00700 1 -- 172.21.15.44:0/12509217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00381034f0 msgr2=0x7f0038077240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:33.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.818+0000 7f003de00700 1 --2- 172.21.15.44:0/12509217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00381034f0 0x7f0038077240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:33.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.818+0000 7f003de00700 1 -- 172.21.15.44:0/12509217 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0038076680 con 0x7f0038105090 2024-05-03T22:44:33.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.819+0000 7f003de00700 1 --2- 172.21.15.44:0/12509217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0038105090 0x7f0038075dd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0030007ee0 tx=0x7f003000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:33.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.819+0000 7f0036000700 1 -- 172.21.15.44:0/12509217 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f003000dbd0 con 0x7f0038105090 2024-05-03T22:44:33.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.819+0000 7f0036000700 1 -- 172.21.15.44:0/12509217 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f003000dd70 con 0x7f0038105090 2024-05-03T22:44:33.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.819+0000 7f003fe00700 1 -- 172.21.15.44:0/12509217 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00381a38c0 con 0x7f0038105090 2024-05-03T22:44:33.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.819+0000 7f0036000700 1 -- 172.21.15.44:0/12509217 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00300133f0 con 0x7f0038105090 2024-05-03T22:44:33.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.819+0000 7f003fe00700 1 -- 172.21.15.44:0/12509217 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00381a3dd0 con 0x7f0038105090 2024-05-03T22:44:33.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.820+0000 7f003fe00700 1 -- 172.21.15.44:0/12509217 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f003806a190 con 0x7f0038105090 2024-05-03T22:44:33.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.823+0000 7f0036000700 1 -- 172.21.15.44:0/12509217 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f003001a020 con 0x7f0038105090 2024-05-03T22:44:33.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.824+0000 7f0036000700 1 --2- 172.21.15.44:0/12509217 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f00200b2990 0x7f00200b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:33.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.825+0000 7f0036000700 1 -- 172.21.15.44:0/12509217 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f00300e2600 con 0x7f0038105090 2024-05-03T22:44:33.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.825+0000 7f003d400700 1 --2- 172.21.15.44:0/12509217 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f00200b2990 0x7f00200b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:33.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.825+0000 7f003d400700 1 --2- 172.21.15.44:0/12509217 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f00200b2990 0x7f00200b4e50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f002c005950 tx=0x7f002c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:33.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:33.827+0000 7f0036000700 1 -- 172.21.15.44:0/12509217 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f0030010070 con 0x7f0038105090 2024-05-03T22:44:34.085 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:34.083+0000 7f003fe00700 1 -- 172.21.15.44:0/12509217 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f00380639a0 con 0x7f00200b2990 2024-05-03T22:44:34.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:34.086+0000 7f0036000700 1 -- 172.21.15.44:0/12509217 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f00380639a0 con 0x7f00200b2990 2024-05-03T22:44:34.087 INFO:teuthology.orchestra.run.smithi044.stdout:Backend: cephadm 2024-05-03T22:44:34.087 INFO:teuthology.orchestra.run.smithi044.stdout:Available: Yes 2024-05-03T22:44:34.088 INFO:teuthology.orchestra.run.smithi044.stdout:Paused: No 2024-05-03T22:44:34.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:34.089+0000 7f003fe00700 1 -- 172.21.15.44:0/12509217 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f00200b2990 msgr2=0x7f00200b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:34.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:34.089+0000 7f003fe00700 1 --2- 172.21.15.44:0/12509217 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f00200b2990 0x7f00200b4e50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f002c005950 tx=0x7f002c0058e0 comp rx=0 tx=0).stop 2024-05-03T22:44:34.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:34.089+0000 7f003fe00700 1 -- 172.21.15.44:0/12509217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0038105090 msgr2=0x7f0038075dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:34.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:34.089+0000 7f003fe00700 1 --2- 172.21.15.44:0/12509217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0038105090 0x7f0038075dd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0030007ee0 tx=0x7f003000d3b0 comp rx=0 tx=0).stop 2024-05-03T22:44:34.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:34.089+0000 7f003fe00700 1 -- 172.21.15.44:0/12509217 shutdown_connections 2024-05-03T22:44:34.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:34.089+0000 7f003fe00700 1 --2- 172.21.15.44:0/12509217 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f0038105090 0x7f0038075dd0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:34.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:34.089+0000 7f003fe00700 1 --2- 172.21.15.44:0/12509217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00381034f0 0x7f0038077240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:34.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:34.089+0000 7f003fe00700 1 --2- 172.21.15.44:0/12509217 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f00200b2990 0x7f00200b4e50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:34.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:34.089+0000 7f003fe00700 1 --2- 172.21.15.44:0/12509217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00381046f0 0x7f0038075890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:34.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:34.090+0000 7f003fe00700 1 -- 172.21.15.44:0/12509217 >> 172.21.15.44:0/12509217 conn(0x7f00380fea90 msgr2=0x7f00381079f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:34.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:34.090+0000 7f003fe00700 1 -- 172.21.15.44:0/12509217 shutdown_connections 2024-05-03T22:44:34.092 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:34.090+0000 7f003fe00700 1 -- 172.21.15.44:0/12509217 wait complete. 2024-05-03T22:44:34.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:34 smithi044 ceph-mon[28604]: pgmap v511: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:34.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:34 smithi060 ceph-mon[31721]: pgmap v511: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:34.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:34 smithi160 ceph-mon[32531]: pgmap v511: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:34.914 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-03T22:44:35.381 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:44:35.715 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:35 smithi044 ceph-mon[28604]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:44:35.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:35 smithi060 ceph-mon[31721]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:44:35.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:35 smithi160 ceph-mon[32531]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:44:36.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:36 smithi044 ceph-mon[28604]: pgmap v512: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:44:36.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:36 smithi060 ceph-mon[31721]: pgmap v512: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:44:36.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:36 smithi160 ceph-mon[32531]: pgmap v512: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:44:37.739 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.737+0000 7f3654200700 1 -- 172.21.15.44:0/2718343960 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f364c1035f0 msgr2=0x7f364c103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:37.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.737+0000 7f3654200700 1 --2- 172.21.15.44:0/2718343960 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f364c1035f0 0x7f364c103a50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f36380099c0 tx=0x7f3638009cd0 comp rx=0 tx=0).stop 2024-05-03T22:44:37.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.737+0000 7f3654200700 1 -- 172.21.15.44:0/2718343960 shutdown_connections 2024-05-03T22:44:37.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.737+0000 7f3654200700 1 --2- 172.21.15.44:0/2718343960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f364c103f90 0x7f364c10a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:37.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.737+0000 7f3654200700 1 --2- 172.21.15.44:0/2718343960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f364c1023f0 0x7f364c102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:37.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.737+0000 7f3654200700 1 --2- 172.21.15.44:0/2718343960 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f364c1035f0 0x7f364c103a50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:37.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.737+0000 7f3654200700 1 -- 172.21.15.44:0/2718343960 >> 172.21.15.44:0/2718343960 conn(0x7f364c0fd990 msgr2=0x7f364c0ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:37.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.737+0000 7f3654200700 1 -- 172.21.15.44:0/2718343960 shutdown_connections 2024-05-03T22:44:37.740 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.737+0000 7f3654200700 1 -- 172.21.15.44:0/2718343960 wait complete. 2024-05-03T22:44:37.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.739+0000 7f3654200700 1 Processor -- start 2024-05-03T22:44:37.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.739+0000 7f3654200700 1 -- start start 2024-05-03T22:44:37.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.739+0000 7f3654200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f364c1023f0 0x7f364c19b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:37.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.739+0000 7f3654200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f364c1035f0 0x7f364c19be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:37.741 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.739+0000 7f3654200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f364c103f90 0x7f364c1a2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:37.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.739+0000 7f3654200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f364c06c170 con 0x7f364c103f90 2024-05-03T22:44:37.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.739+0000 7f3654200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f364c06bff0 con 0x7f364c1023f0 2024-05-03T22:44:37.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.739+0000 7f3654200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f364c06c2f0 con 0x7f364c1035f0 2024-05-03T22:44:37.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.740+0000 7f3652200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f364c103f90 0x7f364c1a2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:37.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.740+0000 7f3652200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f364c103f90 0x7f364c1a2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:45300/0 (socket says 172.21.15.44:45300) 2024-05-03T22:44:37.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.740+0000 7f3652200700 1 -- 172.21.15.44:0/331245080 learned_addr learned my addr 172.21.15.44:0/331245080 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:37.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.740+0000 7f3651800700 1 --2- 172.21.15.44:0/331245080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f364c1023f0 0x7f364c19b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:37.742 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.740+0000 7f3650e00700 1 --2- 172.21.15.44:0/331245080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f364c1035f0 0x7f364c19be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:37.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.740+0000 7f3652200700 1 -- 172.21.15.44:0/331245080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f364c1035f0 msgr2=0x7f364c19be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:37.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.740+0000 7f3652200700 1 --2- 172.21.15.44:0/331245080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f364c1035f0 0x7f364c19be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:37.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.740+0000 7f3652200700 1 -- 172.21.15.44:0/331245080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f364c1023f0 msgr2=0x7f364c19b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:37.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.740+0000 7f3652200700 1 --2- 172.21.15.44:0/331245080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f364c1023f0 0x7f364c19b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:37.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.740+0000 7f3652200700 1 -- 172.21.15.44:0/331245080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364c1a3550 con 0x7f364c103f90 2024-05-03T22:44:37.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.741+0000 7f3652200700 1 --2- 172.21.15.44:0/331245080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f364c103f90 0x7f364c1a2eb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3644007da0 tx=0x7f364400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:37.743 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.741+0000 7f364a000700 1 -- 172.21.15.44:0/331245080 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3644016020 con 0x7f364c103f90 2024-05-03T22:44:37.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.741+0000 7f3654200700 1 -- 172.21.15.44:0/331245080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f364c1a3840 con 0x7f364c103f90 2024-05-03T22:44:37.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.741+0000 7f364a000700 1 -- 172.21.15.44:0/331245080 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f364400ac50 con 0x7f364c103f90 2024-05-03T22:44:37.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.741+0000 7f364a000700 1 -- 172.21.15.44:0/331245080 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36440115e0 con 0x7f364c103f90 2024-05-03T22:44:37.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.741+0000 7f3654200700 1 -- 172.21.15.44:0/331245080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f364c1a3d80 con 0x7f364c103f90 2024-05-03T22:44:37.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.743+0000 7f3654200700 1 -- 172.21.15.44:0/331245080 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f364c06a190 con 0x7f364c103f90 2024-05-03T22:44:37.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.745+0000 7f364a000700 1 -- 172.21.15.44:0/331245080 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3644019020 con 0x7f364c103f90 2024-05-03T22:44:37.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.747+0000 7f364a000700 1 --2- 172.21.15.44:0/331245080 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f36340b2990 0x7f36340b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:37.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.747+0000 7f364a000700 1 -- 172.21.15.44:0/331245080 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f36440e2980 con 0x7f364c103f90 2024-05-03T22:44:37.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.747+0000 7f3651800700 1 --2- 172.21.15.44:0/331245080 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f36340b2990 0x7f36340b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:37.749 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.748+0000 7f3651800700 1 --2- 172.21.15.44:0/331245080 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f36340b2990 0x7f36340b4e50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3640005950 tx=0x7f364000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:37.753 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:37.751+0000 7f364a000700 1 -- 172.21.15.44:0/331245080 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f3644020020 con 0x7f364c103f90 2024-05-03T22:44:38.003 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:38.001+0000 7f3654200700 1 -- 172.21.15.44:0/331245080 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f364c10efe0 con 0x7f36340b2990 2024-05-03T22:44:38.029 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:38.027+0000 7f364a000700 1 -- 172.21.15.44:0/331245080 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f364c10efe0 con 0x7f36340b2990 2024-05-03T22:44:38.029 INFO:teuthology.orchestra.run.smithi044.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-03T22:44:38.029 INFO:teuthology.orchestra.run.smithi044.stdout:mds.a smithi044 running (4m) 2m ago 4m 14.7M - 19.0.0-3450-g9a047fe7 ee4d84620249 8276c737a75e 2024-05-03T22:44:38.029 INFO:teuthology.orchestra.run.smithi044.stdout:mds.b smithi060 running (4m) 2m ago 4m 25.2M - 19.0.0-3450-g9a047fe7 ee4d84620249 0922f61147fd 2024-05-03T22:44:38.030 INFO:teuthology.orchestra.run.smithi044.stdout:mds.c smithi160 running (5m) 2m ago 5m 16.0M - 19.0.0-3450-g9a047fe7 ee4d84620249 9ce22ca19a12 2024-05-03T22:44:38.030 INFO:teuthology.orchestra.run.smithi044.stdout:mds.d smithi044 running (5m) 2m ago 5m 13.2M - 19.0.0-3450-g9a047fe7 ee4d84620249 8cc7f2b26721 2024-05-03T22:44:38.030 INFO:teuthology.orchestra.run.smithi044.stdout:mds.e smithi060 running (5m) 2m ago 5m 16.7M - 19.0.0-3450-g9a047fe7 ee4d84620249 884b783230cf 2024-05-03T22:44:38.030 INFO:teuthology.orchestra.run.smithi044.stdout:mds.f smithi160 running (5m) 2m ago 5m 15.0M - 19.0.0-3450-g9a047fe7 ee4d84620249 102dcaa56d83 2024-05-03T22:44:38.030 INFO:teuthology.orchestra.run.smithi044.stdout:mds.g smithi044 running (4m) 2m ago 4m 14.9M - 19.0.0-3450-g9a047fe7 ee4d84620249 1ed06d1b8655 2024-05-03T22:44:38.030 INFO:teuthology.orchestra.run.smithi044.stdout:mds.h smithi060 running (5m) 2m ago 5m 16.4M - 19.0.0-3450-g9a047fe7 ee4d84620249 36e06da620b3 2024-05-03T22:44:38.030 INFO:teuthology.orchestra.run.smithi044.stdout:mds.i smithi160 running (5m) 2m ago 5m 16.0M - 19.0.0-3450-g9a047fe7 ee4d84620249 31853a619ebc 2024-05-03T22:44:38.030 INFO:teuthology.orchestra.run.smithi044.stdout:mds.j smithi044 running (5m) 2m ago 5m 13.2M - 19.0.0-3450-g9a047fe7 ee4d84620249 8b089bba3c06 2024-05-03T22:44:38.030 INFO:teuthology.orchestra.run.smithi044.stdout:mds.k smithi060 running (5m) 2m ago 5m 16.4M - 19.0.0-3450-g9a047fe7 ee4d84620249 76669e1cfdcc 2024-05-03T22:44:38.030 INFO:teuthology.orchestra.run.smithi044.stdout:mds.l smithi160 running (5m) 2m ago 5m 15.1M - 19.0.0-3450-g9a047fe7 ee4d84620249 7283b54e3648 2024-05-03T22:44:38.030 INFO:teuthology.orchestra.run.smithi044.stdout:mgr.x smithi044 *:9283,8765 running (15m) 2m ago 15m 529M - 19.0.0-3450-g9a047fe7 ee4d84620249 4867f67c70cc 2024-05-03T22:44:38.030 INFO:teuthology.orchestra.run.smithi044.stdout:mgr.y smithi060 *:8443,8765 running (12m) 2m ago 12m 466M - 19.0.0-3450-g9a047fe7 ee4d84620249 37779647d94c 2024-05-03T22:44:38.030 INFO:teuthology.orchestra.run.smithi044.stdout:mgr.z smithi160 *:8443,8765 running (12m) 2m ago 12m 466M - 19.0.0-3450-g9a047fe7 ee4d84620249 3fc33530ccfb 2024-05-03T22:44:38.031 INFO:teuthology.orchestra.run.smithi044.stdout:mon.a smithi044 running (15m) 2m ago 15m 51.5M 2048M 19.0.0-3450-g9a047fe7 ee4d84620249 de4db08ce634 2024-05-03T22:44:38.031 INFO:teuthology.orchestra.run.smithi044.stdout:mon.b smithi060 running (13m) 2m ago 13m 39.9M 2048M 19.0.0-3450-g9a047fe7 ee4d84620249 cfdc67598a7c 2024-05-03T22:44:38.031 INFO:teuthology.orchestra.run.smithi044.stdout:mon.c smithi160 running (13m) 2m ago 13m 41.5M 2048M 19.0.0-3450-g9a047fe7 ee4d84620249 bfea2da91fd4 2024-05-03T22:44:38.031 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0 smithi044 running (12m) 2m ago 12m 47.1M 4273M 19.0.0-3450-g9a047fe7 ee4d84620249 318e3b36bd1a 2024-05-03T22:44:38.031 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1 smithi060 running (11m) 2m ago 11m 45.6M 4273M 19.0.0-3450-g9a047fe7 ee4d84620249 6113c484caf5 2024-05-03T22:44:38.031 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2 smithi160 running (11m) 2m ago 11m 53.5M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 eddd156b5c6f 2024-05-03T22:44:38.031 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3 smithi044 running (10m) 2m ago 10m 51.9M 4273M 19.0.0-3450-g9a047fe7 ee4d84620249 74c24d9d1c10 2024-05-03T22:44:38.031 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4 smithi060 running (10m) 2m ago 10m 50.2M 4273M 19.0.0-3450-g9a047fe7 ee4d84620249 d54263ce3830 2024-05-03T22:44:38.031 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5 smithi160 running (9m) 2m ago 9m 52.9M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 1697cffc0115 2024-05-03T22:44:38.031 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6 smithi044 running (9m) 2m ago 9m 50.4M 4273M 19.0.0-3450-g9a047fe7 ee4d84620249 e72d962a6be8 2024-05-03T22:44:38.031 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7 smithi060 running (8m) 2m ago 8m 45.9M 4273M 19.0.0-3450-g9a047fe7 ee4d84620249 749d88ae1242 2024-05-03T22:44:38.031 INFO:teuthology.orchestra.run.smithi044.stdout:osd.8 smithi160 running (7m) 2m ago 7m 51.6M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 5c9c663f8123 2024-05-03T22:44:38.031 INFO:teuthology.orchestra.run.smithi044.stdout:osd.9 smithi044 running (7m) 2m ago 7m 50.4M 4273M 19.0.0-3450-g9a047fe7 ee4d84620249 a46085ca3162 2024-05-03T22:44:38.031 INFO:teuthology.orchestra.run.smithi044.stdout:osd.10 smithi060 running (6m) 2m ago 6m 51.1M 4273M 19.0.0-3450-g9a047fe7 ee4d84620249 c4ed067f9356 2024-05-03T22:44:38.032 INFO:teuthology.orchestra.run.smithi044.stdout:osd.11 smithi160 running (6m) 2m ago 6m 42.0M 4272M 19.0.0-3450-g9a047fe7 ee4d84620249 86520ec4fa0e 2024-05-03T22:44:38.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:38.030+0000 7f3654200700 1 -- 172.21.15.44:0/331245080 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f36340b2990 msgr2=0x7f36340b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:38.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:38.030+0000 7f3654200700 1 --2- 172.21.15.44:0/331245080 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f36340b2990 0x7f36340b4e50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3640005950 tx=0x7f364000a300 comp rx=0 tx=0).stop 2024-05-03T22:44:38.032 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:38.030+0000 7f3654200700 1 -- 172.21.15.44:0/331245080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f364c103f90 msgr2=0x7f364c1a2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:38.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:38.030+0000 7f3654200700 1 --2- 172.21.15.44:0/331245080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f364c103f90 0x7f364c1a2eb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3644007da0 tx=0x7f364400a340 comp rx=0 tx=0).stop 2024-05-03T22:44:38.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:38.031+0000 7f3654200700 1 -- 172.21.15.44:0/331245080 shutdown_connections 2024-05-03T22:44:38.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:38.031+0000 7f3654200700 1 --2- 172.21.15.44:0/331245080 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f364c103f90 0x7f364c1a2eb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:38.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:38.031+0000 7f3654200700 1 --2- 172.21.15.44:0/331245080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f364c1023f0 0x7f364c19b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:38.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:38.031+0000 7f3654200700 1 --2- 172.21.15.44:0/331245080 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f36340b2990 0x7f36340b4e50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:38.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:38.031+0000 7f3654200700 1 --2- 172.21.15.44:0/331245080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f364c1035f0 0x7f364c19be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:38.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:38.031+0000 7f3654200700 1 -- 172.21.15.44:0/331245080 >> 172.21.15.44:0/331245080 conn(0x7f364c0fd990 msgr2=0x7f364c10d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:38.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:38.031+0000 7f3654200700 1 -- 172.21.15.44:0/331245080 shutdown_connections 2024-05-03T22:44:38.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:38.031+0000 7f3654200700 1 -- 172.21.15.44:0/331245080 wait complete. 2024-05-03T22:44:38.697 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:38 smithi044 ceph-mon[28604]: pgmap v513: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:38.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:38 smithi060 ceph-mon[31721]: pgmap v513: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:38.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:38 smithi160 ceph-mon[32531]: pgmap v513: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:38.930 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-03T22:44:39.409 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:44:39.730 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:39 smithi044 ceph-mon[28604]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:44:39.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:39 smithi060 ceph-mon[31721]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:44:39.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:39 smithi160 ceph-mon[32531]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:44:40.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:40 smithi044 ceph-mon[28604]: pgmap v514: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:44:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:40 smithi060 ceph-mon[31721]: pgmap v514: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:44:40.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:40 smithi160 ceph-mon[32531]: pgmap v514: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:44:41.646 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:41 smithi044 ceph-mon[28604]: pgmap v515: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-03T22:44:41.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:41 smithi060 ceph-mon[31721]: pgmap v515: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-03T22:44:41.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:41 smithi160 ceph-mon[32531]: pgmap v515: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-03T22:44:41.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.824+0000 7f14bbe00700 1 -- 172.21.15.44:0/2199392090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14bc103420 msgr2=0x7f14bc103840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:41.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.824+0000 7f14bbe00700 1 --2- 172.21.15.44:0/2199392090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14bc103420 0x7f14bc103840 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0099c0 tx=0x7f14ac009cd0 comp rx=0 tx=0).stop 2024-05-03T22:44:41.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.825+0000 7f14bbe00700 1 -- 172.21.15.44:0/2199392090 shutdown_connections 2024-05-03T22:44:41.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.825+0000 7f14bbe00700 1 --2- 172.21.15.44:0/2199392090 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14bc104fc0 0x7f14bc10b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:41.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.825+0000 7f14bbe00700 1 --2- 172.21.15.44:0/2199392090 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14bc103420 0x7f14bc103840 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:41.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.825+0000 7f14bbe00700 1 --2- 172.21.15.44:0/2199392090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14bc104620 0x7f14bc104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:41.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.825+0000 7f14bbe00700 1 -- 172.21.15.44:0/2199392090 >> 172.21.15.44:0/2199392090 conn(0x7f14bc0fe9e0 msgr2=0x7f14bc100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:41.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.825+0000 7f14bbe00700 1 -- 172.21.15.44:0/2199392090 shutdown_connections 2024-05-03T22:44:41.827 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.825+0000 7f14bbe00700 1 -- 172.21.15.44:0/2199392090 wait complete. 2024-05-03T22:44:41.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.826+0000 7f14bbe00700 1 Processor -- start 2024-05-03T22:44:41.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.826+0000 7f14bbe00700 1 -- start start 2024-05-03T22:44:41.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.827+0000 7f14bbe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14bc103420 0x7f14bc199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:41.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.827+0000 7f14bbe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14bc104620 0x7f14bc199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:41.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.827+0000 7f14bbe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14bc104fc0 0x7f14bc1a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:41.828 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.827+0000 7f14bbe00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f14bc10eff0 con 0x7f14bc104620 2024-05-03T22:44:41.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.827+0000 7f14bbe00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f14bc10ee70 con 0x7f14bc103420 2024-05-03T22:44:41.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.827+0000 7f14bbe00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f14bc10f170 con 0x7f14bc104fc0 2024-05-03T22:44:41.829 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.827+0000 7f14b2000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14bc104620 0x7f14bc199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:41.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.827+0000 7f14b2000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14bc104620 0x7f14bc199b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51732/0 (socket says 172.21.15.44:51732) 2024-05-03T22:44:41.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.827+0000 7f14b2000700 1 -- 172.21.15.44:0/3239307859 learned_addr learned my addr 172.21.15.44:0/3239307859 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:41.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.828+0000 7f14bb400700 1 --2- 172.21.15.44:0/3239307859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14bc104fc0 0x7f14bc1a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:41.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.828+0000 7f14baa00700 1 --2- 172.21.15.44:0/3239307859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14bc103420 0x7f14bc199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:41.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.828+0000 7f14b2000700 1 -- 172.21.15.44:0/3239307859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14bc104fc0 msgr2=0x7f14bc1a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:41.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.828+0000 7f14b2000700 1 --2- 172.21.15.44:0/3239307859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14bc104fc0 0x7f14bc1a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:41.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.828+0000 7f14b2000700 1 -- 172.21.15.44:0/3239307859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14bc103420 msgr2=0x7f14bc199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:41.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.828+0000 7f14b2000700 1 --2- 172.21.15.44:0/3239307859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14bc103420 0x7f14bc199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:41.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.828+0000 7f14b2000700 1 -- 172.21.15.44:0/3239307859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14bc1a1290 con 0x7f14bc104620 2024-05-03T22:44:41.830 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.828+0000 7f14b2000700 1 --2- 172.21.15.44:0/3239307859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14bc104620 0x7f14bc199b70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f14a400c950 tx=0x7f14a400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:41.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.829+0000 7f14c0a00700 1 -- 172.21.15.44:0/3239307859 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a4007ac0 con 0x7f14bc104620 2024-05-03T22:44:41.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.829+0000 7f14c0a00700 1 -- 172.21.15.44:0/3239307859 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f14a4004d00 con 0x7f14bc104620 2024-05-03T22:44:41.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.829+0000 7f14bbe00700 1 -- 172.21.15.44:0/3239307859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14bc1a1580 con 0x7f14bc104620 2024-05-03T22:44:41.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.829+0000 7f14c0a00700 1 -- 172.21.15.44:0/3239307859 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a40055e0 con 0x7f14bc104620 2024-05-03T22:44:41.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.829+0000 7f14bbe00700 1 -- 172.21.15.44:0/3239307859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14bc1a1ac0 con 0x7f14bc104620 2024-05-03T22:44:41.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.830+0000 7f14bbe00700 1 -- 172.21.15.44:0/3239307859 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14bc06a190 con 0x7f14bc104620 2024-05-03T22:44:41.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.833+0000 7f14c0a00700 1 -- 172.21.15.44:0/3239307859 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f14a4004750 con 0x7f14bc104620 2024-05-03T22:44:41.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.834+0000 7f14c0a00700 1 --2- 172.21.15.44:0/3239307859 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f14a00b2910 0x7f14a00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:41.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.834+0000 7f14c0a00700 1 -- 172.21.15.44:0/3239307859 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f14a40e2330 con 0x7f14bc104620 2024-05-03T22:44:41.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.834+0000 7f14baa00700 1 --2- 172.21.15.44:0/3239307859 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f14a00b2910 0x7f14a00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:41.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.835+0000 7f14baa00700 1 --2- 172.21.15.44:0/3239307859 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f14a00b2910 0x7f14a00b4dd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f14ac003870 tx=0x7f14ac005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:41.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:41.839+0000 7f14c0a00700 1 -- 172.21.15.44:0/3239307859 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f14a4014030 con 0x7f14bc104620 2024-05-03T22:44:42.089 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:42.087+0000 7f14bbe00700 1 -- 172.21.15.44:0/3239307859 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f14bc0638e0 con 0x7f14a00b2910 2024-05-03T22:44:42.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:42.104+0000 7f14c0a00700 1 -- 172.21.15.44:0/3239307859 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f14bc0638e0 con 0x7f14a00b2910 2024-05-03T22:44:42.106 INFO:teuthology.orchestra.run.smithi044.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-03T22:44:42.106 INFO:teuthology.orchestra.run.smithi044.stdout:mds.all 12/12 2m ago 5m smithi044=a;smithi044=d;smithi044=g;smithi044=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2024-05-03T22:44:42.106 INFO:teuthology.orchestra.run.smithi044.stdout:mgr 3/3 2m ago 13m smithi044=x;smithi060=y;smithi160=z;count:3 2024-05-03T22:44:42.106 INFO:teuthology.orchestra.run.smithi044.stdout:mon 3/3 2m ago 13m smithi044:172.21.15.44=a;smithi060:172.21.15.60=b;smithi160:172.21.15.160=c;count:3 2024-05-03T22:44:42.106 INFO:teuthology.orchestra.run.smithi044.stdout:osd 12 2m ago - 2024-05-03T22:44:42.108 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:42.107+0000 7f14bbe00700 1 -- 172.21.15.44:0/3239307859 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f14a00b2910 msgr2=0x7f14a00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:42.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:42.107+0000 7f14bbe00700 1 --2- 172.21.15.44:0/3239307859 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f14a00b2910 0x7f14a00b4dd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f14ac003870 tx=0x7f14ac005fb0 comp rx=0 tx=0).stop 2024-05-03T22:44:42.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:42.107+0000 7f14bbe00700 1 -- 172.21.15.44:0/3239307859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14bc104620 msgr2=0x7f14bc199b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:42.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:42.107+0000 7f14bbe00700 1 --2- 172.21.15.44:0/3239307859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14bc104620 0x7f14bc199b70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f14a400c950 tx=0x7f14a400cc60 comp rx=0 tx=0).stop 2024-05-03T22:44:42.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:42.107+0000 7f14bbe00700 1 -- 172.21.15.44:0/3239307859 shutdown_connections 2024-05-03T22:44:42.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:42.107+0000 7f14bbe00700 1 --2- 172.21.15.44:0/3239307859 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f14a00b2910 0x7f14a00b4dd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:42.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:42.107+0000 7f14bbe00700 1 --2- 172.21.15.44:0/3239307859 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14bc104fc0 0x7f14bc1a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:42.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:42.107+0000 7f14bbe00700 1 --2- 172.21.15.44:0/3239307859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14bc103420 0x7f14bc199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:42.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:42.108+0000 7f14bbe00700 1 --2- 172.21.15.44:0/3239307859 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f14bc104620 0x7f14bc199b70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:42.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:42.108+0000 7f14bbe00700 1 -- 172.21.15.44:0/3239307859 >> 172.21.15.44:0/3239307859 conn(0x7f14bc0fe9e0 msgr2=0x7f14bc1079c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:42.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:42.108+0000 7f14bbe00700 1 -- 172.21.15.44:0/3239307859 shutdown_connections 2024-05-03T22:44:42.110 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:42.108+0000 7f14bbe00700 1 -- 172.21.15.44:0/3239307859 wait complete. 2024-05-03T22:44:42.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:42 smithi044 ceph-mon[28604]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:44:42.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:42 smithi060 ceph-mon[31721]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:44:42.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:42 smithi160 ceph-mon[32531]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:44:43.113 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-03T22:44:43.589 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:44:43.740 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:43 smithi044 ceph-mon[28604]: pgmap v516: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:44:43.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:43 smithi060 ceph-mon[31721]: pgmap v516: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:44:43.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:43 smithi160 ceph-mon[32531]: pgmap v516: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:44:45.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.968+0000 7f54c4600700 1 -- 172.21.15.44:0/526981814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54bc10ad40 msgr2=0x7f54bc10b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:45.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.968+0000 7f54c4600700 1 --2- 172.21.15.44:0/526981814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54bc10ad40 0x7f54bc10b1a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f54a80099c0 tx=0x7f54a8009cd0 comp rx=0 tx=0).stop 2024-05-03T22:44:45.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.968+0000 7f54c4600700 1 -- 172.21.15.44:0/526981814 shutdown_connections 2024-05-03T22:44:45.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.968+0000 7f54c4600700 1 --2- 172.21.15.44:0/526981814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54bc10b6e0 0x7f54bc111f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:45.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.968+0000 7f54c4600700 1 --2- 172.21.15.44:0/526981814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54bc109b40 0x7f54bc109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:45.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.968+0000 7f54c4600700 1 --2- 172.21.15.44:0/526981814 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54bc10ad40 0x7f54bc10b1a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:45.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.968+0000 7f54c4600700 1 -- 172.21.15.44:0/526981814 >> 172.21.15.44:0/526981814 conn(0x7f54bc078b10 msgr2=0x7f54bc07af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:45.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.968+0000 7f54c4600700 1 -- 172.21.15.44:0/526981814 shutdown_connections 2024-05-03T22:44:45.971 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.969+0000 7f54c4600700 1 -- 172.21.15.44:0/526981814 wait complete. 2024-05-03T22:44:45.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.970+0000 7f54c4600700 1 Processor -- start 2024-05-03T22:44:45.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.970+0000 7f54c4600700 1 -- start start 2024-05-03T22:44:45.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.970+0000 7f54c4600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54bc109b40 0x7f54bc19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:45.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.970+0000 7f54c4600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54bc10ad40 0x7f54bc1a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:45.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.970+0000 7f54c4600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54bc10b6e0 0x7f54bc1a7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:45.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.970+0000 7f54c4600700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc1156f0 con 0x7f54bc10b6e0 2024-05-03T22:44:45.973 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.970+0000 7f54c4600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc115570 con 0x7f54bc10ad40 2024-05-03T22:44:45.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.970+0000 7f54c4600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc115870 con 0x7f54bc109b40 2024-05-03T22:44:45.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.971+0000 7f54c2600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54bc10b6e0 0x7f54bc1a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:45.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.971+0000 7f54c2600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54bc10b6e0 0x7f54bc1a7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51758/0 (socket says 172.21.15.44:51758) 2024-05-03T22:44:45.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.971+0000 7f54c2600700 1 -- 172.21.15.44:0/1294476842 learned_addr learned my addr 172.21.15.44:0/1294476842 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:45.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.971+0000 7f54c1c00700 1 --2- 172.21.15.44:0/1294476842 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54bc109b40 0x7f54bc19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:45.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.971+0000 7f54c1200700 1 --2- 172.21.15.44:0/1294476842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54bc10ad40 0x7f54bc1a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:45.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.971+0000 7f54c2600700 1 -- 172.21.15.44:0/1294476842 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54bc109b40 msgr2=0x7f54bc19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:45.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.971+0000 7f54c2600700 1 --2- 172.21.15.44:0/1294476842 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54bc109b40 0x7f54bc19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:45.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.971+0000 7f54c2600700 1 -- 172.21.15.44:0/1294476842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54bc10ad40 msgr2=0x7f54bc1a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:45.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.971+0000 7f54c2600700 1 --2- 172.21.15.44:0/1294476842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54bc10ad40 0x7f54bc1a0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:45.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.971+0000 7f54c2600700 1 -- 172.21.15.44:0/1294476842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54bc1a7940 con 0x7f54bc10b6e0 2024-05-03T22:44:45.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.972+0000 7f54c2600700 1 --2- 172.21.15.44:0/1294476842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54bc10b6e0 0x7f54bc1a7270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f54b4007ee0 tx=0x7f54b400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:45.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.972+0000 7f54ba000700 1 -- 172.21.15.44:0/1294476842 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b400dbd0 con 0x7f54bc10b6e0 2024-05-03T22:44:45.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.972+0000 7f54ba000700 1 -- 172.21.15.44:0/1294476842 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f54b400dd70 con 0x7f54bc10b6e0 2024-05-03T22:44:45.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.972+0000 7f54ba000700 1 -- 172.21.15.44:0/1294476842 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b40133f0 con 0x7f54bc10b6e0 2024-05-03T22:44:45.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.972+0000 7f54c4600700 1 -- 172.21.15.44:0/1294476842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54bc1a7c30 con 0x7f54bc10b6e0 2024-05-03T22:44:45.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.972+0000 7f54c4600700 1 -- 172.21.15.44:0/1294476842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54bc1a8170 con 0x7f54bc10b6e0 2024-05-03T22:44:45.975 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.973+0000 7f54c4600700 1 -- 172.21.15.44:0/1294476842 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54bc06a190 con 0x7f54bc10b6e0 2024-05-03T22:44:45.977 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.976+0000 7f54ba000700 1 -- 172.21.15.44:0/1294476842 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f54b401a020 con 0x7f54bc10b6e0 2024-05-03T22:44:45.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.977+0000 7f54ba000700 1 --2- 172.21.15.44:0/1294476842 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f54a40b2990 0x7f54a40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:45.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.978+0000 7f54ba000700 1 -- 172.21.15.44:0/1294476842 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f54b40e2600 con 0x7f54bc10b6e0 2024-05-03T22:44:45.979 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.978+0000 7f54c1c00700 1 --2- 172.21.15.44:0/1294476842 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f54a40b2990 0x7f54a40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:45.980 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.979+0000 7f54c1c00700 1 --2- 172.21.15.44:0/1294476842 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f54a40b2990 0x7f54a40b4e50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f54b0005950 tx=0x7f54b00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:45.981 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:45.980+0000 7f54ba000700 1 -- 172.21.15.44:0/1294476842 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f54b4010070 con 0x7f54bc10b6e0 2024-05-03T22:44:46.225 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:46.223+0000 7f54c4600700 1 -- 172.21.15.44:0/1294476842 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f54bc0638e0 con 0x7f54a40b2990 2024-05-03T22:44:46.228 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:46.226+0000 7f54ba000700 1 -- 172.21.15.44:0/1294476842 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f54bc0638e0 con 0x7f54a40b2990 2024-05-03T22:44:46.228 INFO:teuthology.orchestra.run.smithi044.stdout:HOST ADDR LABELS STATUS 2024-05-03T22:44:46.228 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044 172.21.15.44 2024-05-03T22:44:46.228 INFO:teuthology.orchestra.run.smithi044.stdout:smithi060 172.21.15.60 2024-05-03T22:44:46.228 INFO:teuthology.orchestra.run.smithi044.stdout:smithi160 172.21.15.160 2024-05-03T22:44:46.228 INFO:teuthology.orchestra.run.smithi044.stdout:3 hosts in cluster 2024-05-03T22:44:46.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:46.229+0000 7f54c4600700 1 -- 172.21.15.44:0/1294476842 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f54a40b2990 msgr2=0x7f54a40b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:46.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:46.229+0000 7f54c4600700 1 --2- 172.21.15.44:0/1294476842 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f54a40b2990 0x7f54a40b4e50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f54b0005950 tx=0x7f54b00058e0 comp rx=0 tx=0).stop 2024-05-03T22:44:46.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:46.229+0000 7f54c4600700 1 -- 172.21.15.44:0/1294476842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54bc10b6e0 msgr2=0x7f54bc1a7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:46.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:46.229+0000 7f54c4600700 1 --2- 172.21.15.44:0/1294476842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54bc10b6e0 0x7f54bc1a7270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f54b4007ee0 tx=0x7f54b400d3b0 comp rx=0 tx=0).stop 2024-05-03T22:44:46.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:46.229+0000 7f54c4600700 1 -- 172.21.15.44:0/1294476842 shutdown_connections 2024-05-03T22:44:46.231 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:46.229+0000 7f54c4600700 1 --2- 172.21.15.44:0/1294476842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f54bc10b6e0 0x7f54bc1a7270 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:46.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:46.229+0000 7f54c4600700 1 --2- 172.21.15.44:0/1294476842 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f54a40b2990 0x7f54a40b4e50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:46.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:46.229+0000 7f54c4600700 1 --2- 172.21.15.44:0/1294476842 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54bc109b40 0x7f54bc19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:46.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:46.229+0000 7f54c4600700 1 --2- 172.21.15.44:0/1294476842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54bc10ad40 0x7f54bc1a0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:46.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:46.230+0000 7f54c4600700 1 -- 172.21.15.44:0/1294476842 >> 172.21.15.44:0/1294476842 conn(0x7f54bc078b10 msgr2=0x7f54bc10e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:46.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:46.230+0000 7f54c4600700 1 -- 172.21.15.44:0/1294476842 shutdown_connections 2024-05-03T22:44:46.232 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:46.230+0000 7f54c4600700 1 -- 172.21.15.44:0/1294476842 wait complete. 2024-05-03T22:44:46.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:46 smithi044 ceph-mon[28604]: pgmap v517: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:44:46.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:46 smithi060 ceph-mon[31721]: pgmap v517: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:44:46.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:46 smithi160 ceph-mon[32531]: pgmap v517: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:44:47.228 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-03T22:44:47.307 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:47 smithi044 ceph-mon[28604]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:44:47.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:47 smithi060 ceph-mon[31721]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:44:47.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:47 smithi160 ceph-mon[32531]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:44:47.691 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:44:48.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:48 smithi044 ceph-mon[28604]: pgmap v518: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:44:48.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:48 smithi060 ceph-mon[31721]: pgmap v518: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:44:48.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:48 smithi160 ceph-mon[32531]: pgmap v518: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:44:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.076+0000 7fa7da400700 1 -- 172.21.15.44:0/329949117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7d410b6e0 msgr2=0x7fa7d4111f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.076+0000 7fa7da400700 1 --2- 172.21.15.44:0/329949117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7d410b6e0 0x7fa7d4111f90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc00b0d0 tx=0x7fa7cc00b3e0 comp rx=0 tx=0).stop 2024-05-03T22:44:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.076+0000 7fa7da400700 1 -- 172.21.15.44:0/329949117 shutdown_connections 2024-05-03T22:44:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.076+0000 7fa7da400700 1 --2- 172.21.15.44:0/329949117 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7d410b6e0 0x7fa7d4111f90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.076+0000 7fa7da400700 1 --2- 172.21.15.44:0/329949117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d4109b40 0x7fa7d4109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.076+0000 7fa7da400700 1 --2- 172.21.15.44:0/329949117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7d410ad40 0x7fa7d410b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.076+0000 7fa7da400700 1 -- 172.21.15.44:0/329949117 >> 172.21.15.44:0/329949117 conn(0x7fa7d4078b10 msgr2=0x7fa7d407af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.076+0000 7fa7da400700 1 -- 172.21.15.44:0/329949117 shutdown_connections 2024-05-03T22:44:50.078 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.076+0000 7fa7da400700 1 -- 172.21.15.44:0/329949117 wait complete. 2024-05-03T22:44:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.077+0000 7fa7da400700 1 Processor -- start 2024-05-03T22:44:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.077+0000 7fa7da400700 1 -- start start 2024-05-03T22:44:50.079 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.078+0000 7fa7da400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7d4109b40 0x7fa7d419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.078+0000 7fa7da400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7d410ad40 0x7fa7d41a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.078+0000 7fa7da400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d410b6e0 0x7fa7d41a7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.078+0000 7fa7da400700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d4115770 con 0x7fa7d4109b40 2024-05-03T22:44:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.078+0000 7fa7da400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d41155f0 con 0x7fa7d410b6e0 2024-05-03T22:44:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.078+0000 7fa7da400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d41158f0 con 0x7fa7d410ad40 2024-05-03T22:44:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.078+0000 7fa7d3400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7d4109b40 0x7fa7d419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.078+0000 7fa7d3400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7d4109b40 0x7fa7d419fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38600/0 (socket says 172.21.15.44:38600) 2024-05-03T22:44:50.080 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.078+0000 7fa7d3400700 1 -- 172.21.15.44:0/2797523722 learned_addr learned my addr 172.21.15.44:0/2797523722 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.078+0000 7fa7d3e00700 1 --2- 172.21.15.44:0/2797523722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d410b6e0 0x7fa7d41a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.078+0000 7fa7d2a00700 1 --2- 172.21.15.44:0/2797523722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7d410ad40 0x7fa7d41a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.079+0000 7fa7d3400700 1 -- 172.21.15.44:0/2797523722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7d410ad40 msgr2=0x7fa7d41a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.079+0000 7fa7d3400700 1 --2- 172.21.15.44:0/2797523722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7d410ad40 0x7fa7d41a0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.079+0000 7fa7d3400700 1 -- 172.21.15.44:0/2797523722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d410b6e0 msgr2=0x7fa7d41a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.079+0000 7fa7d3400700 1 --2- 172.21.15.44:0/2797523722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d410b6e0 0x7fa7d41a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:50.081 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.079+0000 7fa7d3400700 1 -- 172.21.15.44:0/2797523722 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d41a7940 con 0x7fa7d4109b40 2024-05-03T22:44:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.079+0000 7fa7d3400700 1 --2- 172.21.15.44:0/2797523722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7d4109b40 0x7fa7d419fcf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400d980 tx=0x7fa7c400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.079+0000 7fa7cbe00700 1 -- 172.21.15.44:0/2797523722 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4017030 con 0x7fa7d4109b40 2024-05-03T22:44:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.079+0000 7fa7cbe00700 1 -- 172.21.15.44:0/2797523722 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fa7c40044f0 con 0x7fa7d4109b40 2024-05-03T22:44:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.079+0000 7fa7cbe00700 1 -- 172.21.15.44:0/2797523722 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4003b40 con 0x7fa7d4109b40 2024-05-03T22:44:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.080+0000 7fa7da400700 1 -- 172.21.15.44:0/2797523722 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d41a7bd0 con 0x7fa7d4109b40 2024-05-03T22:44:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.080+0000 7fa7da400700 1 -- 172.21.15.44:0/2797523722 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d41a80c0 con 0x7fa7d4109b40 2024-05-03T22:44:50.082 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.081+0000 7fa7da400700 1 -- 172.21.15.44:0/2797523722 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7d406a190 con 0x7fa7d4109b40 2024-05-03T22:44:50.084 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.083+0000 7fa7cbe00700 1 -- 172.21.15.44:0/2797523722 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa7c401a070 con 0x7fa7d4109b40 2024-05-03T22:44:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.085+0000 7fa7cbe00700 1 --2- 172.21.15.44:0/2797523722 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa7b80b2990 0x7fa7b80b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.085+0000 7fa7cbe00700 1 -- 172.21.15.44:0/2797523722 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fa7c40e2530 con 0x7fa7d4109b40 2024-05-03T22:44:50.086 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.085+0000 7fa7d2a00700 1 --2- 172.21.15.44:0/2797523722 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa7b80b2990 0x7fa7b80b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:50.087 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.086+0000 7fa7d2a00700 1 --2- 172.21.15.44:0/2797523722 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa7b80b2990 0x7fa7b80b4e50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0005950 tx=0x7fa7c0005eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:50.088 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.087+0000 7fa7cbe00700 1 -- 172.21.15.44:0/2797523722 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa7c40a9d00 con 0x7fa7d4109b40 2024-05-03T22:44:50.337 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.336+0000 7fa7da400700 1 -- 172.21.15.44:0/2797523722 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fa7d40638e0 con 0x7fa7b80b2990 2024-05-03T22:44:50.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.340+0000 7fa7cbe00700 1 -- 172.21.15.44:0/2797523722 <== mgr.14152 v2:172.21.15.44:6800/1796677758 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fa7d40638e0 con 0x7fa7b80b2990 2024-05-03T22:44:50.342 INFO:teuthology.orchestra.run.smithi044.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-03T22:44:50.342 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331001K400BGN 372G No 7m ago Has a FileSystem, LVM detected 2024-05-03T22:44:50.342 INFO:teuthology.orchestra.run.smithi044.stdout:smithi060 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476008A480DGN 447G No 6m ago Has a FileSystem, LVM detected 2024-05-03T22:44:50.342 INFO:teuthology.orchestra.run.smithi044.stdout:smithi160 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JY400BGN 372G No 6m ago Has a FileSystem, LVM detected 2024-05-03T22:44:50.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.344+0000 7fa7da400700 1 -- 172.21.15.44:0/2797523722 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa7b80b2990 msgr2=0x7fa7b80b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:50.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.344+0000 7fa7da400700 1 --2- 172.21.15.44:0/2797523722 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa7b80b2990 0x7fa7b80b4e50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0005950 tx=0x7fa7c0005eb0 comp rx=0 tx=0).stop 2024-05-03T22:44:50.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.344+0000 7fa7da400700 1 -- 172.21.15.44:0/2797523722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7d4109b40 msgr2=0x7fa7d419fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:50.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.344+0000 7fa7da400700 1 --2- 172.21.15.44:0/2797523722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7d4109b40 0x7fa7d419fcf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400d980 tx=0x7fa7c400dd40 comp rx=0 tx=0).stop 2024-05-03T22:44:50.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.344+0000 7fa7da400700 1 -- 172.21.15.44:0/2797523722 shutdown_connections 2024-05-03T22:44:50.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.344+0000 7fa7da400700 1 --2- 172.21.15.44:0/2797523722 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7d410b6e0 0x7fa7d41a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:50.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.344+0000 7fa7da400700 1 --2- 172.21.15.44:0/2797523722 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa7d4109b40 0x7fa7d419fcf0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:50.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.344+0000 7fa7da400700 1 --2- 172.21.15.44:0/2797523722 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa7b80b2990 0x7fa7b80b4e50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:50.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.344+0000 7fa7da400700 1 --2- 172.21.15.44:0/2797523722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7d410ad40 0x7fa7d41a0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:50.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.344+0000 7fa7da400700 1 -- 172.21.15.44:0/2797523722 >> 172.21.15.44:0/2797523722 conn(0x7fa7d4078b10 msgr2=0x7fa7d410df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:50.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.344+0000 7fa7da400700 1 -- 172.21.15.44:0/2797523722 shutdown_connections 2024-05-03T22:44:50.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:50.344+0000 7fa7da400700 1 -- 172.21.15.44:0/2797523722 wait complete. 2024-05-03T22:44:50.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:50 smithi044 ceph-mon[28604]: pgmap v519: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:44:50.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:50 smithi060 ceph-mon[31721]: pgmap v519: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:44:50.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:50 smithi160 ceph-mon[32531]: pgmap v519: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:44:51.480 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:51 smithi044 ceph-mon[28604]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:44:51.484 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-03T22:44:51.494 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi044.front.sepia.ceph.com 2024-05-03T22:44:51.494 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-03T22:44:51.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:51 smithi060 ceph-mon[31721]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:44:51.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:51 smithi160 ceph-mon[32531]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:44:51.956 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:44:52.457 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:52 smithi044 ceph-mon[28604]: pgmap v520: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:44:52.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:52 smithi060 ceph-mon[31721]: pgmap v520: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:44:52.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:52 smithi160 ceph-mon[32531]: pgmap v520: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:44:54.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.246+0000 7ff480200700 1 -- 172.21.15.44:0/2893541748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4781072e0 msgr2=0x7ff47810db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:54.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.246+0000 7ff480200700 1 --2- 172.21.15.44:0/2893541748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4781072e0 0x7ff47810db90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff47000b0d0 tx=0x7ff47000b3e0 comp rx=0 tx=0).stop 2024-05-03T22:44:54.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.246+0000 7ff480200700 1 -- 172.21.15.44:0/2893541748 shutdown_connections 2024-05-03T22:44:54.248 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.246+0000 7ff480200700 1 --2- 172.21.15.44:0/2893541748 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff4781072e0 0x7ff47810db90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.246+0000 7ff480200700 1 --2- 172.21.15.44:0/2893541748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff478105740 0x7ff478105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.246+0000 7ff480200700 1 --2- 172.21.15.44:0/2893541748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff478106940 0x7ff478106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.246+0000 7ff480200700 1 -- 172.21.15.44:0/2893541748 >> 172.21.15.44:0/2893541748 conn(0x7ff478100d00 msgr2=0x7ff478103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.246+0000 7ff480200700 1 -- 172.21.15.44:0/2893541748 shutdown_connections 2024-05-03T22:44:54.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.246+0000 7ff480200700 1 -- 172.21.15.44:0/2893541748 wait complete. 2024-05-03T22:44:54.249 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:54 smithi044 ceph-mon[28604]: pgmap v521: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:54.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.247+0000 7ff480200700 1 Processor -- start 2024-05-03T22:44:54.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.248+0000 7ff480200700 1 -- start start 2024-05-03T22:44:54.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.248+0000 7ff480200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff478105740 0x7ff47819b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:54.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.248+0000 7ff480200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff478106940 0x7ff47819bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:54.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.248+0000 7ff480200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4781072e0 0x7ff4781a2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:54.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.248+0000 7ff480200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff478111320 con 0x7ff478105740 2024-05-03T22:44:54.251 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.248+0000 7ff480200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff4781111a0 con 0x7ff4781072e0 2024-05-03T22:44:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.248+0000 7ff480200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff4781114a0 con 0x7ff478106940 2024-05-03T22:44:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.248+0000 7ff47d800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff478105740 0x7ff47819b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.248+0000 7ff47d800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff478105740 0x7ff47819b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38622/0 (socket says 172.21.15.44:38622) 2024-05-03T22:44:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.248+0000 7ff47d800700 1 -- 172.21.15.44:0/3683054242 learned_addr learned my addr 172.21.15.44:0/3683054242 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.249+0000 7ff47ce00700 1 --2- 172.21.15.44:0/3683054242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff478106940 0x7ff47819bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.249+0000 7ff47e200700 1 --2- 172.21.15.44:0/3683054242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4781072e0 0x7ff4781a2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.249+0000 7ff47d800700 1 -- 172.21.15.44:0/3683054242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff478106940 msgr2=0x7ff47819bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.249+0000 7ff47d800700 1 --2- 172.21.15.44:0/3683054242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff478106940 0x7ff47819bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.249+0000 7ff47d800700 1 -- 172.21.15.44:0/3683054242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4781072e0 msgr2=0x7ff4781a2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.249+0000 7ff47d800700 1 --2- 172.21.15.44:0/3683054242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4781072e0 0x7ff4781a2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.249+0000 7ff47d800700 1 -- 172.21.15.44:0/3683054242 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4781a3500 con 0x7ff478105740 2024-05-03T22:44:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.249+0000 7ff47d800700 1 --2- 172.21.15.44:0/3683054242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff478105740 0x7ff47819b8a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff46c00e9a0 tx=0x7ff46c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.250+0000 7ff476000700 1 -- 172.21.15.44:0/3683054242 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46c00cbd0 con 0x7ff478105740 2024-05-03T22:44:54.252 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.250+0000 7ff476000700 1 -- 172.21.15.44:0/3683054242 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7ff46c0044f0 con 0x7ff478105740 2024-05-03T22:44:54.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.250+0000 7ff480200700 1 -- 172.21.15.44:0/3683054242 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4781a37f0 con 0x7ff478105740 2024-05-03T22:44:54.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.250+0000 7ff476000700 1 -- 172.21.15.44:0/3683054242 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46c010430 con 0x7ff478105740 2024-05-03T22:44:54.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.250+0000 7ff480200700 1 -- 172.21.15.44:0/3683054242 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4781a3d30 con 0x7ff478105740 2024-05-03T22:44:54.253 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.251+0000 7ff480200700 1 -- 172.21.15.44:0/3683054242 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff47806a190 con 0x7ff478105740 2024-05-03T22:44:54.255 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.253+0000 7ff476000700 1 -- 172.21.15.44:0/3683054242 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff46c003ef0 con 0x7ff478105740 2024-05-03T22:44:54.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.255+0000 7ff476000700 1 --2- 172.21.15.44:0/3683054242 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff4600b2990 0x7ff4600b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:54.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.255+0000 7ff476000700 1 -- 172.21.15.44:0/3683054242 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7ff46c0e2b70 con 0x7ff478105740 2024-05-03T22:44:54.256 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.255+0000 7ff47ce00700 1 --2- 172.21.15.44:0/3683054242 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff4600b2990 0x7ff4600b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:54.257 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.256+0000 7ff47ce00700 1 --2- 172.21.15.44:0/3683054242 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff4600b2990 0x7ff4600b4e50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff464009bf0 tx=0x7ff464009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:54.261 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.260+0000 7ff476000700 1 -- 172.21.15.44:0/3683054242 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff46c0aa2c0 con 0x7ff478105740 2024-05-03T22:44:54.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:54 smithi060 ceph-mon[31721]: pgmap v521: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:54.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:54 smithi160 ceph-mon[32531]: pgmap v521: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:54.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.547+0000 7ff480200700 1 -- 172.21.15.44:0/3683054242 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff47802e5b0 con 0x7ff478105740 2024-05-03T22:44:54.549 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.548+0000 7ff476000700 1 -- 172.21.15.44:0/3683054242 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) ==== 76+0+3092 (secure 0 0 0) 0x7ff46c0a9bc0 con 0x7ff478105740 2024-05-03T22:44:54.551 INFO:teuthology.orchestra.run.smithi044.stdout:e30 2024-05-03T22:44:54.551 INFO:teuthology.orchestra.run.smithi044.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-03T22:44:54.551 INFO:teuthology.orchestra.run.smithi044.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-03T22:44:54.551 INFO:teuthology.orchestra.run.smithi044.stdout:legacy client fscid: 1 2024-05-03T22:44:54.551 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:44:54.551 INFO:teuthology.orchestra.run.smithi044.stdout:Filesystem 'cephfs' (1) 2024-05-03T22:44:54.551 INFO:teuthology.orchestra.run.smithi044.stdout:fs_name cephfs 2024-05-03T22:44:54.551 INFO:teuthology.orchestra.run.smithi044.stdout:epoch 30 2024-05-03T22:44:54.551 INFO:teuthology.orchestra.run.smithi044.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-03T22:44:54.551 INFO:teuthology.orchestra.run.smithi044.stdout:created 2024-05-03T22:40:14.758857+0000 2024-05-03T22:44:54.551 INFO:teuthology.orchestra.run.smithi044.stdout:modified 2024-05-03T22:41:47.427474+0000 2024-05-03T22:44:54.552 INFO:teuthology.orchestra.run.smithi044.stdout:tableserver 0 2024-05-03T22:44:54.552 INFO:teuthology.orchestra.run.smithi044.stdout:root 0 2024-05-03T22:44:54.552 INFO:teuthology.orchestra.run.smithi044.stdout:session_timeout 300 2024-05-03T22:44:54.552 INFO:teuthology.orchestra.run.smithi044.stdout:session_autoclose 300 2024-05-03T22:44:54.552 INFO:teuthology.orchestra.run.smithi044.stdout:max_file_size 1099511627776 2024-05-03T22:44:54.552 INFO:teuthology.orchestra.run.smithi044.stdout:max_xattr_size 65536 2024-05-03T22:44:54.552 INFO:teuthology.orchestra.run.smithi044.stdout:required_client_features {} 2024-05-03T22:44:54.552 INFO:teuthology.orchestra.run.smithi044.stdout:last_failure 0 2024-05-03T22:44:54.552 INFO:teuthology.orchestra.run.smithi044.stdout:last_failure_osd_epoch 0 2024-05-03T22:44:54.552 INFO:teuthology.orchestra.run.smithi044.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-03T22:44:54.552 INFO:teuthology.orchestra.run.smithi044.stdout:max_mds 5 2024-05-03T22:44:54.552 INFO:teuthology.orchestra.run.smithi044.stdout:in 0,1,2,3,4 2024-05-03T22:44:54.552 INFO:teuthology.orchestra.run.smithi044.stdout:up {0=34463,1=34427,2=34409,3=34391,4=24493} 2024-05-03T22:44:54.552 INFO:teuthology.orchestra.run.smithi044.stdout:failed 2024-05-03T22:44:54.552 INFO:teuthology.orchestra.run.smithi044.stdout:damaged 2024-05-03T22:44:54.553 INFO:teuthology.orchestra.run.smithi044.stdout:stopped 2024-05-03T22:44:54.553 INFO:teuthology.orchestra.run.smithi044.stdout:data_pools [3,4] 2024-05-03T22:44:54.553 INFO:teuthology.orchestra.run.smithi044.stdout:metadata_pool 2 2024-05-03T22:44:54.553 INFO:teuthology.orchestra.run.smithi044.stdout:inline_data disabled 2024-05-03T22:44:54.553 INFO:teuthology.orchestra.run.smithi044.stdout:balancer 2024-05-03T22:44:54.553 INFO:teuthology.orchestra.run.smithi044.stdout:bal_rank_mask -1 2024-05-03T22:44:54.553 INFO:teuthology.orchestra.run.smithi044.stdout:standby_count_wanted 0 2024-05-03T22:44:54.553 INFO:teuthology.orchestra.run.smithi044.stdout:qdb_cluster leader: 34463 members: 34463,34427,34409,24493,34391 2024-05-03T22:44:54.553 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.b{0:34463} state up:active seq 7 addr [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:44:54.553 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.c{0:24478} state up:standby-replay seq 1 addr [v2:172.21.15.160:6836/3735287805,v1:172.21.15.160:6837/3735287805] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:44:54.553 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.h{1:34427} state up:active seq 33 addr [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:44:54.553 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.f{1:24469} state up:standby-replay seq 1 addr [v2:172.21.15.160:6834/1332937382,v1:172.21.15.160:6835/1332937382] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:44:54.553 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.e{2:34409} state up:active seq 36 addr [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:44:54.553 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.l{2:24424} state up:standby-replay seq 1 addr [v2:172.21.15.160:6832/2022701378,v1:172.21.15.160:6833/2022701378] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:44:54.554 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.k{3:34391} state up:active seq 41 addr [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:44:54.554 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.a{3:14607} state up:standby-replay seq 1 addr [v2:172.21.15.44:6840/4262223160,v1:172.21.15.44:6841/4262223160] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:44:54.554 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.i{4:24493} state up:active seq 33 addr [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:44:54.554 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.g{4:14595} state up:standby-replay seq 1 addr [v2:172.21.15.44:6838/1408147232,v1:172.21.15.44:6839/1408147232] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:44:54.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:44:54.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:44:54.554 INFO:teuthology.orchestra.run.smithi044.stdout:Standby daemons: 2024-05-03T22:44:54.554 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:44:54.554 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.j{-1:14532} state up:standby seq 1 addr [v2:172.21.15.44:6834/2550955759,v1:172.21.15.44:6835/2550955759] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:44:54.554 INFO:teuthology.orchestra.run.smithi044.stdout:[mds.d{-1:14544} state up:standby seq 1 addr [v2:172.21.15.44:6836/3118490782,v1:172.21.15.44:6837/3118490782] compat {c=[1],r=[1],i=[1fff]}] 2024-05-03T22:44:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.553+0000 7ff480200700 1 -- 172.21.15.44:0/3683054242 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff4600b2990 msgr2=0x7ff4600b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.553+0000 7ff480200700 1 --2- 172.21.15.44:0/3683054242 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff4600b2990 0x7ff4600b4e50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff464009bf0 tx=0x7ff464009260 comp rx=0 tx=0).stop 2024-05-03T22:44:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.553+0000 7ff480200700 1 -- 172.21.15.44:0/3683054242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff478105740 msgr2=0x7ff47819b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.553+0000 7ff480200700 1 --2- 172.21.15.44:0/3683054242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff478105740 0x7ff47819b8a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff46c00e9a0 tx=0x7ff46c00ed60 comp rx=0 tx=0).stop 2024-05-03T22:44:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.553+0000 7ff480200700 1 -- 172.21.15.44:0/3683054242 shutdown_connections 2024-05-03T22:44:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.553+0000 7ff480200700 1 --2- 172.21.15.44:0/3683054242 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4781072e0 0x7ff4781a2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.553+0000 7ff480200700 1 --2- 172.21.15.44:0/3683054242 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff478105740 0x7ff47819b8a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.553+0000 7ff480200700 1 --2- 172.21.15.44:0/3683054242 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff4600b2990 0x7ff4600b4e50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.553+0000 7ff480200700 1 --2- 172.21.15.44:0/3683054242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff478106940 0x7ff47819bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:54.555 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.553+0000 7ff480200700 1 -- 172.21.15.44:0/3683054242 >> 172.21.15.44:0/3683054242 conn(0x7ff478100d00 msgr2=0x7ff478109c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:54.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.554+0000 7ff480200700 1 -- 172.21.15.44:0/3683054242 shutdown_connections 2024-05-03T22:44:54.556 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:54.554+0000 7ff480200700 1 -- 172.21.15.44:0/3683054242 wait complete. 2024-05-03T22:44:54.556 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 30 2024-05-03T22:44:55.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:55 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3683054242' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-03T22:44:55.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:55 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3683054242' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-03T22:44:55.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:55 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3683054242' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-03T22:44:55.534 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-03T22:44:56.015 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:44:56.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:56 smithi044 ceph-mon[28604]: pgmap v522: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:44:56.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:56 smithi060 ceph-mon[31721]: pgmap v522: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:44:56.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:56 smithi160 ceph-mon[32531]: pgmap v522: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:44:58.314 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:58 smithi044 ceph-mon[28604]: pgmap v523: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:58.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.489+0000 7f71c0e00700 1 -- 172.21.15.44:0/2839398830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71bc1072b0 msgr2=0x7f71bc10db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:58.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.489+0000 7f71c0e00700 1 --2- 172.21.15.44:0/2839398830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71bc1072b0 0x7f71bc10db60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f71b400b0d0 tx=0x7f71b400b3e0 comp rx=0 tx=0).stop 2024-05-03T22:44:58.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.490+0000 7f71c0e00700 1 -- 172.21.15.44:0/2839398830 shutdown_connections 2024-05-03T22:44:58.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.490+0000 7f71c0e00700 1 --2- 172.21.15.44:0/2839398830 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71bc1072b0 0x7f71bc10db60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:58.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.490+0000 7f71c0e00700 1 --2- 172.21.15.44:0/2839398830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71bc105710 0x7f71bc105b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:58.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.490+0000 7f71c0e00700 1 --2- 172.21.15.44:0/2839398830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc106910 0x7f71bc106d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:58.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.490+0000 7f71c0e00700 1 -- 172.21.15.44:0/2839398830 >> 172.21.15.44:0/2839398830 conn(0x7f71bc100cb0 msgr2=0x7f71bc1030f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:58.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.490+0000 7f71c0e00700 1 -- 172.21.15.44:0/2839398830 shutdown_connections 2024-05-03T22:44:58.492 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.490+0000 7f71c0e00700 1 -- 172.21.15.44:0/2839398830 wait complete. 2024-05-03T22:44:58.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.491+0000 7f71c0e00700 1 Processor -- start 2024-05-03T22:44:58.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.491+0000 7f71c0e00700 1 -- start start 2024-05-03T22:44:58.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.491+0000 7f71c0e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc105710 0x7f71bc19b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:58.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.491+0000 7f71c0e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71bc106910 0x7f71bc19bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:58.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.491+0000 7f71c0e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71bc1072b0 0x7f71bc1a2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:58.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.491+0000 7f71c0e00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc1112d0 con 0x7f71bc1072b0 2024-05-03T22:44:58.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.491+0000 7f71c0e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc111150 con 0x7f71bc106910 2024-05-03T22:44:58.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.491+0000 7f71c0e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc111450 con 0x7f71bc105710 2024-05-03T22:44:58.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.492+0000 7f71ba800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71bc1072b0 0x7f71bc1a2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:58.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.492+0000 7f71ba800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71bc1072b0 0x7f71bc1a2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38650/0 (socket says 172.21.15.44:38650) 2024-05-03T22:44:58.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.492+0000 7f71ba800700 1 -- 172.21.15.44:0/1487487247 learned_addr learned my addr 172.21.15.44:0/1487487247 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:44:58.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.492+0000 7f71b9e00700 1 --2- 172.21.15.44:0/1487487247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc105710 0x7f71bc19b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:58.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.492+0000 7f71b9400700 1 --2- 172.21.15.44:0/1487487247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71bc106910 0x7f71bc19bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:58.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.492+0000 7f71ba800700 1 -- 172.21.15.44:0/1487487247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc105710 msgr2=0x7f71bc19b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:58.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.492+0000 7f71ba800700 1 --2- 172.21.15.44:0/1487487247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc105710 0x7f71bc19b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:58.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.492+0000 7f71ba800700 1 -- 172.21.15.44:0/1487487247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71bc106910 msgr2=0x7f71bc19bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:58.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.492+0000 7f71ba800700 1 --2- 172.21.15.44:0/1487487247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71bc106910 0x7f71bc19bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:58.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.492+0000 7f71ba800700 1 -- 172.21.15.44:0/1487487247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71bc1a34c0 con 0x7f71bc1072b0 2024-05-03T22:44:58.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.492+0000 7f71ba800700 1 --2- 172.21.15.44:0/1487487247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71bc1072b0 0x7f71bc1a2e20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f71b4007d40 tx=0x7f71b4007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:58.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.493+0000 7f71b2a00700 1 -- 172.21.15.44:0/1487487247 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4021020 con 0x7f71bc1072b0 2024-05-03T22:44:58.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.493+0000 7f71b2a00700 1 -- 172.21.15.44:0/1487487247 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f71b401d940 con 0x7f71bc1072b0 2024-05-03T22:44:58.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.493+0000 7f71c0e00700 1 -- 172.21.15.44:0/1487487247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71bc1a3750 con 0x7f71bc1072b0 2024-05-03T22:44:58.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.493+0000 7f71b2a00700 1 -- 172.21.15.44:0/1487487247 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4005620 con 0x7f71bc1072b0 2024-05-03T22:44:58.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.493+0000 7f71c0e00700 1 -- 172.21.15.44:0/1487487247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71bc1a3ba0 con 0x7f71bc1072b0 2024-05-03T22:44:58.496 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.494+0000 7f71c0e00700 1 -- 172.21.15.44:0/1487487247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71bc06a190 con 0x7f71bc1072b0 2024-05-03T22:44:58.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.497+0000 7f71b2a00700 1 -- 172.21.15.44:0/1487487247 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f71b4024020 con 0x7f71bc1072b0 2024-05-03T22:44:58.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.499+0000 7f71b2a00700 1 --2- 172.21.15.44:0/1487487247 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f71a00b2910 0x7f71a00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:44:58.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.499+0000 7f71b2a00700 1 -- 172.21.15.44:0/1487487247 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f71b400f020 con 0x7f71bc1072b0 2024-05-03T22:44:58.501 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.500+0000 7f71b9e00700 1 --2- 172.21.15.44:0/1487487247 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f71a00b2910 0x7f71a00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:44:58.502 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.501+0000 7f71b9e00700 1 --2- 172.21.15.44:0/1487487247 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f71a00b2910 0x7f71a00b4dd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f71ac005950 tx=0x7f71ac0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:44:58.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:58 smithi060 ceph-mon[31721]: pgmap v523: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:58.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.505+0000 7f71b2a00700 1 -- 172.21.15.44:0/1487487247 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f71b40ab490 con 0x7f71bc1072b0 2024-05-03T22:44:58.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:58 smithi160 ceph-mon[32531]: pgmap v523: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:44:58.746 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.744+0000 7f71c0e00700 1 -- 172.21.15.44:0/1487487247 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f71bc0640b0 con 0x7f71bc1072b0 2024-05-03T22:44:58.748 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.747+0000 7f71b2a00700 1 -- 172.21.15.44:0/1487487247 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v89) ==== 56+0+5736 (secure 0 0 0) 0x7f71b40aad90 con 0x7f71bc1072b0 2024-05-03T22:44:58.750 INFO:teuthology.orchestra.run.smithi044.stdout:epoch 89 2024-05-03T22:44:58.750 INFO:teuthology.orchestra.run.smithi044.stdout:fsid 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T22:44:58.750 INFO:teuthology.orchestra.run.smithi044.stdout:created 2024-05-03T22:28:49.471963+0000 2024-05-03T22:44:58.751 INFO:teuthology.orchestra.run.smithi044.stdout:modified 2024-05-03T22:42:11.407700+0000 2024-05-03T22:44:58.751 INFO:teuthology.orchestra.run.smithi044.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-03T22:44:58.751 INFO:teuthology.orchestra.run.smithi044.stdout:crush_version 27 2024-05-03T22:44:58.751 INFO:teuthology.orchestra.run.smithi044.stdout:full_ratio 0.95 2024-05-03T22:44:58.751 INFO:teuthology.orchestra.run.smithi044.stdout:backfillfull_ratio 0.9 2024-05-03T22:44:58.751 INFO:teuthology.orchestra.run.smithi044.stdout:nearfull_ratio 0.85 2024-05-03T22:44:58.751 INFO:teuthology.orchestra.run.smithi044.stdout:require_min_compat_client luminous 2024-05-03T22:44:58.751 INFO:teuthology.orchestra.run.smithi044.stdout:min_compat_client luminous 2024-05-03T22:44:58.751 INFO:teuthology.orchestra.run.smithi044.stdout:require_osd_release squid 2024-05-03T22:44:58.751 INFO:teuthology.orchestra.run.smithi044.stdout:stretch_mode_enabled false 2024-05-03T22:44:58.751 INFO:teuthology.orchestra.run.smithi044.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-03T22:44:58.751 INFO:teuthology.orchestra.run.smithi044.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-05-03T22:44:58.752 INFO:teuthology.orchestra.run.smithi044.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-05-03T22:44:58.752 INFO:teuthology.orchestra.run.smithi044.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-05-03T22:44:58.752 INFO:teuthology.orchestra.run.smithi044.stdout:max_osd 12 2024-05-03T22:44:58.752 INFO:teuthology.orchestra.run.smithi044.stdout:osd.0 up in weight 1 up_from 8 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6802/4219032560,v1:172.21.15.44:6803/4219032560] [v2:172.21.15.44:6804/4219032560,v1:172.21.15.44:6805/4219032560] exists,up 05869397-bdc9-4c38-b1c6-deb466454dd3 2024-05-03T22:44:58.752 INFO:teuthology.orchestra.run.smithi044.stdout:osd.1 up in weight 1 up_from 13 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6800/563003638,v1:172.21.15.60:6801/563003638] [v2:172.21.15.60:6802/563003638,v1:172.21.15.60:6803/563003638] exists,up ff61ca27-e36b-41c9-898f-1cd7af1d9db5 2024-05-03T22:44:58.752 INFO:teuthology.orchestra.run.smithi044.stdout:osd.2 up in weight 1 up_from 18 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6800/2524540447,v1:172.21.15.160:6801/2524540447] [v2:172.21.15.160:6802/2524540447,v1:172.21.15.160:6803/2524540447] exists,up e58f96dc-3486-452e-85a1-847a0e2c523a 2024-05-03T22:44:58.752 INFO:teuthology.orchestra.run.smithi044.stdout:osd.3 up in weight 1 up_from 25 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6810/3298926279,v1:172.21.15.44:6811/3298926279] [v2:172.21.15.44:6812/3298926279,v1:172.21.15.44:6813/3298926279] exists,up 75c56c3b-5807-4646-885c-1ef16541ff72 2024-05-03T22:44:58.752 INFO:teuthology.orchestra.run.smithi044.stdout:osd.4 up in weight 1 up_from 31 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6808/3794821539,v1:172.21.15.60:6809/3794821539] [v2:172.21.15.60:6810/3794821539,v1:172.21.15.60:6811/3794821539] exists,up a8a322e4-6ca1-4727-8b41-5ff523acc591 2024-05-03T22:44:58.752 INFO:teuthology.orchestra.run.smithi044.stdout:osd.5 up in weight 1 up_from 36 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6808/429142335,v1:172.21.15.160:6809/429142335] [v2:172.21.15.160:6810/429142335,v1:172.21.15.160:6811/429142335] exists,up bc718527-bacd-4d1b-90c6-758cbd859e86 2024-05-03T22:44:58.752 INFO:teuthology.orchestra.run.smithi044.stdout:osd.6 up in weight 1 up_from 42 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6818/2805326764,v1:172.21.15.44:6819/2805326764] [v2:172.21.15.44:6820/2805326764,v1:172.21.15.44:6821/2805326764] exists,up f95a1d05-a958-4e5c-a90a-6b0c3d9fad43 2024-05-03T22:44:58.752 INFO:teuthology.orchestra.run.smithi044.stdout:osd.7 up in weight 1 up_from 47 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6816/693512829,v1:172.21.15.60:6817/693512829] [v2:172.21.15.60:6818/693512829,v1:172.21.15.60:6819/693512829] exists,up a515e4be-c607-4f4a-96bb-c3d395d7ecfe 2024-05-03T22:44:58.752 INFO:teuthology.orchestra.run.smithi044.stdout:osd.8 up in weight 1 up_from 53 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6816/2920554498,v1:172.21.15.160:6817/2920554498] [v2:172.21.15.160:6818/2920554498,v1:172.21.15.160:6819/2920554498] exists,up 717aeffb-6c51-4e4e-8344-fba70ac2c295 2024-05-03T22:44:58.753 INFO:teuthology.orchestra.run.smithi044.stdout:osd.9 up in weight 1 up_from 59 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.44:6826/414763386,v1:172.21.15.44:6827/414763386] [v2:172.21.15.44:6828/414763386,v1:172.21.15.44:6829/414763386] exists,up ade31284-1246-42c8-9cee-e60dacc58a8a 2024-05-03T22:44:58.753 INFO:teuthology.orchestra.run.smithi044.stdout:osd.10 up in weight 1 up_from 64 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6824/2396062554,v1:172.21.15.60:6825/2396062554] [v2:172.21.15.60:6826/2396062554,v1:172.21.15.60:6827/2396062554] exists,up e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf 2024-05-03T22:44:58.753 INFO:teuthology.orchestra.run.smithi044.stdout:osd.11 up in weight 1 up_from 70 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6824/1397967755,v1:172.21.15.160:6825/1397967755] [v2:172.21.15.160:6826/1397967755,v1:172.21.15.160:6827/1397967755] exists,up b6951585-9337-4b5a-a691-e765deb4b825 2024-05-03T22:44:58.753 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 2.0 [8,4] 2024-05-03T22:44:58.753 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 2.2 [7,11] 2024-05-03T22:44:58.753 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 2.6 [8,11] 2024-05-03T22:44:58.753 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 2.b [2,4] 2024-05-03T22:44:58.753 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 2.e [2,1] 2024-05-03T22:44:58.753 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 3.1 [4,9] 2024-05-03T22:44:58.753 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 3.18 [3,9] 2024-05-03T22:44:58.753 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 3.1a [5,6] 2024-05-03T22:44:58.753 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 3.21 [4,8] 2024-05-03T22:44:58.754 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 3.36 [4,9] 2024-05-03T22:44:58.754 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 3.37 [5,7] 2024-05-03T22:44:58.754 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 3.3a [4,6] 2024-05-03T22:44:58.754 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 4.6 [9,11] 2024-05-03T22:44:58.754 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 4.13 [9,8] 2024-05-03T22:44:58.754 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 4.1a [5,10] 2024-05-03T22:44:58.754 INFO:teuthology.orchestra.run.smithi044.stdout:pg_upmap_items 4.1b [9,8] 2024-05-03T22:44:58.754 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:6800/1309719283 expires 2024-05-04T22:30:08.766919+0000 2024-05-03T22:44:58.754 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:0/2661810503 expires 2024-05-04T22:30:08.766919+0000 2024-05-03T22:44:58.754 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:0/3426728285 expires 2024-05-04T22:29:32.846592+0000 2024-05-03T22:44:58.754 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:0/4246410673 expires 2024-05-04T22:29:32.846592+0000 2024-05-03T22:44:58.754 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:6801/1309719283 expires 2024-05-04T22:30:08.766919+0000 2024-05-03T22:44:58.754 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:0/2328074241 expires 2024-05-04T22:29:32.846592+0000 2024-05-03T22:44:58.755 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:0/1738155460 expires 2024-05-04T22:30:08.766919+0000 2024-05-03T22:44:58.755 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:0/3461866265 expires 2024-05-04T22:30:08.766919+0000 2024-05-03T22:44:58.755 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:6800/950841500 expires 2024-05-04T22:29:32.846592+0000 2024-05-03T22:44:58.755 INFO:teuthology.orchestra.run.smithi044.stdout:blocklist 172.21.15.44:6801/950841500 expires 2024-05-04T22:29:32.846592+0000 2024-05-03T22:44:58.755 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.750+0000 7f71c0e00700 1 -- 172.21.15.44:0/1487487247 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f71a00b2910 msgr2=0x7f71a00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:58.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.750+0000 7f71c0e00700 1 --2- 172.21.15.44:0/1487487247 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f71a00b2910 0x7f71a00b4dd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f71ac005950 tx=0x7f71ac0058e0 comp rx=0 tx=0).stop 2024-05-03T22:44:58.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.750+0000 7f71c0e00700 1 -- 172.21.15.44:0/1487487247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71bc1072b0 msgr2=0x7f71bc1a2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:44:58.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.751+0000 7f71c0e00700 1 --2- 172.21.15.44:0/1487487247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71bc1072b0 0x7f71bc1a2e20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f71b4007d40 tx=0x7f71b4007e20 comp rx=0 tx=0).stop 2024-05-03T22:44:58.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.751+0000 7f71c0e00700 1 -- 172.21.15.44:0/1487487247 shutdown_connections 2024-05-03T22:44:58.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.751+0000 7f71c0e00700 1 --2- 172.21.15.44:0/1487487247 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71bc1072b0 0x7f71bc1a2e20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:58.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.751+0000 7f71c0e00700 1 --2- 172.21.15.44:0/1487487247 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f71a00b2910 0x7f71a00b4dd0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:58.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.751+0000 7f71c0e00700 1 --2- 172.21.15.44:0/1487487247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71bc105710 0x7f71bc19b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:58.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.751+0000 7f71c0e00700 1 --2- 172.21.15.44:0/1487487247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71bc106910 0x7f71bc19bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:44:58.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.751+0000 7f71c0e00700 1 -- 172.21.15.44:0/1487487247 >> 172.21.15.44:0/1487487247 conn(0x7f71bc100cb0 msgr2=0x7f71bc109bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:44:58.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.751+0000 7f71c0e00700 1 -- 172.21.15.44:0/1487487247 shutdown_connections 2024-05-03T22:44:58.756 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:44:58.751+0000 7f71c0e00700 1 -- 172.21.15.44:0/1487487247 wait complete. 2024-05-03T22:44:59.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:44:59 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1487487247' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-03T22:44:59.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:44:59 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1487487247' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-03T22:44:59.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:44:59 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1487487247' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-03T22:44:59.725 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-03T22:44:59.739 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:45:00.198 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:45:00.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:00 smithi044 ceph-mon[28604]: pgmap v524: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:45:00.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:00 smithi060 ceph-mon[31721]: pgmap v524: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:45:00.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:00 smithi160 ceph-mon[32531]: pgmap v524: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:45:02.352 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:02 smithi044 ceph-mon[28604]: pgmap v525: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:45:02.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:02 smithi060 ceph-mon[31721]: pgmap v525: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:45:02.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:02 smithi160 ceph-mon[32531]: pgmap v525: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:45:02.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.644+0000 7f65c3e00700 1 -- 172.21.15.44:0/2774884618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65c40779d0 msgr2=0x7f65c4077db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:02.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.644+0000 7f65c3e00700 1 --2- 172.21.15.44:0/2774884618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65c40779d0 0x7f65c4077db0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f65b4009990 tx=0x7f65b4009ca0 comp rx=0 tx=0).stop 2024-05-03T22:45:02.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.644+0000 7f65c3e00700 1 -- 172.21.15.44:0/2774884618 shutdown_connections 2024-05-03T22:45:02.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.644+0000 7f65c3e00700 1 --2- 172.21.15.44:0/2774884618 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65c4114250 0x7f65c4116640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:02.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.644+0000 7f65c3e00700 1 --2- 172.21.15.44:0/2774884618 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65c40779d0 0x7f65c4077db0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:02.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.644+0000 7f65c3e00700 1 --2- 172.21.15.44:0/2774884618 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65c40782f0 0x7f65c4113d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:02.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.644+0000 7f65c3e00700 1 -- 172.21.15.44:0/2774884618 >> 172.21.15.44:0/2774884618 conn(0x7f65c4101080 msgr2=0x7f65c41034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:02.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.644+0000 7f65c3e00700 1 -- 172.21.15.44:0/2774884618 shutdown_connections 2024-05-03T22:45:02.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.644+0000 7f65c3e00700 1 -- 172.21.15.44:0/2774884618 wait complete. 2024-05-03T22:45:02.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.645+0000 7f65c3e00700 1 Processor -- start 2024-05-03T22:45:02.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.646+0000 7f65c3e00700 1 -- start start 2024-05-03T22:45:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.646+0000 7f65c3e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65c40779d0 0x7f65c41a0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.646+0000 7f65c3e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65c40782f0 0x7f65c41a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.646+0000 7f65c3e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65c4114250 0x7f65c41a49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.646+0000 7f65c3e00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f65c4119d50 con 0x7f65c40782f0 2024-05-03T22:45:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.646+0000 7f65c3e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f65c4119bd0 con 0x7f65c4114250 2024-05-03T22:45:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.646+0000 7f65c3e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f65c4119ed0 con 0x7f65c40779d0 2024-05-03T22:45:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.646+0000 7f65c2000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65c40782f0 0x7f65c41a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.647+0000 7f65c2000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65c40782f0 0x7f65c41a0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38162/0 (socket says 172.21.15.44:38162) 2024-05-03T22:45:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.647+0000 7f65c2000700 1 -- 172.21.15.44:0/1178312350 learned_addr learned my addr 172.21.15.44:0/1178312350 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.647+0000 7f65c2a00700 1 --2- 172.21.15.44:0/1178312350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65c40779d0 0x7f65c41a0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.647+0000 7f65c3400700 1 --2- 172.21.15.44:0/1178312350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65c4114250 0x7f65c41a49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.647+0000 7f65c2000700 1 -- 172.21.15.44:0/1178312350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65c40779d0 msgr2=0x7f65c41a0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:02.650 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.647+0000 7f65c2000700 1 --2- 172.21.15.44:0/1178312350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65c40779d0 0x7f65c41a0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.647+0000 7f65c2000700 1 -- 172.21.15.44:0/1178312350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65c4114250 msgr2=0x7f65c41a49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.647+0000 7f65c2000700 1 --2- 172.21.15.44:0/1178312350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65c4114250 0x7f65c41a49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.647+0000 7f65c2000700 1 -- 172.21.15.44:0/1178312350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c41a5110 con 0x7f65c40782f0 2024-05-03T22:45:02.651 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.647+0000 7f65c2a00700 1 --2- 172.21.15.44:0/1178312350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65c40779d0 0x7f65c41a0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:45:02.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.647+0000 7f65c2000700 1 --2- 172.21.15.44:0/1178312350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65c40782f0 0x7f65c41a0640 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f65b000c9b0 tx=0x7f65b000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:02.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.648+0000 7f65bb400700 1 -- 172.21.15.44:0/1178312350 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b0007b00 con 0x7f65c40782f0 2024-05-03T22:45:02.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.648+0000 7f65bb400700 1 -- 172.21.15.44:0/1178312350 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f65b0007ca0 con 0x7f65c40782f0 2024-05-03T22:45:02.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.648+0000 7f65c3e00700 1 -- 172.21.15.44:0/1178312350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65c41a5400 con 0x7f65c40782f0 2024-05-03T22:45:02.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.648+0000 7f65bb400700 1 -- 172.21.15.44:0/1178312350 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65b00187c0 con 0x7f65c40782f0 2024-05-03T22:45:02.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.648+0000 7f65c3e00700 1 -- 172.21.15.44:0/1178312350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65c41acc80 con 0x7f65c40782f0 2024-05-03T22:45:02.652 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.649+0000 7f65c3e00700 1 -- 172.21.15.44:0/1178312350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65c406a190 con 0x7f65c40782f0 2024-05-03T22:45:02.655 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.652+0000 7f65bb400700 1 -- 172.21.15.44:0/1178312350 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f65b000f450 con 0x7f65c40782f0 2024-05-03T22:45:02.656 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.654+0000 7f65bb400700 1 --2- 172.21.15.44:0/1178312350 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f65a80b2990 0x7f65a80b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:02.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.654+0000 7f65bb400700 1 -- 172.21.15.44:0/1178312350 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f65b00e2b20 con 0x7f65c40782f0 2024-05-03T22:45:02.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.654+0000 7f65c2a00700 1 --2- 172.21.15.44:0/1178312350 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f65a80b2990 0x7f65a80b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:02.657 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.655+0000 7f65c2a00700 1 --2- 172.21.15.44:0/1178312350 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f65a80b2990 0x7f65a80b4e50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f65b4006010 tx=0x7f65b400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:02.658 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.656+0000 7f65bb400700 1 -- 172.21.15.44:0/1178312350 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f65b0014030 con 0x7f65c40782f0 2024-05-03T22:45:02.950 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.947+0000 7f65c3e00700 1 -- 172.21.15.44:0/1178312350 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65c41a1460 con 0x7f65c40782f0 2024-05-03T22:45:02.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.950+0000 7f65bb400700 1 -- 172.21.15.44:0/1178312350 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11932 (secure 0 0 0) 0x7f65c41a1460 con 0x7f65c40782f0 2024-05-03T22:45:02.953 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:45:02.953 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2550955759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2550955759},{"type":"v1","addr":"172.21.15.44:6835","nonce":2550955759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3118490782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3118490782},{"type":"v1","addr":"172.21.15.44:6837","nonce":3118490782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T22:40:14.758857+0000","modified":"2024-05-03T22:41:47.427474+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34463,"mds_1":34427,"mds_2":34409,"mds_3":34391,"mds_4":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/1408147232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1408147232},{"type":"v1","addr":"172.21.15.44:6839","nonce":1408147232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14607":{"gid":14607,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/4262223160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":4262223160},{"type":"v1","addr":"172.21.15.44:6841","nonce":4262223160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/1332937382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1332937382},{"type":"v1","addr":"172.21.15.160:6835","nonce":1332937382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/3735287805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3735287805},{"type":"v1","addr":"172.21.15.160:6837","nonce":3735287805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.160:6839/861756806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":861756806},{"type":"v1","addr":"172.21.15.160:6839","nonce":861756806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34391":{"gid":34391,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":41,"addr":"172.21.15.60:6833/153110190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":153110190},{"type":"v1","addr":"172.21.15.60:6833","nonce":153110190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.60:6835/3390425489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3390425489},{"type":"v1","addr":"172.21.15.60:6835","nonce":3390425489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.60:6837/3568217572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3568217572},{"type":"v1","addr":"172.21.15.60:6837","nonce":3568217572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.60:6839/2420093605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2420093605},{"type":"v1","addr":"172.21.15.60:6839","nonce":2420093605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34463,"qdb_cluster":[34463,34427,34409,24493,34391]},"id":1}]} 2024-05-03T22:45:02.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.953+0000 7f65c3e00700 1 -- 172.21.15.44:0/1178312350 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f65a80b2990 msgr2=0x7f65a80b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:02.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.953+0000 7f65c3e00700 1 --2- 172.21.15.44:0/1178312350 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f65a80b2990 0x7f65a80b4e50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f65b4006010 tx=0x7f65b400b540 comp rx=0 tx=0).stop 2024-05-03T22:45:02.955 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.953+0000 7f65c3e00700 1 -- 172.21.15.44:0/1178312350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65c40782f0 msgr2=0x7f65c41a0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:02.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.953+0000 7f65c3e00700 1 --2- 172.21.15.44:0/1178312350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65c40782f0 0x7f65c41a0640 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f65b000c9b0 tx=0x7f65b000cd70 comp rx=0 tx=0).stop 2024-05-03T22:45:02.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.953+0000 7f65c3e00700 1 -- 172.21.15.44:0/1178312350 shutdown_connections 2024-05-03T22:45:02.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.953+0000 7f65c3e00700 1 --2- 172.21.15.44:0/1178312350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65c4114250 0x7f65c41a49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:02.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.953+0000 7f65c3e00700 1 --2- 172.21.15.44:0/1178312350 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f65a80b2990 0x7f65a80b4e50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:02.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.953+0000 7f65c3e00700 1 --2- 172.21.15.44:0/1178312350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65c40779d0 0x7f65c41a0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:02.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.953+0000 7f65c3e00700 1 --2- 172.21.15.44:0/1178312350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f65c40782f0 0x7f65c41a0640 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:02.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.953+0000 7f65c3e00700 1 -- 172.21.15.44:0/1178312350 >> 172.21.15.44:0/1178312350 conn(0x7f65c4101080 msgr2=0x7f65c4103470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:02.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.954+0000 7f65c3e00700 1 -- 172.21.15.44:0/1178312350 shutdown_connections 2024-05-03T22:45:02.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:02.954+0000 7f65c3e00700 1 -- 172.21.15.44:0/1178312350 wait complete. 2024-05-03T22:45:02.957 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 30 2024-05-03T22:45:03.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:03 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1178312350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:45:03.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:03 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1178312350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:45:03.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:03 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1178312350' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:45:03.904 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T22:45:04.358 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:45:04.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:04 smithi160 ceph-mon[32531]: pgmap v526: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:04.575 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:04 smithi044 ceph-mon[28604]: pgmap v526: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:04.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:04 smithi060 ceph-mon[31721]: pgmap v526: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:06.479 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:06 smithi044 ceph-mon[28604]: pgmap v527: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:45:06.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:06 smithi160 ceph-mon[32531]: pgmap v527: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:45:06.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:06 smithi060 ceph-mon[31721]: pgmap v527: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:45:06.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.794+0000 7ff66bc00700 1 -- 172.21.15.44:0/3777768369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66406b180 msgr2=0x7ff66406b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:06.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.794+0000 7ff66bc00700 1 --2- 172.21.15.44:0/3777768369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66406b180 0x7ff66406b600 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff650009990 tx=0x7ff650009ca0 comp rx=0 tx=0).stop 2024-05-03T22:45:06.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.794+0000 7ff66bc00700 1 -- 172.21.15.44:0/3777768369 shutdown_connections 2024-05-03T22:45:06.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.794+0000 7ff66bc00700 1 --2- 172.21.15.44:0/3777768369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff66406bb40 0x7ff664110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:06.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.794+0000 7ff66bc00700 1 --2- 172.21.15.44:0/3777768369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff664109510 0x7ff6641098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:06.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.794+0000 7ff66bc00700 1 --2- 172.21.15.44:0/3777768369 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66406b180 0x7ff66406b600 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:06.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.794+0000 7ff66bc00700 1 -- 172.21.15.44:0/3777768369 >> 172.21.15.44:0/3777768369 conn(0x7ff664079350 msgr2=0x7ff664079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:06.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.794+0000 7ff66bc00700 1 -- 172.21.15.44:0/3777768369 shutdown_connections 2024-05-03T22:45:06.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.794+0000 7ff66bc00700 1 -- 172.21.15.44:0/3777768369 wait complete. 2024-05-03T22:45:06.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.796+0000 7ff66bc00700 1 Processor -- start 2024-05-03T22:45:06.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.796+0000 7ff66bc00700 1 -- start start 2024-05-03T22:45:06.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.796+0000 7ff66bc00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66406b180 0x7ff664102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:06.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.796+0000 7ff66bc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff66406bb40 0x7ff6641029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:06.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.796+0000 7ff66bc00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff664109510 0x7ff664102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:06.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.796+0000 7ff66bc00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7ff6641137d0 con 0x7ff66406b180 2024-05-03T22:45:06.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.796+0000 7ff66bc00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff664113650 con 0x7ff66406bb40 2024-05-03T22:45:06.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.796+0000 7ff66bc00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff664113950 con 0x7ff664109510 2024-05-03T22:45:06.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.797+0000 7ff669200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66406b180 0x7ff664102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:06.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.797+0000 7ff669200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66406b180 0x7ff664102470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:38184/0 (socket says 172.21.15.44:38184) 2024-05-03T22:45:06.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.797+0000 7ff669200700 1 -- 172.21.15.44:0/2941267075 learned_addr learned my addr 172.21.15.44:0/2941267075 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:06.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.797+0000 7ff663e00700 1 --2- 172.21.15.44:0/2941267075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff66406bb40 0x7ff6641029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:06.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.797+0000 7ff669c00700 1 --2- 172.21.15.44:0/2941267075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff664109510 0x7ff664102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:06.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.797+0000 7ff669200700 1 -- 172.21.15.44:0/2941267075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff664109510 msgr2=0x7ff664102ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:06.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.797+0000 7ff669200700 1 --2- 172.21.15.44:0/2941267075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff664109510 0x7ff664102ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:06.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.797+0000 7ff669200700 1 -- 172.21.15.44:0/2941267075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff66406bb40 msgr2=0x7ff6641029b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:06.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.797+0000 7ff669200700 1 --2- 172.21.15.44:0/2941267075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff66406bb40 0x7ff6641029b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:06.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.797+0000 7ff669200700 1 -- 172.21.15.44:0/2941267075 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6641a81d0 con 0x7ff66406b180 2024-05-03T22:45:06.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.798+0000 7ff669200700 1 --2- 172.21.15.44:0/2941267075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66406b180 0x7ff664102470 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff65800d980 tx=0x7ff65800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:06.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.798+0000 7ff661600700 1 -- 172.21.15.44:0/2941267075 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658017070 con 0x7ff66406b180 2024-05-03T22:45:06.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.798+0000 7ff661600700 1 -- 172.21.15.44:0/2941267075 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7ff658004d00 con 0x7ff66406b180 2024-05-03T22:45:06.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.798+0000 7ff66bc00700 1 -- 172.21.15.44:0/2941267075 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6641a84c0 con 0x7ff66406b180 2024-05-03T22:45:06.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.798+0000 7ff661600700 1 -- 172.21.15.44:0/2941267075 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff658005540 con 0x7ff66406b180 2024-05-03T22:45:06.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.798+0000 7ff66bc00700 1 -- 172.21.15.44:0/2941267075 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6641a89b0 con 0x7ff66406b180 2024-05-03T22:45:06.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.800+0000 7ff66bc00700 1 -- 172.21.15.44:0/2941267075 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff66410b9f0 con 0x7ff66406b180 2024-05-03T22:45:06.806 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.804+0000 7ff661600700 1 -- 172.21.15.44:0/2941267075 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7ff658004750 con 0x7ff66406b180 2024-05-03T22:45:06.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.805+0000 7ff661600700 1 --2- 172.21.15.44:0/2941267075 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff64c0b2910 0x7ff64c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:06.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.806+0000 7ff661600700 1 -- 172.21.15.44:0/2941267075 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7ff6580e2b60 con 0x7ff66406b180 2024-05-03T22:45:06.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.806+0000 7ff663e00700 1 --2- 172.21.15.44:0/2941267075 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff64c0b2910 0x7ff64c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:06.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.807+0000 7ff663e00700 1 --2- 172.21.15.44:0/2941267075 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff64c0b2910 0x7ff64c0b4dd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff65000b5c0 tx=0x7ff650005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:06.811 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:06.808+0000 7ff661600700 1 -- 172.21.15.44:0/2941267075 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7ff658020020 con 0x7ff66406b180 2024-05-03T22:45:07.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:07.097+0000 7ff66bc00700 1 -- 172.21.15.44:0/2941267075 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff66406a190 con 0x7ff66406b180 2024-05-03T22:45:07.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:07.098+0000 7ff661600700 1 -- 172.21.15.44:0/2941267075 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11932 (secure 0 0 0) 0x7ff6580aa2b0 con 0x7ff66406b180 2024-05-03T22:45:07.101 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:45:07.101 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2550955759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2550955759},{"type":"v1","addr":"172.21.15.44:6835","nonce":2550955759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3118490782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3118490782},{"type":"v1","addr":"172.21.15.44:6837","nonce":3118490782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T22:40:14.758857+0000","modified":"2024-05-03T22:41:47.427474+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34463,"mds_1":34427,"mds_2":34409,"mds_3":34391,"mds_4":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/1408147232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1408147232},{"type":"v1","addr":"172.21.15.44:6839","nonce":1408147232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14607":{"gid":14607,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/4262223160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":4262223160},{"type":"v1","addr":"172.21.15.44:6841","nonce":4262223160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/1332937382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1332937382},{"type":"v1","addr":"172.21.15.160:6835","nonce":1332937382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/3735287805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3735287805},{"type":"v1","addr":"172.21.15.160:6837","nonce":3735287805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.160:6839/861756806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":861756806},{"type":"v1","addr":"172.21.15.160:6839","nonce":861756806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34391":{"gid":34391,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":41,"addr":"172.21.15.60:6833/153110190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":153110190},{"type":"v1","addr":"172.21.15.60:6833","nonce":153110190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.60:6835/3390425489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3390425489},{"type":"v1","addr":"172.21.15.60:6835","nonce":3390425489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.60:6837/3568217572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3568217572},{"type":"v1","addr":"172.21.15.60:6837","nonce":3568217572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.60:6839/2420093605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2420093605},{"type":"v1","addr":"172.21.15.60:6839","nonce":2420093605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34463,"qdb_cluster":[34463,34427,34409,24493,34391]},"id":1}]} 2024-05-03T22:45:07.103 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:07.101+0000 7ff66bc00700 1 -- 172.21.15.44:0/2941267075 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff64c0b2910 msgr2=0x7ff64c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:07.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:07.101+0000 7ff66bc00700 1 --2- 172.21.15.44:0/2941267075 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff64c0b2910 0x7ff64c0b4dd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff65000b5c0 tx=0x7ff650005fd0 comp rx=0 tx=0).stop 2024-05-03T22:45:07.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:07.101+0000 7ff66bc00700 1 -- 172.21.15.44:0/2941267075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66406b180 msgr2=0x7ff664102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:07.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:07.101+0000 7ff66bc00700 1 --2- 172.21.15.44:0/2941267075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66406b180 0x7ff664102470 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff65800d980 tx=0x7ff65800dd40 comp rx=0 tx=0).stop 2024-05-03T22:45:07.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:07.102+0000 7ff66bc00700 1 -- 172.21.15.44:0/2941267075 shutdown_connections 2024-05-03T22:45:07.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:07.102+0000 7ff66bc00700 1 --2- 172.21.15.44:0/2941267075 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7ff64c0b2910 0x7ff64c0b4dd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:07.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:07.102+0000 7ff66bc00700 1 --2- 172.21.15.44:0/2941267075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff664109510 0x7ff664102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:07.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:07.102+0000 7ff66bc00700 1 --2- 172.21.15.44:0/2941267075 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7ff66406b180 0x7ff664102470 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:07.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:07.102+0000 7ff66bc00700 1 --2- 172.21.15.44:0/2941267075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff66406bb40 0x7ff6641029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:07.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:07.102+0000 7ff66bc00700 1 -- 172.21.15.44:0/2941267075 >> 172.21.15.44:0/2941267075 conn(0x7ff664079350 msgr2=0x7ff664100fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:07.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:07.103+0000 7ff66bc00700 1 -- 172.21.15.44:0/2941267075 shutdown_connections 2024-05-03T22:45:07.106 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:07.103+0000 7ff66bc00700 1 -- 172.21.15.44:0/2941267075 wait complete. 2024-05-03T22:45:07.106 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 30 2024-05-03T22:45:07.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:07 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2941267075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:45:07.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:07 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2941267075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:45:07.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:07 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2941267075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T22:45:08.042 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T22:45:08.489 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:45:08.643 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:08 smithi044 ceph-mon[28604]: pgmap v528: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:08.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:08 smithi060 ceph-mon[31721]: pgmap v528: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:08.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:08 smithi160 ceph-mon[32531]: pgmap v528: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:10.391 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:10 smithi044 ceph-mon[28604]: pgmap v529: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:45:10.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.687+0000 7fb46d000700 1 -- 172.21.15.44:0/2947520898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46810b6c0 msgr2=0x7fb46810baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:10.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.687+0000 7fb46d000700 1 --2- 172.21.15.44:0/2947520898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46810b6c0 0x7fb46810baa0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb458009990 tx=0x7fb458009ca0 comp rx=0 tx=0).stop 2024-05-03T22:45:10.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.687+0000 7fb46d000700 1 -- 172.21.15.44:0/2947520898 shutdown_connections 2024-05-03T22:45:10.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.687+0000 7fb46d000700 1 --2- 172.21.15.44:0/2947520898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb468106080 0x7fb468112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:10.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.687+0000 7fb46d000700 1 --2- 172.21.15.44:0/2947520898 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46810b6c0 0x7fb46810baa0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:10.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.687+0000 7fb46d000700 1 --2- 172.21.15.44:0/2947520898 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4681056c0 0x7fb468105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:10.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.687+0000 7fb46d000700 1 -- 172.21.15.44:0/2947520898 >> 172.21.15.44:0/2947520898 conn(0x7fb4681011b0 msgr2=0x7fb4681035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:10.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.688+0000 7fb46d000700 1 -- 172.21.15.44:0/2947520898 shutdown_connections 2024-05-03T22:45:10.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.688+0000 7fb46d000700 1 -- 172.21.15.44:0/2947520898 wait complete. 2024-05-03T22:45:10.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.689+0000 7fb46d000700 1 Processor -- start 2024-05-03T22:45:10.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.689+0000 7fb46d000700 1 -- start start 2024-05-03T22:45:10.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.690+0000 7fb46d000700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4681056c0 0x7fb4680779b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:10.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.690+0000 7fb46d000700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb468106080 0x7fb468077ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:10.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.690+0000 7fb46d000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46810b6c0 0x7fb468078430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:10.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.690+0000 7fb46d000700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb4681159e0 con 0x7fb46810b6c0 2024-05-03T22:45:10.692 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.690+0000 7fb46d000700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb468115860 con 0x7fb4681056c0 2024-05-03T22:45:10.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.690+0000 7fb46d000700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb468115b60 con 0x7fb468106080 2024-05-03T22:45:10.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.690+0000 7fb466800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46810b6c0 0x7fb468078430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:10.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.690+0000 7fb466800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46810b6c0 0x7fb468078430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56466/0 (socket says 172.21.15.44:56466) 2024-05-03T22:45:10.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.690+0000 7fb466800700 1 -- 172.21.15.44:0/1118079669 learned_addr learned my addr 172.21.15.44:0/1118079669 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:10.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.690+0000 7fb465400700 1 --2- 172.21.15.44:0/1118079669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb468106080 0x7fb468077ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:10.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.691+0000 7fb465e00700 1 --2- 172.21.15.44:0/1118079669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4681056c0 0x7fb4680779b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:10.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.691+0000 7fb466800700 1 -- 172.21.15.44:0/1118079669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb468106080 msgr2=0x7fb468077ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:10.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.691+0000 7fb466800700 1 --2- 172.21.15.44:0/1118079669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb468106080 0x7fb468077ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:10.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.691+0000 7fb466800700 1 -- 172.21.15.44:0/1118079669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4681056c0 msgr2=0x7fb4680779b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:10.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.691+0000 7fb466800700 1 --2- 172.21.15.44:0/1118079669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4681056c0 0x7fb4680779b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:10.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.691+0000 7fb466800700 1 -- 172.21.15.44:0/1118079669 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4681ac4a0 con 0x7fb46810b6c0 2024-05-03T22:45:10.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.691+0000 7fb465400700 1 --2- 172.21.15.44:0/1118079669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb468106080 0x7fb468077ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:45:10.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.691+0000 7fb466800700 1 --2- 172.21.15.44:0/1118079669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46810b6c0 0x7fb468078430 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb460007ee0 tx=0x7fb46000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:10.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.692+0000 7fb45ea00700 1 -- 172.21.15.44:0/1118079669 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb46000dbd0 con 0x7fb46810b6c0 2024-05-03T22:45:10.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.692+0000 7fb45ea00700 1 -- 172.21.15.44:0/1118079669 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fb46000dd70 con 0x7fb46810b6c0 2024-05-03T22:45:10.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.692+0000 7fb46d000700 1 -- 172.21.15.44:0/1118079669 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4681ac790 con 0x7fb46810b6c0 2024-05-03T22:45:10.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.692+0000 7fb45ea00700 1 -- 172.21.15.44:0/1118079669 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4600133f0 con 0x7fb46810b6c0 2024-05-03T22:45:10.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.692+0000 7fb46d000700 1 -- 172.21.15.44:0/1118079669 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4681acc80 con 0x7fb46810b6c0 2024-05-03T22:45:10.696 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.693+0000 7fb46d000700 1 -- 172.21.15.44:0/1118079669 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb46810dc50 con 0x7fb46810b6c0 2024-05-03T22:45:10.698 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.696+0000 7fb45ea00700 1 -- 172.21.15.44:0/1118079669 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb46001a020 con 0x7fb46810b6c0 2024-05-03T22:45:10.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.697+0000 7fb45ea00700 1 --2- 172.21.15.44:0/1118079669 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb44c0b2910 0x7fb44c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:10.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.697+0000 7fb45ea00700 1 -- 172.21.15.44:0/1118079669 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fb4600e1fb0 con 0x7fb46810b6c0 2024-05-03T22:45:10.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.697+0000 7fb465e00700 1 --2- 172.21.15.44:0/1118079669 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb44c0b2910 0x7fb44c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:10.700 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.698+0000 7fb465e00700 1 --2- 172.21.15.44:0/1118079669 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb44c0b2910 0x7fb44c0b4dd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb458006010 tx=0x7fb45800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:10.704 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.702+0000 7fb45ea00700 1 -- 172.21.15.44:0/1118079669 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb460010070 con 0x7fb46810b6c0 2024-05-03T22:45:10.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:10 smithi060 ceph-mon[31721]: pgmap v529: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:45:10.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:10 smithi160 ceph-mon[32531]: pgmap v529: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:45:10.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.943+0000 7fb46d000700 1 -- 172.21.15.44:0/1118079669 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb46810d630 con 0x7fb46810b6c0 2024-05-03T22:45:10.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.945+0000 7fb45ea00700 1 -- 172.21.15.44:0/1118079669 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24819 (secure 0 0 0) 0x7fb4600a9700 con 0x7fb46810b6c0 2024-05-03T22:45:10.949 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T22:45:10.949 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":89,"fsid":"5b0efdca-099c-11ef-bc97-c7b262605968","created":"2024-05-03T22:28:49.471963+0000","modified":"2024-05-03T22:42:11.407700+0000","last_up_change":"2024-05-03T22:38:41.446244+0000","last_in_change":"2024-05-03T22:38:16.952689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:33:24.956832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:40:05.501996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:40:09.732161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:40:23.052845+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05869397-bdc9-4c38-b1c6-deb466454dd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6803","nonce":4219032560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6805","nonce":4219032560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6809","nonce":4219032560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6807","nonce":4219032560}]},"public_addr":"172.21.15.44:6803/4219032560","cluster_addr":"172.21.15.44:6805/4219032560","heartbeat_back_addr":"172.21.15.44:6809/4219032560","heartbeat_front_addr":"172.21.15.44:6807/4219032560","state":["exists","up"]},{"osd":1,"uuid":"ff61ca27-e36b-41c9-898f-1cd7af1d9db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6801","nonce":563003638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6803","nonce":563003638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6807","nonce":563003638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6805","nonce":563003638}]},"public_addr":"172.21.15.60:6801/563003638","cluster_addr":"172.21.15.60:6803/563003638","heartbeat_back_addr":"172.21.15.60:6807/563003638","heartbeat_front_addr":"172.21.15.60:6805/563003638","state":["exists","up"]},{"osd":2,"uuid":"e58f96dc-3486-452e-85a1-847a0e2c523a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6801","nonce":2524540447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6803","nonce":2524540447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6807","nonce":2524540447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6805","nonce":2524540447}]},"public_addr":"172.21.15.160:6801/2524540447","cluster_addr":"172.21.15.160:6803/2524540447","heartbeat_back_addr":"172.21.15.160:6807/2524540447","heartbeat_front_addr":"172.21.15.160:6805/2524540447","state":["exists","up"]},{"osd":3,"uuid":"75c56c3b-5807-4646-885c-1ef16541ff72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6811","nonce":3298926279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6813","nonce":3298926279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6817","nonce":3298926279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6815","nonce":3298926279}]},"public_addr":"172.21.15.44:6811/3298926279","cluster_addr":"172.21.15.44:6813/3298926279","heartbeat_back_addr":"172.21.15.44:6817/3298926279","heartbeat_front_addr":"172.21.15.44:6815/3298926279","state":["exists","up"]},{"osd":4,"uuid":"a8a322e4-6ca1-4727-8b41-5ff523acc591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6809","nonce":3794821539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6811","nonce":3794821539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6815","nonce":3794821539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6813","nonce":3794821539}]},"public_addr":"172.21.15.60:6809/3794821539","cluster_addr":"172.21.15.60:6811/3794821539","heartbeat_back_addr":"172.21.15.60:6815/3794821539","heartbeat_front_addr":"172.21.15.60:6813/3794821539","state":["exists","up"]},{"osd":5,"uuid":"bc718527-bacd-4d1b-90c6-758cbd859e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6809","nonce":429142335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6811","nonce":429142335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6815","nonce":429142335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6813","nonce":429142335}]},"public_addr":"172.21.15.160:6809/429142335","cluster_addr":"172.21.15.160:6811/429142335","heartbeat_back_addr":"172.21.15.160:6815/429142335","heartbeat_front_addr":"172.21.15.160:6813/429142335","state":["exists","up"]},{"osd":6,"uuid":"f95a1d05-a958-4e5c-a90a-6b0c3d9fad43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6819","nonce":2805326764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6821","nonce":2805326764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6825","nonce":2805326764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6823","nonce":2805326764}]},"public_addr":"172.21.15.44:6819/2805326764","cluster_addr":"172.21.15.44:6821/2805326764","heartbeat_back_addr":"172.21.15.44:6825/2805326764","heartbeat_front_addr":"172.21.15.44:6823/2805326764","state":["exists","up"]},{"osd":7,"uuid":"a515e4be-c607-4f4a-96bb-c3d395d7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6817","nonce":693512829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6819","nonce":693512829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6823","nonce":693512829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6821","nonce":693512829}]},"public_addr":"172.21.15.60:6817/693512829","cluster_addr":"172.21.15.60:6819/693512829","heartbeat_back_addr":"172.21.15.60:6823/693512829","heartbeat_front_addr":"172.21.15.60:6821/693512829","state":["exists","up"]},{"osd":8,"uuid":"717aeffb-6c51-4e4e-8344-fba70ac2c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6817","nonce":2920554498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6819","nonce":2920554498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6823","nonce":2920554498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6821","nonce":2920554498}]},"public_addr":"172.21.15.160:6817/2920554498","cluster_addr":"172.21.15.160:6819/2920554498","heartbeat_back_addr":"172.21.15.160:6823/2920554498","heartbeat_front_addr":"172.21.15.160:6821/2920554498","state":["exists","up"]},{"osd":9,"uuid":"ade31284-1246-42c8-9cee-e60dacc58a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6827","nonce":414763386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6829","nonce":414763386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6833","nonce":414763386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6831","nonce":414763386}]},"public_addr":"172.21.15.44:6827/414763386","cluster_addr":"172.21.15.44:6829/414763386","heartbeat_back_addr":"172.21.15.44:6833/414763386","heartbeat_front_addr":"172.21.15.44:6831/414763386","state":["exists","up"]},{"osd":10,"uuid":"e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6825","nonce":2396062554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6827","nonce":2396062554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6831","nonce":2396062554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6829","nonce":2396062554}]},"public_addr":"172.21.15.60:6825/2396062554","cluster_addr":"172.21.15.60:6827/2396062554","heartbeat_back_addr":"172.21.15.60:6831/2396062554","heartbeat_front_addr":"172.21.15.60:6829/2396062554","state":["exists","up"]},{"osd":11,"uuid":"b6951585-9337-4b5a-a691-e765deb4b825","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6825","nonce":1397967755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6827","nonce":1397967755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6831","nonce":1397967755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6829","nonce":1397967755}]},"public_addr":"172.21.15.160:6825/1397967755","cluster_addr":"172.21.15.160:6827/1397967755","heartbeat_back_addr":"172.21.15.160:6831/1397967755","heartbeat_front_addr":"172.21.15.160:6829/1397967755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:15.012060+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:48.390669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:21.227227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:56.388453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:34:31.079377+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:04.912058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:40.941904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:16.757849+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:51.591794+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:37:29.022917+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:05.506391+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:39.793901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2661810503":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3426728285":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/4246410673":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2328074241":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/1738155460":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3461866265":"2024-05-04T22:30:08.766919+0000","172.21.15.44:6800/950841500":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/950841500":"2024-05-04T22:29:32.846592+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T22:45:10.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.949+0000 7fb46d000700 1 -- 172.21.15.44:0/1118079669 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb44c0b2910 msgr2=0x7fb44c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:10.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.949+0000 7fb46d000700 1 --2- 172.21.15.44:0/1118079669 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb44c0b2910 0x7fb44c0b4dd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb458006010 tx=0x7fb45800b540 comp rx=0 tx=0).stop 2024-05-03T22:45:10.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.949+0000 7fb46d000700 1 -- 172.21.15.44:0/1118079669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46810b6c0 msgr2=0x7fb468078430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:10.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.949+0000 7fb46d000700 1 --2- 172.21.15.44:0/1118079669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46810b6c0 0x7fb468078430 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb460007ee0 tx=0x7fb46000d3b0 comp rx=0 tx=0).stop 2024-05-03T22:45:10.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.949+0000 7fb46d000700 1 -- 172.21.15.44:0/1118079669 shutdown_connections 2024-05-03T22:45:10.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.949+0000 7fb46d000700 1 --2- 172.21.15.44:0/1118079669 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb46810b6c0 0x7fb468078430 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:10.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.949+0000 7fb46d000700 1 --2- 172.21.15.44:0/1118079669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4681056c0 0x7fb4680779b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:10.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.949+0000 7fb46d000700 1 --2- 172.21.15.44:0/1118079669 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb44c0b2910 0x7fb44c0b4dd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:10.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.949+0000 7fb46d000700 1 --2- 172.21.15.44:0/1118079669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb468106080 0x7fb468077ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:10.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.949+0000 7fb46d000700 1 -- 172.21.15.44:0/1118079669 >> 172.21.15.44:0/1118079669 conn(0x7fb4681011b0 msgr2=0x7fb468101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:10.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.949+0000 7fb46d000700 1 -- 172.21.15.44:0/1118079669 shutdown_connections 2024-05-03T22:45:10.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:10.949+0000 7fb46d000700 1 -- 172.21.15.44:0/1118079669 wait complete. 2024-05-03T22:45:11.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:11 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1118079669' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:45:11.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:11 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1118079669' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:45:11.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:11 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1118079669' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T22:45:11.913 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-03T22:40:14.758857+0000', 'modified': '2024-05-03T22:41:47.427474+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 34463, 'mds_1': 34427, 'mds_2': 34409, 'mds_3': 34391, 'mds_4': 24493}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14595': {'gid': 14595, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6839/1408147232', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6838', 'nonce': 1408147232}, {'type': 'v1', 'addr': '172.21.15.44:6839', 'nonce': 1408147232}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14607': {'gid': 14607, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.44:6841/4262223160', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.44:6840', 'nonce': 4262223160}, {'type': 'v1', 'addr': '172.21.15.44:6841', 'nonce': 4262223160}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24424': {'gid': 24424, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6833/2022701378', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6832', 'nonce': 2022701378}, {'type': 'v1', 'addr': '172.21.15.160:6833', 'nonce': 2022701378}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6835/1332937382', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6834', 'nonce': 1332937382}, {'type': 'v1', 'addr': '172.21.15.160:6835', 'nonce': 1332937382}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24478': {'gid': 24478, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6837/3735287805', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6836', 'nonce': 3735287805}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 3735287805}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24493': {'gid': 24493, 'name': 'i', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 33, 'addr': '172.21.15.160:6839/861756806', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6838', 'nonce': 861756806}, {'type': 'v1', 'addr': '172.21.15.160:6839', 'nonce': 861756806}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34391': {'gid': 34391, 'name': 'k', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 41, 'addr': '172.21.15.60:6833/153110190', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6832', 'nonce': 153110190}, {'type': 'v1', 'addr': '172.21.15.60:6833', 'nonce': 153110190}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34409': {'gid': 34409, 'name': 'e', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 36, 'addr': '172.21.15.60:6835/3390425489', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6834', 'nonce': 3390425489}, {'type': 'v1', 'addr': '172.21.15.60:6835', 'nonce': 3390425489}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34427': {'gid': 34427, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 33, 'addr': '172.21.15.60:6837/3568217572', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 3568217572}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 3568217572}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34463': {'gid': 34463, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.60:6839/2420093605', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6838', 'nonce': 2420093605}, {'type': 'v1', 'addr': '172.21.15.60:6839', 'nonce': 2420093605}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34463, 'qdb_cluster': [34463, 34427, 34409, 24493, 34391]} 2024-05-03T22:45:11.913 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-03T22:45:11.914 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell mds.i status 2024-05-03T22:45:12.385 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:45:12.571 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:12 smithi044 ceph-mon[28604]: pgmap v530: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:45:12.657 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:12 smithi060 ceph-mon[31721]: pgmap v530: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:45:12.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:12 smithi160 ceph-mon[32531]: pgmap v530: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:45:14.482 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:14 smithi044 ceph-mon[28604]: pgmap v531: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:14.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:14 smithi060 ceph-mon[31721]: pgmap v531: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:14.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.757+0000 7f9b3bc00700 1 -- 172.21.15.44:0/3028320836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b34103550 msgr2=0x7f9b341039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:14.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.757+0000 7f9b3bc00700 1 --2- 172.21.15.44:0/3028320836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b34103550 0x7f9b341039b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9b20009990 tx=0x7f9b20009ca0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.757+0000 7f9b3bc00700 1 -- 172.21.15.44:0/3028320836 shutdown_connections 2024-05-03T22:45:14.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.757+0000 7f9b3bc00700 1 --2- 172.21.15.44:0/3028320836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b34103ef0 0x7f9b341103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.760 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.757+0000 7f9b3bc00700 1 --2- 172.21.15.44:0/3028320836 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b34108460 0x7f9b34108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.757+0000 7f9b3bc00700 1 --2- 172.21.15.44:0/3028320836 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b34103550 0x7f9b341039b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.757+0000 7f9b3bc00700 1 -- 172.21.15.44:0/3028320836 >> 172.21.15.44:0/3028320836 conn(0x7f9b3407a600 msgr2=0x7f9b3407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:14.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.757+0000 7f9b3bc00700 1 -- 172.21.15.44:0/3028320836 shutdown_connections 2024-05-03T22:45:14.761 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.757+0000 7f9b3bc00700 1 -- 172.21.15.44:0/3028320836 wait complete. 2024-05-03T22:45:14.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.758+0000 7f9b3bc00700 1 Processor -- start 2024-05-03T22:45:14.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.759+0000 7f9b3bc00700 1 -- start start 2024-05-03T22:45:14.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.759+0000 7f9b3bc00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b34103550 0x7f9b3419beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:14.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.759+0000 7f9b3bc00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b34103ef0 0x7f9b3419c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:14.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.759+0000 7f9b3bc00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b34108460 0x7f9b341a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:14.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.759+0000 7f9b3bc00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f9b34113840 con 0x7f9b34103ef0 2024-05-03T22:45:14.762 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.759+0000 7f9b3bc00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9b341136c0 con 0x7f9b34103550 2024-05-03T22:45:14.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.759+0000 7f9b3bc00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9b341139c0 con 0x7f9b34108460 2024-05-03T22:45:14.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.759+0000 7f9b33e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b34103ef0 0x7f9b3419c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:14.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.759+0000 7f9b33e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b34103ef0 0x7f9b3419c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56488/0 (socket says 172.21.15.44:56488) 2024-05-03T22:45:14.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.759+0000 7f9b33e00700 1 -- 172.21.15.44:0/1945678646 learned_addr learned my addr 172.21.15.44:0/1945678646 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:14.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.760+0000 7f9b39200700 1 --2- 172.21.15.44:0/1945678646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b34103550 0x7f9b3419beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:14.763 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.760+0000 7f9b39c00700 1 --2- 172.21.15.44:0/1945678646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b34108460 0x7f9b341a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:14.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.760+0000 7f9b33e00700 1 -- 172.21.15.44:0/1945678646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b34108460 msgr2=0x7f9b341a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:14.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.760+0000 7f9b33e00700 1 --2- 172.21.15.44:0/1945678646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b34108460 0x7f9b341a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.760+0000 7f9b33e00700 1 -- 172.21.15.44:0/1945678646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b34103550 msgr2=0x7f9b3419beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:14.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.760+0000 7f9b33e00700 1 --2- 172.21.15.44:0/1945678646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b34103550 0x7f9b3419beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.760+0000 7f9b33e00700 1 -- 172.21.15.44:0/1945678646 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b341a0ec0 con 0x7f9b34103ef0 2024-05-03T22:45:14.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.760+0000 7f9b33e00700 1 --2- 172.21.15.44:0/1945678646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b34103ef0 0x7f9b3419c3f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9b20000c00 tx=0x7f9b20005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:14.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.761+0000 7f9b31600700 1 -- 172.21.15.44:0/1945678646 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20027070 con 0x7f9b34103ef0 2024-05-03T22:45:14.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.761+0000 7f9b31600700 1 -- 172.21.15.44:0/1945678646 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f9b20003f70 con 0x7f9b34103ef0 2024-05-03T22:45:14.764 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.761+0000 7f9b3bc00700 1 -- 172.21.15.44:0/1945678646 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b341a1150 con 0x7f9b34103ef0 2024-05-03T22:45:14.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.761+0000 7f9b31600700 1 -- 172.21.15.44:0/1945678646 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20022df0 con 0x7f9b34103ef0 2024-05-03T22:45:14.765 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.761+0000 7f9b3bc00700 1 -- 172.21.15.44:0/1945678646 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b341a8a30 con 0x7f9b34103ef0 2024-05-03T22:45:14.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:14 smithi160 ceph-mon[32531]: pgmap v531: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:14.767 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.765+0000 7f9b31600700 1 -- 172.21.15.44:0/1945678646 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9b2002a070 con 0x7f9b34103ef0 2024-05-03T22:45:14.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.766+0000 7f9b465a0b80 1 Processor -- start 2024-05-03T22:45:14.768 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.766+0000 7f9b465a0b80 1 -- start start 2024-05-03T22:45:14.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.766+0000 7f9b465a0b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cc760 0x555e223ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:14.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.766+0000 7f9b465a0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223cd080 0x555e223c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:14.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.766+0000 7f9b465a0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223c8580 0x555e223c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:14.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.766+0000 7f9b465a0b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555e2231a9d0 con 0x555e223cc760 2024-05-03T22:45:14.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.766+0000 7f9b31600700 1 --2- 172.21.15.44:0/1945678646 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9b1c0b2910 0x7f9b1c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:14.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.766+0000 7f9b465a0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555e222b8710 con 0x555e223cd080 2024-05-03T22:45:14.769 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.766+0000 7f9b465a0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555e22316990 con 0x555e223c8580 2024-05-03T22:45:14.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.767+0000 7f9b31600700 1 -- 172.21.15.44:0/1945678646 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f9b200e35a0 con 0x7f9b34103ef0 2024-05-03T22:45:14.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.767+0000 7f9b39c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cc760 0x555e223ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:14.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.767+0000 7f9b39c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cc760 0x555e223ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56502/0 (socket says 172.21.15.44:56502) 2024-05-03T22:45:14.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.767+0000 7f9b39c00700 1 -- 172.21.15.44:0/1062926646 learned_addr learned my addr 172.21.15.44:0/1062926646 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:14.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.767+0000 7f9b39c00700 1 --2- 172.21.15.44:0/1945678646 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9b1c0b2910 0x7f9b1c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:14.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.767+0000 7f9b39200700 1 --2- 172.21.15.44:0/1062926646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223cd080 0x555e223c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:14.770 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.767+0000 7f9b33e00700 1 --2- 172.21.15.44:0/1062926646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223c8580 0x555e223c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:14.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.768+0000 7f9b39200700 1 -- 172.21.15.44:0/1062926646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223c8580 msgr2=0x555e223c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:14.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.768+0000 7f9b39200700 1 --2- 172.21.15.44:0/1062926646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223c8580 0x555e223c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.771 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.768+0000 7f9b39200700 1 -- 172.21.15.44:0/1062926646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cc760 msgr2=0x555e223ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:14.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.768+0000 7f9b39200700 1 --2- 172.21.15.44:0/1062926646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cc760 0x555e223ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.768+0000 7f9b39200700 1 -- 172.21.15.44:0/1062926646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e22267880 con 0x555e223cd080 2024-05-03T22:45:14.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.768+0000 7f9b39c00700 1 --2- 172.21.15.44:0/1062926646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cc760 0x555e223ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-03T22:45:14.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.768+0000 7f9b39c00700 1 --2- 172.21.15.44:0/1945678646 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9b1c0b2910 0x7f9b1c0b4dd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c007c20 tx=0x7f9b2c009990 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:14.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.768+0000 7f9b39200700 1 --2- 172.21.15.44:0/1062926646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223cd080 0x555e223c7f60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800dbe0 tx=0x7f9b2800def0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c6ce2c30f84063c server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:14.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.769+0000 7f9b26000700 1 -- 172.21.15.44:0/1062926646 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b28004220 con 0x555e223cd080 2024-05-03T22:45:14.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.769+0000 7f9b26000700 1 -- 172.21.15.44:0/1062926646 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f9b2800fde0 con 0x555e223cd080 2024-05-03T22:45:14.772 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.769+0000 7f9b26000700 1 -- 172.21.15.44:0/1062926646 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b28003e30 con 0x555e223cd080 2024-05-03T22:45:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.770+0000 7f9b465a0b80 1 -- 172.21.15.44:0/1062926646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223cd080 msgr2=0x555e223c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.770+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/1062926646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223cd080 0x555e223c7f60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9b2800dbe0 tx=0x7f9b2800def0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.770+0000 7f9b465a0b80 1 -- 172.21.15.44:0/1062926646 shutdown_connections 2024-05-03T22:45:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.770+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/1062926646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223c8580 0x555e223c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.770+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/1062926646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cc760 0x555e223ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.770+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/1062926646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223cd080 0x555e223c7f60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.770+0000 7f9b465a0b80 1 -- 172.21.15.44:0/1062926646 >> 172.21.15.44:0/1062926646 conn(0x555e222f6b10 msgr2=0x555e223c27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:14.773 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.770+0000 7f9b465a0b80 1 -- 172.21.15.44:0/1062926646 shutdown_connections 2024-05-03T22:45:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.770+0000 7f9b465a0b80 1 -- 172.21.15.44:0/1062926646 wait complete. 2024-05-03T22:45:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.771+0000 7f9b465a0b80 1 -- start start 2024-05-03T22:45:14.774 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.771+0000 7f9b465a0b80 1 Processor -- start 2024-05-03T22:45:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.771+0000 7f9b465a0b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223c8580 0x555e223d3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.771+0000 7f9b465a0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223cc760 0x555e223d1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.771+0000 7f9b465a0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223cd080 0x555e223d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.771+0000 7f9b465a0b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555e223d4c50 con 0x555e223c8580 2024-05-03T22:45:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.771+0000 7f9b465a0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555e22280ad0 con 0x555e223cc760 2024-05-03T22:45:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.771+0000 7f9b465a0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555e223d4dd0 con 0x555e223cd080 2024-05-03T22:45:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.772+0000 7f9b465a0b80 10 client.0 _ll_register_callbacks cb 0x555e222c1c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:45:14.775 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.772+0000 7f9b39200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223c8580 0x555e223d3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.772+0000 7f9b39200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223c8580 0x555e223d3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56504/0 (socket says 172.21.15.44:56504) 2024-05-03T22:45:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.772+0000 7f9b39200700 1 -- 172.21.15.44:0/2763562555 learned_addr learned my addr 172.21.15.44:0/2763562555 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.772+0000 7f9b33e00700 1 --2- 172.21.15.44:0/2763562555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223cc760 0x555e223d1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.772+0000 7f9b39c00700 1 --2- 172.21.15.44:0/2763562555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223cd080 0x555e223d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.772+0000 7f9b39200700 1 -- 172.21.15.44:0/2763562555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223cd080 msgr2=0x555e223d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.772+0000 7f9b39200700 1 --2- 172.21.15.44:0/2763562555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223cd080 0x555e223d1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.772+0000 7f9b39200700 1 -- 172.21.15.44:0/2763562555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223cc760 msgr2=0x555e223d1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.772+0000 7f9b39200700 1 --2- 172.21.15.44:0/2763562555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223cc760 0x555e223d1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.772+0000 7f9b39200700 1 -- 172.21.15.44:0/2763562555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e222e03d0 con 0x555e223c8580 2024-05-03T22:45:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.773+0000 7f9b39200700 1 --2- 172.21.15.44:0/2763562555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223c8580 0x555e223d3d90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9b28010010 tx=0x7f9b2800fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77e8911cabba535 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:14.776 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.773+0000 7f9b1aa00700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:45:14.777 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.773+0000 7f9b1aa00700 1 -- 172.21.15.44:0/2763562555 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2802b060 con 0x555e223c8580 2024-05-03T22:45:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.773+0000 7f9b1aa00700 1 -- 172.21.15.44:0/2763562555 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f9b2801b670 con 0x555e223c8580 2024-05-03T22:45:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.773+0000 7f9b465a0b80 1 -- 172.21.15.44:0/2763562555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b2800fde0 con 0x555e223c8580 2024-05-03T22:45:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.774+0000 7f9b1aa00700 1 -- 172.21.15.44:0/2763562555 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9b28032050 con 0x555e223c8580 2024-05-03T22:45:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.774+0000 7f9b465a0b80 10 client.15213 fetch_fsmap learned FSMap version 30 2024-05-03T22:45:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.774+0000 7f9b465a0b80 1 -- 172.21.15.44:0/2763562555 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555e223df380 con 0x555e223c8580 2024-05-03T22:45:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.774+0000 7f9b1aa00700 1 -- 172.21.15.44:0/2763562555 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f9b2800fde0 con 0x555e223c8580 2024-05-03T22:45:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.774+0000 7f9b1aa00700 1 -- 172.21.15.44:0/2763562555 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f9b280119a0 con 0x555e223c8580 2024-05-03T22:45:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.774+0000 7f9b465a0b80 10 client.15213 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:45:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.774+0000 7f9b465a0b80 10 client.15213 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-03T22:45:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.774+0000 7f9b465a0b80 20 client.15213 populate_metadata read hostname 'smithi044' 2024-05-03T22:45:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.774+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/2763562555 >> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] conn(0x555e223e1640 0x555e223e2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.774+0000 7f9b465a0b80 4 client.15213 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:45:14.778 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.774+0000 7f9b465a0b80 1 -- 172.21.15.44:0/2763562555 --> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e22395180 con 0x555e223e1640 2024-05-03T22:45:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.775+0000 7f9b33e00700 1 --2- 172.21.15.44:0/2763562555 >> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] conn(0x555e223e1640 0x555e223e2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.776+0000 7f9b33e00700 1 --2- 172.21.15.44:0/2763562555 >> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] conn(0x555e223e1640 0x555e223e2ab0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8e5bfaf538044763 server_cookie=c7afc320a9acae8 in_seq=0 out_seq=0 2024-05-03T22:45:14.779 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.776+0000 7f9b1aa00700 10 client.15213 ms_handle_connect on v2:172.21.15.160:6838/861756806 2024-05-03T22:45:14.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.778+0000 7f9b1aa00700 1 -- 172.21.15.44:0/2763562555 <== mds.4 v2:172.21.15.160:6838/861756806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555e22395180 con 0x555e223e1640 2024-05-03T22:45:14.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.778+0000 7f9b1aa00700 10 client.15213 handle_command_reply: tid=0 2024-05-03T22:45:14.780 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.778+0000 7f9b465a0b80 1 client.15213 shutdown 2024-05-03T22:45:14.781 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.778+0000 7f9b465a0b80 1 -- 172.21.15.44:0/2763562555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223c8580 msgr2=0x555e223d3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.778+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/2763562555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223c8580 0x555e223d3d90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9b28010010 tx=0x7f9b2800fb40 comp rx=0 tx=0).stop 2024-05-03T22:45:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.779+0000 7f9b465a0b80 1 -- 172.21.15.44:0/2763562555 shutdown_connections 2024-05-03T22:45:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.779+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/2763562555 >> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] conn(0x555e223e1640 0x555e223e2ab0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.779+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/2763562555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223cd080 0x555e223d1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.779+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/2763562555 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223c8580 0x555e223d3d90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.779+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/2763562555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223cc760 0x555e223d1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.779+0000 7f9b465a0b80 1 -- 172.21.15.44:0/2763562555 >> 172.21.15.44:0/2763562555 conn(0x555e222f6b10 msgr2=0x555e223cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.779+0000 7f9b1aa00700 0 client.15213 ms_handle_reset on v2:172.21.15.160:6838/861756806 2024-05-03T22:45:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.779+0000 7f9b465a0b80 1 -- 172.21.15.44:0/2763562555 shutdown_connections 2024-05-03T22:45:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.779+0000 7f9b465a0b80 1 -- 172.21.15.44:0/2763562555 wait complete. 2024-05-03T22:45:14.782 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.779+0000 7f9b465a0b80 20 client.15213 trim_cache size 0 max 16384 2024-05-03T22:45:14.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.802+0000 7f9b465a0b80 1 Processor -- start 2024-05-03T22:45:14.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.803+0000 7f9b465a0b80 1 -- start start 2024-05-03T22:45:14.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.803+0000 7f9b465a0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223c8580 0x555e223e07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:14.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.803+0000 7f9b465a0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223cc760 0x555e223d1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:14.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.803+0000 7f9b465a0b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cd080 0x555e223d3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:14.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.803+0000 7f9b465a0b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555e223e0df0 con 0x555e223cd080 2024-05-03T22:45:14.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.803+0000 7f9b465a0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555e223e14c0 con 0x555e223c8580 2024-05-03T22:45:14.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.803+0000 7f9b465a0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555e223e1b90 con 0x555e223cc760 2024-05-03T22:45:14.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.804+0000 7f9b39c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cd080 0x555e223d3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:14.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.804+0000 7f9b39c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cd080 0x555e223d3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56512/0 (socket says 172.21.15.44:56512) 2024-05-03T22:45:14.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.804+0000 7f9b39c00700 1 -- 172.21.15.44:0/2621757586 learned_addr learned my addr 172.21.15.44:0/2621757586 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:14.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.804+0000 7f9b33e00700 1 --2- 172.21.15.44:0/2621757586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223cc760 0x555e223d1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.804+0000 7f9b39200700 1 --2- 172.21.15.44:0/2621757586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223c8580 0x555e223e07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.804+0000 7f9b39c00700 1 -- 172.21.15.44:0/2621757586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223cc760 msgr2=0x555e223d1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.804+0000 7f9b39c00700 1 --2- 172.21.15.44:0/2621757586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223cc760 0x555e223d1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.804+0000 7f9b39c00700 1 -- 172.21.15.44:0/2621757586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223c8580 msgr2=0x555e223e07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.804+0000 7f9b39c00700 1 --2- 172.21.15.44:0/2621757586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223c8580 0x555e223e07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.804+0000 7f9b39c00700 1 -- 172.21.15.44:0/2621757586 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e223bd750 con 0x555e223cd080 2024-05-03T22:45:14.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.804+0000 7f9b39200700 1 --2- 172.21.15.44:0/2621757586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223c8580 0x555e223e07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:45:14.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.805+0000 7f9b39c00700 1 --2- 172.21.15.44:0/2621757586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cd080 0x555e223d3490 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0079e0 tx=0x7f9b2c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28435d0f9c188194 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:14.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.805+0000 7f9b25600700 1 -- 172.21.15.44:0/2621757586 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0076a0 con 0x555e223cd080 2024-05-03T22:45:14.812 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.805+0000 7f9b25600700 1 -- 172.21.15.44:0/2621757586 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f9b2c02a070 con 0x555e223cd080 2024-05-03T22:45:14.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.805+0000 7f9b25600700 1 -- 172.21.15.44:0/2621757586 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0257f0 con 0x555e223cd080 2024-05-03T22:45:14.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.806+0000 7f9b465a0b80 1 -- 172.21.15.44:0/2621757586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cd080 msgr2=0x555e223d3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:14.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.806+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/2621757586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cd080 0x555e223d3490 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0079e0 tx=0x7f9b2c011000 comp rx=0 tx=0).stop 2024-05-03T22:45:14.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.806+0000 7f9b465a0b80 1 -- 172.21.15.44:0/2621757586 shutdown_connections 2024-05-03T22:45:14.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.806+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/2621757586 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cd080 0x555e223d3490 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.806+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/2621757586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223c8580 0x555e223e07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.806+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/2621757586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223cc760 0x555e223d1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.806+0000 7f9b465a0b80 1 -- 172.21.15.44:0/2621757586 >> 172.21.15.44:0/2621757586 conn(0x555e222f6b10 msgr2=0x555e223cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:14.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.806+0000 7f9b465a0b80 1 -- 172.21.15.44:0/2621757586 shutdown_connections 2024-05-03T22:45:14.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.806+0000 7f9b465a0b80 1 -- 172.21.15.44:0/2621757586 wait complete. 2024-05-03T22:45:14.813 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.807+0000 7f9b465a0b80 1 -- start start 2024-05-03T22:45:14.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.807+0000 7f9b465a0b80 1 Processor -- start 2024-05-03T22:45:14.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.808+0000 7f9b465a0b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223c8580 0x555e223ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:14.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.808+0000 7f9b465a0b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cc760 0x555e223cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:14.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.808+0000 7f9b465a0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223cd080 0x555e223ec120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:14.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.808+0000 7f9b465a0b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x555e223e2930 con 0x555e223cc760 2024-05-03T22:45:14.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.808+0000 7f9b465a0b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555e223e2260 con 0x555e223c8580 2024-05-03T22:45:14.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.808+0000 7f9b465a0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555e223e3000 con 0x555e223cd080 2024-05-03T22:45:14.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.808+0000 7f9b465a0b80 10 client.0 _ll_register_callbacks cb 0x555e222c1c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:45:14.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.808+0000 7f9b33e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cc760 0x555e223cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:14.814 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.808+0000 7f9b33e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cc760 0x555e223cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56522/0 (socket says 172.21.15.44:56522) 2024-05-03T22:45:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.808+0000 7f9b33e00700 1 -- 172.21.15.44:0/3563353872 learned_addr learned my addr 172.21.15.44:0/3563353872 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.808+0000 7f9b39c00700 1 --2- 172.21.15.44:0/3563353872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223cd080 0x555e223ec120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.808+0000 7f9b39200700 1 --2- 172.21.15.44:0/3563353872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223c8580 0x555e223ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.808+0000 7f9b33e00700 1 -- 172.21.15.44:0/3563353872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223cd080 msgr2=0x555e223ec120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.808+0000 7f9b33e00700 1 --2- 172.21.15.44:0/3563353872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223cd080 0x555e223ec120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.808+0000 7f9b33e00700 1 -- 172.21.15.44:0/3563353872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223c8580 msgr2=0x555e223ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.808+0000 7f9b33e00700 1 --2- 172.21.15.44:0/3563353872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223c8580 0x555e223ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.808+0000 7f9b33e00700 1 -- 172.21.15.44:0/3563353872 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e223ec930 con 0x555e223cc760 2024-05-03T22:45:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.809+0000 7f9b33e00700 1 --2- 172.21.15.44:0/3563353872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cc760 0x555e223cee00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9b200aa380 tx=0x7f9b20009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba926da7dc737721 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.809+0000 7f9b1aa00700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:45:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.809+0000 7f9b1aa00700 1 -- 172.21.15.44:0/3563353872 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b200aad80 con 0x555e223cc760 2024-05-03T22:45:14.815 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.809+0000 7f9b465a0b80 1 -- 172.21.15.44:0/3563353872 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b2c02a070 con 0x555e223cc760 2024-05-03T22:45:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.809+0000 7f9b1aa00700 1 -- 172.21.15.44:0/3563353872 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f9b20022590 con 0x555e223cc760 2024-05-03T22:45:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.809+0000 7f9b1aa00700 1 -- 172.21.15.44:0/3563353872 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9b200aa190 con 0x555e223cc760 2024-05-03T22:45:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.809+0000 7f9b465a0b80 10 client.15219 fetch_fsmap learned FSMap version 30 2024-05-03T22:45:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.809+0000 7f9b465a0b80 1 -- 172.21.15.44:0/3563353872 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x555e2244cb10 con 0x555e223cc760 2024-05-03T22:45:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.810+0000 7f9b1aa00700 1 -- 172.21.15.44:0/3563353872 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f9b2c02a070 con 0x555e223cc760 2024-05-03T22:45:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.810+0000 7f9b1aa00700 1 -- 172.21.15.44:0/3563353872 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f9b200920b0 con 0x555e223cc760 2024-05-03T22:45:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.810+0000 7f9b465a0b80 10 client.15219 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:45:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.810+0000 7f9b465a0b80 10 client.15219 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-03T22:45:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.810+0000 7f9b465a0b80 20 client.15219 populate_metadata read hostname 'smithi044' 2024-05-03T22:45:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.810+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/3563353872 >> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] conn(0x555e22451680 0x555e22450390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.810+0000 7f9b465a0b80 4 client.15219 mds_command: new command op to 24493 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:45:14.816 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.810+0000 7f9b465a0b80 1 -- 172.21.15.44:0/3563353872 --> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] -- command(tid 0: {"prefix": "status"}) -- 0x555e223283b0 con 0x555e22451680 2024-05-03T22:45:14.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.811+0000 7f9b39200700 1 --2- 172.21.15.44:0/3563353872 >> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] conn(0x555e22451680 0x555e22450390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:14.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.812+0000 7f9b39200700 1 --2- 172.21.15.44:0/3563353872 >> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] conn(0x555e22451680 0x555e22450390 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=992c8ad791eed174 server_cookie=77395a9fcff5d4ca in_seq=0 out_seq=0 2024-05-03T22:45:14.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.812+0000 7f9b1aa00700 10 client.15219 ms_handle_connect on v2:172.21.15.160:6838/861756806 2024-05-03T22:45:14.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.812+0000 7f9b1aa00700 1 -- 172.21.15.44:0/3563353872 <== mds.4 v2:172.21.15.160:6838/861756806 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x555e223283b0 con 0x555e22451680 2024-05-03T22:45:14.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.812+0000 7f9b1aa00700 10 client.15219 handle_command_reply: tid=0 2024-05-03T22:45:14.818 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.812+0000 7f9b465a0b80 1 client.15219 shutdown 2024-05-03T22:45:14.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.812+0000 7f9b465a0b80 1 -- 172.21.15.44:0/3563353872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cc760 msgr2=0x555e223cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:14.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.812+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/3563353872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cc760 0x555e223cee00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9b200aa380 tx=0x7f9b20009ca0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.812+0000 7f9b465a0b80 1 -- 172.21.15.44:0/3563353872 shutdown_connections 2024-05-03T22:45:14.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.812+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/3563353872 >> [v2:172.21.15.160:6838/861756806,v1:172.21.15.160:6839/861756806] conn(0x555e22451680 0x555e22450390 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.812+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/3563353872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555e223cd080 0x555e223ec120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.812+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/3563353872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e223c8580 0x555e223ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.812+0000 7f9b465a0b80 1 --2- 172.21.15.44:0/3563353872 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x555e223cc760 0x555e223cee00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.812+0000 7f9b1aa00700 0 client.15219 ms_handle_reset on v2:172.21.15.160:6838/861756806 2024-05-03T22:45:14.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.812+0000 7f9b465a0b80 1 -- 172.21.15.44:0/3563353872 >> 172.21.15.44:0/3563353872 conn(0x555e222f6b10 msgr2=0x555e223cb3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:14.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.813+0000 7f9b465a0b80 1 -- 172.21.15.44:0/3563353872 shutdown_connections 2024-05-03T22:45:14.819 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.813+0000 7f9b465a0b80 1 -- 172.21.15.44:0/3563353872 wait complete. 2024-05-03T22:45:14.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.813+0000 7f9b465a0b80 20 client.15219 trim_cache size 0 max 16384 2024-05-03T22:45:14.820 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-03T22:45:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "5b0efdca-099c-11ef-bc97-c7b262605968", 2024-05-03T22:45:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 4, 2024-05-03T22:45:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 24493, 2024-05-03T22:45:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-05-03T22:45:14.820 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-05-03T22:45:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-05-03T22:45:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 213.610271181, 2024-05-03T22:45:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 30, 2024-05-03T22:45:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 89, 2024-05-03T22:45:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 87, 2024-05-03T22:45:14.821 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 338.37514304699999 2024-05-03T22:45:14.821 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-03T22:45:14.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.814+0000 7f9b3bc00700 1 -- 172.21.15.44:0/1945678646 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9b1c0b2910 msgr2=0x7f9b1c0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:14.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.814+0000 7f9b3bc00700 1 --2- 172.21.15.44:0/1945678646 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9b1c0b2910 0x7f9b1c0b4dd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c007c20 tx=0x7f9b2c009990 comp rx=0 tx=0).stop 2024-05-03T22:45:14.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.814+0000 7f9b3bc00700 1 -- 172.21.15.44:0/1945678646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b34103ef0 msgr2=0x7f9b3419c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:14.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.814+0000 7f9b3bc00700 1 --2- 172.21.15.44:0/1945678646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b34103ef0 0x7f9b3419c3f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9b20000c00 tx=0x7f9b20005ef0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.814+0000 7f9b3bc00700 1 -- 172.21.15.44:0/1945678646 shutdown_connections 2024-05-03T22:45:14.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.814+0000 7f9b3bc00700 1 --2- 172.21.15.44:0/1945678646 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f9b1c0b2910 0x7f9b1c0b4dd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.814+0000 7f9b3bc00700 1 --2- 172.21.15.44:0/1945678646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b34108460 0x7f9b341a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.814+0000 7f9b3bc00700 1 --2- 172.21.15.44:0/1945678646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b34103550 0x7f9b3419beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.814+0000 7f9b3bc00700 1 --2- 172.21.15.44:0/1945678646 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f9b34103ef0 0x7f9b3419c3f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:14.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.814+0000 7f9b3bc00700 1 -- 172.21.15.44:0/1945678646 >> 172.21.15.44:0/1945678646 conn(0x7f9b3407a600 msgr2=0x7f9b341013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:14.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.814+0000 7f9b3bc00700 1 -- 172.21.15.44:0/1945678646 shutdown_connections 2024-05-03T22:45:14.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:14.814+0000 7f9b3bc00700 1 -- 172.21.15.44:0/1945678646 wait complete. 2024-05-03T22:45:15.930 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell mds.k status 2024-05-03T22:45:16.414 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:45:16.566 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:16 smithi044 ceph-mon[28604]: pgmap v532: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:45:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:16 smithi060 ceph-mon[31721]: pgmap v532: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:45:16.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:16 smithi160 ceph-mon[32531]: pgmap v532: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:45:18.534 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:18 smithi044 ceph-mon[28604]: pgmap v533: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:18.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:18 smithi060 ceph-mon[31721]: pgmap v533: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:18.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:18 smithi160 ceph-mon[32531]: pgmap v533: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:18.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.817+0000 7f6234e00700 1 -- 172.21.15.44:0/2602878711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f623010fea0 msgr2=0x7f6230112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:18.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.817+0000 7f6234e00700 1 --2- 172.21.15.44:0/2602878711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f623010fea0 0x7f6230112290 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f622800b0a0 tx=0x7f622800b3b0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.820 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.817+0000 7f6234e00700 1 -- 172.21.15.44:0/2602878711 shutdown_connections 2024-05-03T22:45:18.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.817+0000 7f6234e00700 1 --2- 172.21.15.44:0/2602878711 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f623010fea0 0x7f6230112290 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.817+0000 7f6234e00700 1 --2- 172.21.15.44:0/2602878711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62300756d0 0x7f6230075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.817+0000 7f6234e00700 1 --2- 172.21.15.44:0/2602878711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6230075ff0 0x7f623010f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.817+0000 7f6234e00700 1 -- 172.21.15.44:0/2602878711 >> 172.21.15.44:0/2602878711 conn(0x7f623007a600 msgr2=0x7f623007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:18.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.818+0000 7f6234e00700 1 -- 172.21.15.44:0/2602878711 shutdown_connections 2024-05-03T22:45:18.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.818+0000 7f6234e00700 1 -- 172.21.15.44:0/2602878711 wait complete. 2024-05-03T22:45:18.821 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.819+0000 7f6234e00700 1 Processor -- start 2024-05-03T22:45:18.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.819+0000 7f6234e00700 1 -- start start 2024-05-03T22:45:18.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.820+0000 7f6234e00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62300756d0 0x7f623019bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:18.822 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.820+0000 7f6234e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6230075ff0 0x7f623019c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:18.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.820+0000 7f6234e00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f623010fea0 0x7f62301a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:18.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.820+0000 7f6234e00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f62301159d0 con 0x7f6230075ff0 2024-05-03T22:45:18.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.820+0000 7f6234e00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6230115850 con 0x7f623010fea0 2024-05-03T22:45:18.823 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.820+0000 7f6234e00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6230115b50 con 0x7f62300756d0 2024-05-03T22:45:18.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.820+0000 7f622d400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6230075ff0 0x7f623019c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:18.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.820+0000 7f622d400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6230075ff0 0x7f623019c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56540/0 (socket says 172.21.15.44:56540) 2024-05-03T22:45:18.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.820+0000 7f622d400700 1 -- 172.21.15.44:0/3705843701 learned_addr learned my addr 172.21.15.44:0/3705843701 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:18.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.821+0000 7f622de00700 1 --2- 172.21.15.44:0/3705843701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62300756d0 0x7f623019bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:18.824 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.821+0000 7f622e800700 1 --2- 172.21.15.44:0/3705843701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f623010fea0 0x7f62301a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:18.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.821+0000 7f622d400700 1 -- 172.21.15.44:0/3705843701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62300756d0 msgr2=0x7f623019bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:18.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.821+0000 7f622d400700 1 --2- 172.21.15.44:0/3705843701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62300756d0 0x7f623019bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.821+0000 7f622d400700 1 -- 172.21.15.44:0/3705843701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f623010fea0 msgr2=0x7f62301a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:18.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.821+0000 7f622d400700 1 --2- 172.21.15.44:0/3705843701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f623010fea0 0x7f62301a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.821+0000 7f622d400700 1 -- 172.21.15.44:0/3705843701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62301a0d30 con 0x7f6230075ff0 2024-05-03T22:45:18.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.822+0000 7f622d400700 1 --2- 172.21.15.44:0/3705843701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6230075ff0 0x7f623019c260 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f621c00c990 tx=0x7f621c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:18.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.822+0000 7f6226a00700 1 -- 172.21.15.44:0/3705843701 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c007b00 con 0x7f6230075ff0 2024-05-03T22:45:18.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.822+0000 7f6226a00700 1 -- 172.21.15.44:0/3705843701 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f621c007ca0 con 0x7f6230075ff0 2024-05-03T22:45:18.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.822+0000 7f6234e00700 1 -- 172.21.15.44:0/3705843701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62301a1020 con 0x7f6230075ff0 2024-05-03T22:45:18.825 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.822+0000 7f6226a00700 1 -- 172.21.15.44:0/3705843701 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c018710 con 0x7f6230075ff0 2024-05-03T22:45:18.826 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.822+0000 7f6234e00700 1 -- 172.21.15.44:0/3705843701 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62301a88a0 con 0x7f6230075ff0 2024-05-03T22:45:18.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.828+0000 7f623f7ceb80 1 Processor -- start 2024-05-03T22:45:18.831 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.829+0000 7f623f7ceb80 1 -- start start 2024-05-03T22:45:18.832 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.829+0000 7f6226a00700 1 -- 172.21.15.44:0/3705843701 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f621c0188b0 con 0x7f6230075ff0 2024-05-03T22:45:18.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.829+0000 7f623f7ceb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfa760 0x556853cfab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:18.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.829+0000 7f623f7ceb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfb080 0x556853cf5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:18.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.829+0000 7f623f7ceb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cf6580 0x556853cf69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:18.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.829+0000 7f623f7ceb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556853c489d0 con 0x556853cfa760 2024-05-03T22:45:18.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.829+0000 7f623f7ceb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556853be6710 con 0x556853cf6580 2024-05-03T22:45:18.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.829+0000 7f623f7ceb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556853c44990 con 0x556853cfb080 2024-05-03T22:45:18.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.830+0000 7f622e800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfa760 0x556853cfab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:18.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.830+0000 7f622e800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfa760 0x556853cfab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56550/0 (socket says 172.21.15.44:56550) 2024-05-03T22:45:18.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.830+0000 7f622e800700 1 -- 172.21.15.44:0/3434504549 learned_addr learned my addr 172.21.15.44:0/3434504549 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:18.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.830+0000 7f622de00700 1 --2- 172.21.15.44:0/3434504549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfb080 0x556853cf5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:18.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.830+0000 7f622d400700 1 --2- 172.21.15.44:0/3434504549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cf6580 0x556853cf69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:18.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.830+0000 7f622e800700 1 -- 172.21.15.44:0/3434504549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfb080 msgr2=0x556853cf5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:18.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.830+0000 7f622e800700 1 --2- 172.21.15.44:0/3434504549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfb080 0x556853cf5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.830+0000 7f622e800700 1 -- 172.21.15.44:0/3434504549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cf6580 msgr2=0x556853cf69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:18.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.830+0000 7f622e800700 1 --2- 172.21.15.44:0/3434504549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cf6580 0x556853cf69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.830+0000 7f622e800700 1 -- 172.21.15.44:0/3434504549 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556853b95880 con 0x556853cfa760 2024-05-03T22:45:18.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.831+0000 7f622e800700 1 --2- 172.21.15.44:0/3434504549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfa760 0x556853cfab40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6228015000 tx=0x7f6228009d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8dd49056c585b07 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:18.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.831+0000 7f621b400700 1 -- 172.21.15.44:0/3434504549 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6228004a50 con 0x556853cfa760 2024-05-03T22:45:18.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.831+0000 7f621b400700 1 -- 172.21.15.44:0/3434504549 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f6228004bf0 con 0x556853cfa760 2024-05-03T22:45:18.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.831+0000 7f621b400700 1 -- 172.21.15.44:0/3434504549 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622801c6a0 con 0x556853cfa760 2024-05-03T22:45:18.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.832+0000 7f6226a00700 1 --2- 172.21.15.44:0/3705843701 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f62140b2910 0x7f62140b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:18.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.832+0000 7f6226a00700 1 -- 172.21.15.44:0/3705843701 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f621c0e2750 con 0x7f6230075ff0 2024-05-03T22:45:18.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.832+0000 7f622de00700 1 --2- 172.21.15.44:0/3705843701 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f62140b2910 0x7f62140b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:18.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.832+0000 7f623f7ceb80 1 -- 172.21.15.44:0/3434504549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfa760 msgr2=0x556853cfab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:18.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.832+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/3434504549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfa760 0x556853cfab40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6228015000 tx=0x7f6228009d90 comp rx=0 tx=0).stop 2024-05-03T22:45:18.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.832+0000 7f623f7ceb80 1 -- 172.21.15.44:0/3434504549 shutdown_connections 2024-05-03T22:45:18.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.832+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/3434504549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cf6580 0x556853cf69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.832+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/3434504549 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfa760 0x556853cfab40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.832+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/3434504549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfb080 0x556853cf5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.836 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.832+0000 7f623f7ceb80 1 -- 172.21.15.44:0/3434504549 >> 172.21.15.44:0/3434504549 conn(0x556853c24b10 msgr2=0x556853cf07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:18.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.832+0000 7f623f7ceb80 1 -- 172.21.15.44:0/3434504549 shutdown_connections 2024-05-03T22:45:18.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.833+0000 7f623f7ceb80 1 -- 172.21.15.44:0/3434504549 wait complete. 2024-05-03T22:45:18.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.833+0000 7f622de00700 1 --2- 172.21.15.44:0/3705843701 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f62140b2910 0x7f62140b4dd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6220005950 tx=0x7f62200058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:18.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.833+0000 7f623f7ceb80 1 -- start start 2024-05-03T22:45:18.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.833+0000 7f623f7ceb80 1 Processor -- start 2024-05-03T22:45:18.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.834+0000 7f623f7ceb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cf6580 0x556853d01d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:18.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.834+0000 7f623f7ceb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfa760 0x556853cff100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.834+0000 7f623f7ceb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cfb080 0x556853cff640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.834+0000 7f623f7ceb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556853d02bf0 con 0x556853cf6580 2024-05-03T22:45:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.834+0000 7f623f7ceb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556853baead0 con 0x556853cfb080 2024-05-03T22:45:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.834+0000 7f623f7ceb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556853d02d70 con 0x556853cfa760 2024-05-03T22:45:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.834+0000 7f623f7ceb80 10 client.0 _ll_register_callbacks cb 0x556853befc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:45:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.834+0000 7f622de00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cf6580 0x556853d01d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.834+0000 7f622de00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cf6580 0x556853d01d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56554/0 (socket says 172.21.15.44:56554) 2024-05-03T22:45:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.834+0000 7f622de00700 1 -- 172.21.15.44:0/2133251096 learned_addr learned my addr 172.21.15.44:0/2133251096 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.835+0000 7f622d400700 1 --2- 172.21.15.44:0/2133251096 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfa760 0x556853cff100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.835+0000 7f622e800700 1 --2- 172.21.15.44:0/2133251096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cfb080 0x556853cff640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.835+0000 7f622de00700 1 -- 172.21.15.44:0/2133251096 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfa760 msgr2=0x556853cff100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.835+0000 7f622de00700 1 --2- 172.21.15.44:0/2133251096 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfa760 0x556853cff100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.835+0000 7f622de00700 1 -- 172.21.15.44:0/2133251096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cfb080 msgr2=0x556853cff640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.835+0000 7f622de00700 1 --2- 172.21.15.44:0/2133251096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cfb080 0x556853cff640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.835+0000 7f622de00700 1 -- 172.21.15.44:0/2133251096 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556853c0e3d0 con 0x556853cf6580 2024-05-03T22:45:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.835+0000 7f622d400700 1 --2- 172.21.15.44:0/2133251096 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfa760 0x556853cff100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:45:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.835+0000 7f622e800700 1 --2- 172.21.15.44:0/2133251096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cfb080 0x556853cff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:45:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.835+0000 7f622de00700 1 --2- 172.21.15.44:0/2133251096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cf6580 0x556853d01d60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f62200119f0 tx=0x7f6220004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348b1fbbe175198a server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.835+0000 7f620fe00700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:45:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.836+0000 7f620fe00700 1 -- 172.21.15.44:0/2133251096 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6220011e60 con 0x556853cf6580 2024-05-03T22:45:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.836+0000 7f620fe00700 1 -- 172.21.15.44:0/2133251096 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f6220004a30 con 0x556853cf6580 2024-05-03T22:45:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.836+0000 7f623f7ceb80 1 -- 172.21.15.44:0/2133251096 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6228004bf0 con 0x556853cf6580 2024-05-03T22:45:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.836+0000 7f620fe00700 1 -- 172.21.15.44:0/2133251096 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f622002d050 con 0x556853cf6580 2024-05-03T22:45:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.836+0000 7f623f7ceb80 10 client.15231 fetch_fsmap learned FSMap version 30 2024-05-03T22:45:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.836+0000 7f623f7ceb80 1 -- 172.21.15.44:0/2133251096 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556853d0d360 con 0x556853cf6580 2024-05-03T22:45:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.836+0000 7f620fe00700 1 -- 172.21.15.44:0/2133251096 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f6228004bf0 con 0x556853cf6580 2024-05-03T22:45:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.837+0000 7f620fe00700 1 -- 172.21.15.44:0/2133251096 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f622001eb20 con 0x556853cf6580 2024-05-03T22:45:18.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.837+0000 7f623f7ceb80 10 client.15231 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:45:18.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.837+0000 7f623f7ceb80 10 client.15231 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-03T22:45:18.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.837+0000 7f623f7ceb80 20 client.15231 populate_metadata read hostname 'smithi044' 2024-05-03T22:45:18.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.837+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/2133251096 >> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] conn(0x556853d0f9b0 0x556853d10e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:18.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.837+0000 7f623f7ceb80 4 client.15231 mds_command: new command op to 34391 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:45:18.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.837+0000 7f623f7ceb80 1 -- 172.21.15.44:0/2133251096 --> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556853cc3180 con 0x556853d0f9b0 2024-05-03T22:45:18.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.838+0000 7f622d400700 1 --2- 172.21.15.44:0/2133251096 >> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] conn(0x556853d0f9b0 0x556853d10e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:18.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.838+0000 7f622d400700 1 --2- 172.21.15.44:0/2133251096 >> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] conn(0x556853d0f9b0 0x556853d10e20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d8889af37ecad37c server_cookie=75bb2c33cfbb240a in_seq=0 out_seq=0 2024-05-03T22:45:18.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.838+0000 7f620fe00700 10 client.15231 ms_handle_connect on v2:172.21.15.60:6832/153110190 2024-05-03T22:45:18.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.840+0000 7f620fe00700 1 -- 172.21.15.44:0/2133251096 <== mds.3 v2:172.21.15.60:6832/153110190 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556853cc3180 con 0x556853d0f9b0 2024-05-03T22:45:18.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.840+0000 7f620fe00700 10 client.15231 handle_command_reply: tid=0 2024-05-03T22:45:18.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.840+0000 7f623f7ceb80 1 client.15231 shutdown 2024-05-03T22:45:18.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.841+0000 7f623f7ceb80 1 -- 172.21.15.44:0/2133251096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cf6580 msgr2=0x556853d01d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:18.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.841+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/2133251096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cf6580 0x556853d01d60 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f62200119f0 tx=0x7f6220004750 comp rx=0 tx=0).stop 2024-05-03T22:45:18.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.841+0000 7f623f7ceb80 1 -- 172.21.15.44:0/2133251096 shutdown_connections 2024-05-03T22:45:18.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.841+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/2133251096 >> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] conn(0x556853d0f9b0 0x556853d10e20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.841+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/2133251096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cfb080 0x556853cff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.841+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/2133251096 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cf6580 0x556853d01d60 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.841+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/2133251096 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfa760 0x556853cff100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.841+0000 7f623f7ceb80 1 -- 172.21.15.44:0/2133251096 >> 172.21.15.44:0/2133251096 conn(0x556853c24b10 msgr2=0x556853cf9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:18.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.841+0000 7f620fe00700 0 client.15231 ms_handle_reset on v2:172.21.15.60:6832/153110190 2024-05-03T22:45:18.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.841+0000 7f623f7ceb80 1 -- 172.21.15.44:0/2133251096 shutdown_connections 2024-05-03T22:45:18.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.841+0000 7f623f7ceb80 1 -- 172.21.15.44:0/2133251096 wait complete. 2024-05-03T22:45:18.845 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.841+0000 7f623f7ceb80 20 client.15231 trim_cache size 0 max 16384 2024-05-03T22:45:18.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.865+0000 7f623f7ceb80 1 Processor -- start 2024-05-03T22:45:18.868 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.865+0000 7f623f7ceb80 1 -- start start 2024-05-03T22:45:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.866+0000 7f623f7ceb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cf6580 0x556853cf0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.866+0000 7f623f7ceb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfa760 0x556853cfda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.866+0000 7f623f7ceb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfb080 0x556853cfdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.866+0000 7f623f7ceb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556853d0f160 con 0x556853cfb080 2024-05-03T22:45:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.866+0000 7f623f7ceb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556853d0f830 con 0x556853cf6580 2024-05-03T22:45:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.866+0000 7f623f7ceb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556853d0ff00 con 0x556853cfa760 2024-05-03T22:45:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.866+0000 7f622e800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfb080 0x556853cfdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.866+0000 7f622e800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfb080 0x556853cfdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56562/0 (socket says 172.21.15.44:56562) 2024-05-03T22:45:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.866+0000 7f622e800700 1 -- 172.21.15.44:0/2587239157 learned_addr learned my addr 172.21.15.44:0/2587239157 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:18.869 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.866+0000 7f622de00700 1 --2- 172.21.15.44:0/2587239157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cf6580 0x556853cf0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:18.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.867+0000 7f622d400700 1 --2- 172.21.15.44:0/2587239157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfa760 0x556853cfda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:18.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.867+0000 7f622e800700 1 -- 172.21.15.44:0/2587239157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfa760 msgr2=0x556853cfda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:18.870 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.867+0000 7f622e800700 1 --2- 172.21.15.44:0/2587239157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfa760 0x556853cfda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.867+0000 7f622e800700 1 -- 172.21.15.44:0/2587239157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cf6580 msgr2=0x556853cf0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:18.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.867+0000 7f622e800700 1 --2- 172.21.15.44:0/2587239157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cf6580 0x556853cf0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.867+0000 7f622e800700 1 -- 172.21.15.44:0/2587239157 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556853cfa3b0 con 0x556853cfb080 2024-05-03T22:45:18.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.867+0000 7f622e800700 1 --2- 172.21.15.44:0/2587239157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfb080 0x556853cfdf50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6228023000 tx=0x7f62280094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28cf0638bc0762fd server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:18.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.868+0000 7f621aa00700 1 -- 172.21.15.44:0/2587239157 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622802a070 con 0x556853cfb080 2024-05-03T22:45:18.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.868+0000 7f621aa00700 1 -- 172.21.15.44:0/2587239157 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f62280074a0 con 0x556853cfb080 2024-05-03T22:45:18.871 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.868+0000 7f621aa00700 1 -- 172.21.15.44:0/2587239157 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622801c6a0 con 0x556853cfb080 2024-05-03T22:45:18.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.869+0000 7f623f7ceb80 1 -- 172.21.15.44:0/2587239157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfb080 msgr2=0x556853cfdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:18.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.869+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/2587239157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfb080 0x556853cfdf50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6228023000 tx=0x7f62280094c0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.869+0000 7f623f7ceb80 1 -- 172.21.15.44:0/2587239157 shutdown_connections 2024-05-03T22:45:18.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.869+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/2587239157 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfb080 0x556853cfdf50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.869+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/2587239157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cf6580 0x556853cf0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.869+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/2587239157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfa760 0x556853cfda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.869+0000 7f623f7ceb80 1 -- 172.21.15.44:0/2587239157 >> 172.21.15.44:0/2587239157 conn(0x556853c24b10 msgr2=0x556853cf5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:18.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.869+0000 7f623f7ceb80 1 -- 172.21.15.44:0/2587239157 shutdown_connections 2024-05-03T22:45:18.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.869+0000 7f623f7ceb80 1 -- 172.21.15.44:0/2587239157 wait complete. 2024-05-03T22:45:18.872 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.869+0000 7f623f7ceb80 1 -- start start 2024-05-03T22:45:18.873 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.869+0000 7f623f7ceb80 1 Processor -- start 2024-05-03T22:45:18.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.870+0000 7f623f7ceb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cf6580 0x556853d1a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:18.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.870+0000 7f623f7ceb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfa760 0x556853cfbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:18.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.870+0000 7f623f7ceb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfb080 0x556853cfc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:18.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.870+0000 7f623f7ceb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x556853d10ca0 con 0x556853cfb080 2024-05-03T22:45:18.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.870+0000 7f623f7ceb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556853d105d0 con 0x556853cf6580 2024-05-03T22:45:18.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.870+0000 7f623f7ceb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556853d11370 con 0x556853cfa760 2024-05-03T22:45:18.874 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.870+0000 7f623f7ceb80 10 client.0 _ll_register_callbacks cb 0x556853befc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:45:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.870+0000 7f622e800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfb080 0x556853cfc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.870+0000 7f622e800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfb080 0x556853cfc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56576/0 (socket says 172.21.15.44:56576) 2024-05-03T22:45:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.870+0000 7f622e800700 1 -- 172.21.15.44:0/3813391049 learned_addr learned my addr 172.21.15.44:0/3813391049 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.871+0000 7f622d400700 1 --2- 172.21.15.44:0/3813391049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfa760 0x556853cfbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.871+0000 7f622de00700 1 --2- 172.21.15.44:0/3813391049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cf6580 0x556853d1a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.871+0000 7f622e800700 1 -- 172.21.15.44:0/3813391049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfa760 msgr2=0x556853cfbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.871+0000 7f622e800700 1 --2- 172.21.15.44:0/3813391049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfa760 0x556853cfbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.871+0000 7f622e800700 1 -- 172.21.15.44:0/3813391049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cf6580 msgr2=0x556853d1a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.871+0000 7f622e800700 1 --2- 172.21.15.44:0/3813391049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cf6580 0x556853d1a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.871+0000 7f622e800700 1 -- 172.21.15.44:0/3813391049 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556853cfc9f0 con 0x556853cfb080 2024-05-03T22:45:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.871+0000 7f622e800700 1 --2- 172.21.15.44:0/3813391049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfb080 0x556853cfc1e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6228000f80 tx=0x7f622800b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25524cbc670f0bec server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.871+0000 7f620fe00700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:45:18.875 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.872+0000 7f620fe00700 1 -- 172.21.15.44:0/3813391049 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622802a040 con 0x556853cfb080 2024-05-03T22:45:18.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.872+0000 7f620fe00700 1 -- 172.21.15.44:0/3813391049 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f6228007860 con 0x556853cfb080 2024-05-03T22:45:18.876 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.872+0000 7f623f7ceb80 1 -- 172.21.15.44:0/3813391049 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62280074a0 con 0x556853cfb080 2024-05-03T22:45:18.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.872+0000 7f620fe00700 1 -- 172.21.15.44:0/3813391049 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f622803e050 con 0x556853cfb080 2024-05-03T22:45:18.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.872+0000 7f623f7ceb80 10 client.15237 fetch_fsmap learned FSMap version 30 2024-05-03T22:45:18.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.872+0000 7f623f7ceb80 1 -- 172.21.15.44:0/3813391049 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x556853d7ae80 con 0x556853cfb080 2024-05-03T22:45:18.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.872+0000 7f620fe00700 1 -- 172.21.15.44:0/3813391049 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f62280074a0 con 0x556853cfb080 2024-05-03T22:45:18.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.873+0000 7f620fe00700 1 -- 172.21.15.44:0/3813391049 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6228011070 con 0x556853cfb080 2024-05-03T22:45:18.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.873+0000 7f623f7ceb80 10 client.15237 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:45:18.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.873+0000 7f623f7ceb80 10 client.15237 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-03T22:45:18.877 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.873+0000 7f623f7ceb80 20 client.15237 populate_metadata read hostname 'smithi044' 2024-05-03T22:45:18.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.873+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/3813391049 >> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] conn(0x556853d7f380 0x556853d7e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:18.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.873+0000 7f623f7ceb80 4 client.15237 mds_command: new command op to 34391 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:45:18.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.873+0000 7f623f7ceb80 1 -- 172.21.15.44:0/3813391049 --> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] -- command(tid 0: {"prefix": "status"}) -- 0x556853c563b0 con 0x556853d7f380 2024-05-03T22:45:18.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.874+0000 7f622de00700 1 --2- 172.21.15.44:0/3813391049 >> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] conn(0x556853d7f380 0x556853d7e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:18.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.875+0000 7f622de00700 1 --2- 172.21.15.44:0/3813391049 >> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] conn(0x556853d7f380 0x556853d7e090 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d554e4e81bb1d85 server_cookie=f147e9e90b7fa1fb in_seq=0 out_seq=0 2024-05-03T22:45:18.878 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.875+0000 7f620fe00700 10 client.15237 ms_handle_connect on v2:172.21.15.60:6832/153110190 2024-05-03T22:45:18.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.875+0000 7f620fe00700 1 -- 172.21.15.44:0/3813391049 <== mds.3 v2:172.21.15.60:6832/153110190 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x556853c563b0 con 0x556853d7f380 2024-05-03T22:45:18.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.875+0000 7f620fe00700 10 client.15237 handle_command_reply: tid=0 2024-05-03T22:45:18.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.875+0000 7f623f7ceb80 1 client.15237 shutdown 2024-05-03T22:45:18.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.876+0000 7f623f7ceb80 1 -- 172.21.15.44:0/3813391049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfb080 msgr2=0x556853cfc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:18.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.876+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/3813391049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfb080 0x556853cfc1e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6228000f80 tx=0x7f622800b430 comp rx=0 tx=0).stop 2024-05-03T22:45:18.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.876+0000 7f623f7ceb80 1 -- 172.21.15.44:0/3813391049 shutdown_connections 2024-05-03T22:45:18.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.876+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/3813391049 >> [v2:172.21.15.60:6832/153110190,v1:172.21.15.60:6833/153110190] conn(0x556853d7f380 0x556853d7e090 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.876+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/3813391049 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x556853cfb080 0x556853cfc1e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.876+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/3813391049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556853cf6580 0x556853d1a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.879 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.876+0000 7f623f7ceb80 1 --2- 172.21.15.44:0/3813391049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556853cfa760 0x556853cfbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.876+0000 7f623f7ceb80 1 -- 172.21.15.44:0/3813391049 >> 172.21.15.44:0/3813391049 conn(0x556853c24b10 msgr2=0x556853cfd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:18.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.876+0000 7f620fe00700 0 client.15237 ms_handle_reset on v2:172.21.15.60:6832/153110190 2024-05-03T22:45:18.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.876+0000 7f623f7ceb80 1 -- 172.21.15.44:0/3813391049 shutdown_connections 2024-05-03T22:45:18.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.876+0000 7f623f7ceb80 1 -- 172.21.15.44:0/3813391049 wait complete. 2024-05-03T22:45:18.880 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.876+0000 7f623f7ceb80 20 client.15237 trim_cache size 0 max 16384 2024-05-03T22:45:18.880 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-03T22:45:18.880 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "5b0efdca-099c-11ef-bc97-c7b262605968", 2024-05-03T22:45:18.880 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 3, 2024-05-03T22:45:18.880 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 34391, 2024-05-03T22:45:18.880 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-05-03T22:45:18.881 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-05-03T22:45:18.881 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-05-03T22:45:18.881 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 218.69747066599999, 2024-05-03T22:45:18.881 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 30, 2024-05-03T22:45:18.881 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 89, 2024-05-03T22:45:18.881 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 87, 2024-05-03T22:45:18.881 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 374.86951681599999 2024-05-03T22:45:18.881 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-03T22:45:18.881 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.877+0000 7f6234e00700 1 -- 172.21.15.44:0/3705843701 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f62140b2910 msgr2=0x7f62140b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:18.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.877+0000 7f6234e00700 1 --2- 172.21.15.44:0/3705843701 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f62140b2910 0x7f62140b4dd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6220005950 tx=0x7f62200058e0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.877+0000 7f6234e00700 1 -- 172.21.15.44:0/3705843701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6230075ff0 msgr2=0x7f623019c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:18.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.877+0000 7f6234e00700 1 --2- 172.21.15.44:0/3705843701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6230075ff0 0x7f623019c260 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f621c00c990 tx=0x7f621c00cd50 comp rx=0 tx=0).stop 2024-05-03T22:45:18.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.877+0000 7f6234e00700 1 -- 172.21.15.44:0/3705843701 shutdown_connections 2024-05-03T22:45:18.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.877+0000 7f6234e00700 1 --2- 172.21.15.44:0/3705843701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f623010fea0 0x7f62301a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.877+0000 7f6234e00700 1 --2- 172.21.15.44:0/3705843701 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f62140b2910 0x7f62140b4dd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.877+0000 7f6234e00700 1 --2- 172.21.15.44:0/3705843701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62300756d0 0x7f623019bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.877+0000 7f6234e00700 1 --2- 172.21.15.44:0/3705843701 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f6230075ff0 0x7f623019c260 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:18.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.877+0000 7f6234e00700 1 -- 172.21.15.44:0/3705843701 >> 172.21.15.44:0/3705843701 conn(0x7f623007a600 msgr2=0x7f6230101690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:18.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.878+0000 7f6234e00700 1 -- 172.21.15.44:0/3705843701 shutdown_connections 2024-05-03T22:45:18.882 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:18.878+0000 7f6234e00700 1 -- 172.21.15.44:0/3705843701 wait complete. 2024-05-03T22:45:19.907 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell mds.e status 2024-05-03T22:45:20.343 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:45:20.670 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:20 smithi044 ceph-mon[28604]: pgmap v534: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:45:20.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:20 smithi060 ceph-mon[31721]: pgmap v534: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:45:20.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:20 smithi160 ceph-mon[32531]: pgmap v534: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:45:22.609 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:22 smithi044 ceph-mon[28604]: pgmap v535: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:45:22.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:22 smithi060 ceph-mon[31721]: pgmap v535: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:45:22.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:22 smithi160 ceph-mon[32531]: pgmap v535: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:45:22.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.894+0000 7f71e2a00700 1 -- 172.21.15.44:0/848276875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71dc103550 msgr2=0x7f71dc1039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:22.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.894+0000 7f71e2a00700 1 --2- 172.21.15.44:0/848276875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71dc103550 0x7f71dc1039b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f71c8009990 tx=0x7f71c8009ca0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.896 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.894+0000 7f71e2a00700 1 -- 172.21.15.44:0/848276875 shutdown_connections 2024-05-03T22:45:22.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.894+0000 7f71e2a00700 1 --2- 172.21.15.44:0/848276875 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71dc103ef0 0x7f71dc1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.894+0000 7f71e2a00700 1 --2- 172.21.15.44:0/848276875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71dc108460 0x7f71dc108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.894+0000 7f71e2a00700 1 --2- 172.21.15.44:0/848276875 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71dc103550 0x7f71dc1039b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.894+0000 7f71e2a00700 1 -- 172.21.15.44:0/848276875 >> 172.21.15.44:0/848276875 conn(0x7f71dc07a600 msgr2=0x7f71dc07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:22.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.895+0000 7f71e2a00700 1 -- 172.21.15.44:0/848276875 shutdown_connections 2024-05-03T22:45:22.897 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.895+0000 7f71e2a00700 1 -- 172.21.15.44:0/848276875 wait complete. 2024-05-03T22:45:22.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.896+0000 7f71e2a00700 1 Processor -- start 2024-05-03T22:45:22.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.896+0000 7f71e2a00700 1 -- start start 2024-05-03T22:45:22.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.896+0000 7f71e2a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71dc103550 0x7f71dc19bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:22.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.896+0000 7f71e2a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71dc103ef0 0x7f71dc19c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:22.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.896+0000 7f71e2a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71dc108460 0x7f71dc1a07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:22.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.896+0000 7f71e2a00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc1137e0 con 0x7f71dc103550 2024-05-03T22:45:22.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.896+0000 7f71e2a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc113660 con 0x7f71dc108460 2024-05-03T22:45:22.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.896+0000 7f71e2a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f71dc113960 con 0x7f71dc103ef0 2024-05-03T22:45:22.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.897+0000 7f71dbe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71dc103550 0x7f71dc19bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:22.899 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.897+0000 7f71dbe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71dc103550 0x7f71dc19bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48266/0 (socket says 172.21.15.44:48266) 2024-05-03T22:45:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.897+0000 7f71dbe00700 1 -- 172.21.15.44:0/405538378 learned_addr learned my addr 172.21.15.44:0/405538378 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.897+0000 7f71db400700 1 --2- 172.21.15.44:0/405538378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71dc103ef0 0x7f71dc19c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.897+0000 7f71e0a00700 1 --2- 172.21.15.44:0/405538378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71dc108460 0x7f71dc1a07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.897+0000 7f71dbe00700 1 -- 172.21.15.44:0/405538378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71dc103ef0 msgr2=0x7f71dc19c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.897+0000 7f71dbe00700 1 --2- 172.21.15.44:0/405538378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71dc103ef0 0x7f71dc19c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.897+0000 7f71dbe00700 1 -- 172.21.15.44:0/405538378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71dc108460 msgr2=0x7f71dc1a07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.897+0000 7f71dbe00700 1 --2- 172.21.15.44:0/405538378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71dc108460 0x7f71dc1a07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.900 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.897+0000 7f71dbe00700 1 -- 172.21.15.44:0/405538378 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71dc1a0ee0 con 0x7f71dc103550 2024-05-03T22:45:22.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.898+0000 7f71dbe00700 1 --2- 172.21.15.44:0/405538378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71dc103550 0x7f71dc19bed0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00d980 tx=0x7f71cc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:22.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.898+0000 7f71d8c00700 1 -- 172.21.15.44:0/405538378 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71cc016070 con 0x7f71dc103550 2024-05-03T22:45:22.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.898+0000 7f71e2a00700 1 -- 172.21.15.44:0/405538378 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71dc1a11d0 con 0x7f71dc103550 2024-05-03T22:45:22.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.898+0000 7f71d8c00700 1 -- 172.21.15.44:0/405538378 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f71cc00bb60 con 0x7f71dc103550 2024-05-03T22:45:22.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.898+0000 7f71d8c00700 1 -- 172.21.15.44:0/405538378 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71cc00f3c0 con 0x7f71dc103550 2024-05-03T22:45:22.901 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.898+0000 7f71e2a00700 1 -- 172.21.15.44:0/405538378 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71dc1a8a50 con 0x7f71dc103550 2024-05-03T22:45:22.903 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.902+0000 7f71d8c00700 1 -- 172.21.15.44:0/405538378 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f71cc019070 con 0x7f71dc103550 2024-05-03T22:45:22.904 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.903+0000 7f71ed347b80 1 Processor -- start 2024-05-03T22:45:22.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.903+0000 7f71ed347b80 1 -- start start 2024-05-03T22:45:22.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.904+0000 7f71d8c00700 1 --2- 172.21.15.44:0/405538378 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f71c00b2910 0x7f71c00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:22.905 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.904+0000 7f71ed347b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4faab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:22.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.904+0000 7f71ed347b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fab080 0x5582e4fa5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:22.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.904+0000 7f71ed347b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fa6580 0x5582e4fa69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:22.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.904+0000 7f71ed347b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5582e4ef89d0 con 0x5582e4fa6580 2024-05-03T22:45:22.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.904+0000 7f71ed347b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5582e4e96710 con 0x5582e4faa760 2024-05-03T22:45:22.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.904+0000 7f71ed347b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5582e4ef4990 con 0x5582e4fab080 2024-05-03T22:45:22.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.904+0000 7f71d8c00700 1 -- 172.21.15.44:0/405538378 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f71cc0e2380 con 0x7f71dc103550 2024-05-03T22:45:22.906 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.904+0000 7f71e0a00700 1 --2- 172.21.15.44:0/405538378 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f71c00b2910 0x7f71c00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.904+0000 7f71db400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fab080 0x5582e4fa5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.905+0000 7f71dbe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4faab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.905+0000 7f71db400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fab080 0x5582e4fa5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.44:60578/0 (socket says 172.21.15.44:60578) 2024-05-03T22:45:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.905+0000 7f71dbe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4faab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.44:33538/0 (socket says 172.21.15.44:33538) 2024-05-03T22:45:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.905+0000 7f71db400700 1 -- 172.21.15.44:0/2831039387 learned_addr learned my addr 172.21.15.44:0/2831039387 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:22.907 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.905+0000 7f71e0a00700 1 --2- 172.21.15.44:0/2831039387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fa6580 0x5582e4fa69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.905+0000 7f71dbe00700 1 -- 172.21.15.44:0/2831039387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fab080 msgr2=0x5582e4fa5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.905+0000 7f71dbe00700 1 --2- 172.21.15.44:0/2831039387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fab080 0x5582e4fa5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.905+0000 7f71dbe00700 1 -- 172.21.15.44:0/2831039387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fa6580 msgr2=0x5582e4fa69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.905+0000 7f71dbe00700 1 --2- 172.21.15.44:0/2831039387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fa6580 0x5582e4fa69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.905+0000 7f71dbe00700 1 -- 172.21.15.44:0/2831039387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582e4e45880 con 0x5582e4faa760 2024-05-03T22:45:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.906+0000 7f71e0a00700 1 --2- 172.21.15.44:0/405538378 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f71c00b2910 0x7f71c00b4dd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f71d40060b0 tx=0x7f71d4007a50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.906+0000 7f71dbe00700 1 --2- 172.21.15.44:0/2831039387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4faab40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0df8c0 tx=0x7f71cc0a8b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b47eb9d285bb34ae server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.906+0000 7f71d1600700 1 -- 172.21.15.44:0/2831039387 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71cc0a9ad0 con 0x5582e4faa760 2024-05-03T22:45:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.906+0000 7f71d1600700 1 -- 172.21.15.44:0/2831039387 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f71cc013d00 con 0x5582e4faa760 2024-05-03T22:45:22.908 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.906+0000 7f71d1600700 1 -- 172.21.15.44:0/2831039387 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71cc0a57f0 con 0x5582e4faa760 2024-05-03T22:45:22.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.907+0000 7f71ed347b80 1 -- 172.21.15.44:0/2831039387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 msgr2=0x5582e4faab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:22.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.907+0000 7f71ed347b80 1 --2- 172.21.15.44:0/2831039387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4faab40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0df8c0 tx=0x7f71cc0a8b40 comp rx=0 tx=0).stop 2024-05-03T22:45:22.909 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.907+0000 7f71ed347b80 1 -- 172.21.15.44:0/2831039387 shutdown_connections 2024-05-03T22:45:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.907+0000 7f71ed347b80 1 --2- 172.21.15.44:0/2831039387 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fa6580 0x5582e4fa69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.907+0000 7f71ed347b80 1 --2- 172.21.15.44:0/2831039387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4faab40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.907+0000 7f71ed347b80 1 --2- 172.21.15.44:0/2831039387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fab080 0x5582e4fa5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.907+0000 7f71ed347b80 1 -- 172.21.15.44:0/2831039387 >> 172.21.15.44:0/2831039387 conn(0x5582e4ed4b10 msgr2=0x5582e4fa07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.907+0000 7f71ed347b80 1 -- 172.21.15.44:0/2831039387 shutdown_connections 2024-05-03T22:45:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.907+0000 7f71ed347b80 1 -- 172.21.15.44:0/2831039387 wait complete. 2024-05-03T22:45:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.908+0000 7f71ed347b80 1 -- start start 2024-05-03T22:45:22.910 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.908+0000 7f71ed347b80 1 Processor -- start 2024-05-03T22:45:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.909+0000 7f71ed347b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fa6580 0x5582e4fb1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.909+0000 7f71ed347b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4faf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:22.911 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.909+0000 7f71ed347b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fab080 0x5582e4faf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.909+0000 7f71ed347b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5582e4fb2c50 con 0x5582e4fa6580 2024-05-03T22:45:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.909+0000 7f71ed347b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5582e4e5ead0 con 0x5582e4faa760 2024-05-03T22:45:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.909+0000 7f71ed347b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5582e4fb2dd0 con 0x5582e4fab080 2024-05-03T22:45:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.909+0000 7f71ed347b80 10 client.0 _ll_register_callbacks cb 0x5582e4e9fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:45:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.909+0000 7f71dbe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fa6580 0x5582e4fb1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.909+0000 7f71dbe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fa6580 0x5582e4fb1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48276/0 (socket says 172.21.15.44:48276) 2024-05-03T22:45:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.909+0000 7f71dbe00700 1 -- 172.21.15.44:0/3194726287 learned_addr learned my addr 172.21.15.44:0/3194726287 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.909+0000 7f71db400700 1 --2- 172.21.15.44:0/3194726287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4faf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.909+0000 7f71e0a00700 1 --2- 172.21.15.44:0/3194726287 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fab080 0x5582e4faf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.910+0000 7f71dbe00700 1 -- 172.21.15.44:0/3194726287 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fab080 msgr2=0x5582e4faf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.910+0000 7f71dbe00700 1 --2- 172.21.15.44:0/3194726287 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fab080 0x5582e4faf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.910+0000 7f71dbe00700 1 -- 172.21.15.44:0/3194726287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 msgr2=0x5582e4faf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:22.912 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.910+0000 7f71dbe00700 1 --2- 172.21.15.44:0/3194726287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4faf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.913 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.910+0000 7f71dbe00700 1 -- 172.21.15.44:0/3194726287 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582e4ebe3d0 con 0x5582e4fa6580 2024-05-03T22:45:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.910+0000 7f71dbe00700 1 --2- 172.21.15.44:0/3194726287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fa6580 0x5582e4fb1e10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00dfd0 tx=0x7f71cc0dfdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ad8aff204afd78 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.910+0000 7f71c6000700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:45:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.911+0000 7f71c6000700 1 -- 172.21.15.44:0/3194726287 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71cc0a9ad0 con 0x5582e4fa6580 2024-05-03T22:45:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.911+0000 7f71c6000700 1 -- 172.21.15.44:0/3194726287 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f71cc0b1fb0 con 0x5582e4fa6580 2024-05-03T22:45:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.911+0000 7f71ed347b80 1 -- 172.21.15.44:0/3194726287 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71cc013d00 con 0x5582e4fa6580 2024-05-03T22:45:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.911+0000 7f71c6000700 1 -- 172.21.15.44:0/3194726287 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f71cc0a93d0 con 0x5582e4fa6580 2024-05-03T22:45:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.911+0000 7f71ed347b80 10 client.15249 fetch_fsmap learned FSMap version 30 2024-05-03T22:45:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.911+0000 7f71ed347b80 1 -- 172.21.15.44:0/3194726287 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5582e4fbd3d0 con 0x5582e4fa6580 2024-05-03T22:45:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.911+0000 7f71c6000700 1 -- 172.21.15.44:0/3194726287 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f71cc013d00 con 0x5582e4fa6580 2024-05-03T22:45:22.914 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.912+0000 7f71c6000700 1 -- 172.21.15.44:0/3194726287 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f71cc0b0c90 con 0x5582e4fa6580 2024-05-03T22:45:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.912+0000 7f71ed347b80 10 client.15249 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:45:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.912+0000 7f71ed347b80 10 client.15249 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-03T22:45:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.912+0000 7f71ed347b80 20 client.15249 populate_metadata read hostname 'smithi044' 2024-05-03T22:45:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.912+0000 7f71ed347b80 1 --2- 172.21.15.44:0/3194726287 >> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] conn(0x5582e4fbe720 0x5582e4fc0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.912+0000 7f71ed347b80 4 client.15249 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:45:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.912+0000 7f71ed347b80 1 -- 172.21.15.44:0/3194726287 --> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582e4f73180 con 0x5582e4fbe720 2024-05-03T22:45:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.913+0000 7f71db400700 1 --2- 172.21.15.44:0/3194726287 >> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] conn(0x5582e4fbe720 0x5582e4fc0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:22.915 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.914+0000 7f71db400700 1 --2- 172.21.15.44:0/3194726287 >> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] conn(0x5582e4fbe720 0x5582e4fc0860 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2a8505abdc5b56a2 server_cookie=1e2ec512a860600 in_seq=0 out_seq=0 2024-05-03T22:45:22.916 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.914+0000 7f71c6000700 10 client.15249 ms_handle_connect on v2:172.21.15.60:6834/3390425489 2024-05-03T22:45:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.916+0000 7f71c6000700 1 -- 172.21.15.44:0/3194726287 <== mds.2 v2:172.21.15.60:6834/3390425489 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5582e4f73180 con 0x5582e4fbe720 2024-05-03T22:45:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.916+0000 7f71c6000700 10 client.15249 handle_command_reply: tid=0 2024-05-03T22:45:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.916+0000 7f71ed347b80 1 client.15249 shutdown 2024-05-03T22:45:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.916+0000 7f71ed347b80 1 -- 172.21.15.44:0/3194726287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fa6580 msgr2=0x5582e4fb1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:22.917 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.916+0000 7f71ed347b80 1 --2- 172.21.15.44:0/3194726287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fa6580 0x5582e4fb1e10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00dfd0 tx=0x7f71cc0dfdc0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.918 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.916+0000 7f71ed347b80 1 -- 172.21.15.44:0/3194726287 shutdown_connections 2024-05-03T22:45:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.916+0000 7f71ed347b80 1 --2- 172.21.15.44:0/3194726287 >> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] conn(0x5582e4fbe720 0x5582e4fc0860 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.916+0000 7f71c6000700 0 client.15249 ms_handle_reset on v2:172.21.15.60:6834/3390425489 2024-05-03T22:45:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.916+0000 7f71ed347b80 1 --2- 172.21.15.44:0/3194726287 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fab080 0x5582e4faf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.916+0000 7f71ed347b80 1 --2- 172.21.15.44:0/3194726287 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fa6580 0x5582e4fb1e10 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.916+0000 7f71ed347b80 1 --2- 172.21.15.44:0/3194726287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4faf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.916+0000 7f71ed347b80 1 -- 172.21.15.44:0/3194726287 >> 172.21.15.44:0/3194726287 conn(0x5582e4ed4b10 msgr2=0x5582e4f9f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.917+0000 7f71ed347b80 1 -- 172.21.15.44:0/3194726287 shutdown_connections 2024-05-03T22:45:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.917+0000 7f71ed347b80 1 -- 172.21.15.44:0/3194726287 wait complete. 2024-05-03T22:45:22.919 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.917+0000 7f71ed347b80 20 client.15249 trim_cache size 0 max 16384 2024-05-03T22:45:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.940+0000 7f71ed347b80 1 Processor -- start 2024-05-03T22:45:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.940+0000 7f71ed347b80 1 -- start start 2024-05-03T22:45:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.941+0000 7f71ed347b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fa6580 0x5582e4fafd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:22.942 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.941+0000 7f71ed347b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4fa0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.941+0000 7f71ed347b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fab080 0x5582e4fac470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.941+0000 7f71ed347b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5582e4fbeba0 con 0x5582e4fa6580 2024-05-03T22:45:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.941+0000 7f71ed347b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5582e4fbf270 con 0x5582e4faa760 2024-05-03T22:45:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.941+0000 7f71ed347b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5582e4fbf940 con 0x5582e4fab080 2024-05-03T22:45:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.941+0000 7f71dbe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fa6580 0x5582e4fafd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.941+0000 7f71dbe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fa6580 0x5582e4fafd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48290/0 (socket says 172.21.15.44:48290) 2024-05-03T22:45:22.943 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.941+0000 7f71dbe00700 1 -- 172.21.15.44:0/2462650988 learned_addr learned my addr 172.21.15.44:0/2462650988 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.941+0000 7f71e0a00700 1 --2- 172.21.15.44:0/2462650988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fab080 0x5582e4fac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.942+0000 7f71db400700 1 --2- 172.21.15.44:0/2462650988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4fa0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.942+0000 7f71dbe00700 1 -- 172.21.15.44:0/2462650988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fab080 msgr2=0x5582e4fac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.942+0000 7f71dbe00700 1 --2- 172.21.15.44:0/2462650988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fab080 0x5582e4fac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.942+0000 7f71dbe00700 1 -- 172.21.15.44:0/2462650988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 msgr2=0x5582e4fa0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.942+0000 7f71dbe00700 1 --2- 172.21.15.44:0/2462650988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4fa0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.944 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.942+0000 7f71dbe00700 1 -- 172.21.15.44:0/2462650988 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582e4fa2240 con 0x5582e4fa6580 2024-05-03T22:45:22.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.942+0000 7f71db400700 1 --2- 172.21.15.44:0/2462650988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4fa0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:45:22.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.942+0000 7f71dbe00700 1 --2- 172.21.15.44:0/2462650988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fa6580 0x5582e4fafd50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0a9080 tx=0x7f71cc005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79605a77642a25a server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:22.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.942+0000 7f71d0c00700 1 -- 172.21.15.44:0/2462650988 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71cc0a9ad0 con 0x5582e4fa6580 2024-05-03T22:45:22.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.943+0000 7f71d0c00700 1 -- 172.21.15.44:0/2462650988 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f71cc013cc0 con 0x5582e4fa6580 2024-05-03T22:45:22.945 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.943+0000 7f71d0c00700 1 -- 172.21.15.44:0/2462650988 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71cc0a5030 con 0x5582e4fa6580 2024-05-03T22:45:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.943+0000 7f71ed347b80 1 -- 172.21.15.44:0/2462650988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fa6580 msgr2=0x5582e4fafd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.943+0000 7f71ed347b80 1 --2- 172.21.15.44:0/2462650988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fa6580 0x5582e4fafd50 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0a9080 tx=0x7f71cc005e40 comp rx=0 tx=0).stop 2024-05-03T22:45:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.943+0000 7f71ed347b80 1 -- 172.21.15.44:0/2462650988 shutdown_connections 2024-05-03T22:45:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.943+0000 7f71ed347b80 1 --2- 172.21.15.44:0/2462650988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fab080 0x5582e4fac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.943+0000 7f71ed347b80 1 --2- 172.21.15.44:0/2462650988 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fa6580 0x5582e4fafd50 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.943+0000 7f71ed347b80 1 --2- 172.21.15.44:0/2462650988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4fa0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.943+0000 7f71ed347b80 1 -- 172.21.15.44:0/2462650988 >> 172.21.15.44:0/2462650988 conn(0x5582e4ed4b10 msgr2=0x5582e4fa4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.944+0000 7f71ed347b80 1 -- 172.21.15.44:0/2462650988 shutdown_connections 2024-05-03T22:45:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.944+0000 7f71ed347b80 1 -- 172.21.15.44:0/2462650988 wait complete. 2024-05-03T22:45:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.944+0000 7f71ed347b80 1 -- start start 2024-05-03T22:45:22.946 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.944+0000 7f71ed347b80 1 Processor -- start 2024-05-03T22:45:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.945+0000 7f71ed347b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fa6580 0x5582e4fc9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.945+0000 7f71ed347b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4fc4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.945+0000 7f71ed347b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fab080 0x5582e4fc51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.945+0000 7f71ed347b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x5582e4fc06e0 con 0x5582e4fab080 2024-05-03T22:45:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.945+0000 7f71ed347b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5582e4fc0010 con 0x5582e4faa760 2024-05-03T22:45:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.945+0000 7f71ed347b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5582e4fc0db0 con 0x5582e4fa6580 2024-05-03T22:45:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.945+0000 7f71ed347b80 10 client.0 _ll_register_callbacks cb 0x5582e4e9fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:45:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.945+0000 7f71dbe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fa6580 0x5582e4fc9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.946+0000 7f71dbe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fa6580 0x5582e4fc9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.44:60606/0 (socket says 172.21.15.44:60606) 2024-05-03T22:45:22.948 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.946+0000 7f71dbe00700 1 -- 172.21.15.44:0/3619806350 learned_addr learned my addr 172.21.15.44:0/3619806350 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.946+0000 7f71db400700 1 --2- 172.21.15.44:0/3619806350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4fc4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.946+0000 7f71e0a00700 1 --2- 172.21.15.44:0/3619806350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fab080 0x5582e4fc51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.946+0000 7f71dbe00700 1 -- 172.21.15.44:0/3619806350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 msgr2=0x5582e4fc4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.946+0000 7f71dbe00700 1 --2- 172.21.15.44:0/3619806350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4fc4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.946+0000 7f71dbe00700 1 -- 172.21.15.44:0/3619806350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fab080 msgr2=0x5582e4fc51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.946+0000 7f71dbe00700 1 --2- 172.21.15.44:0/3619806350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fab080 0x5582e4fc51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.946+0000 7f71dbe00700 1 -- 172.21.15.44:0/3619806350 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582e4faa3b0 con 0x5582e4fa6580 2024-05-03T22:45:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.946+0000 7f71db400700 1 --2- 172.21.15.44:0/3619806350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4fc4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-03T22:45:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.947+0000 7f71dbe00700 1 --2- 172.21.15.44:0/3619806350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fa6580 0x5582e4fc9ec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f71cc010fd0 tx=0x7f71cc00dee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=719eb4790e3bd2c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:22.949 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.947+0000 7f71c6000700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2024-05-03T22:45:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.947+0000 7f71c6000700 1 -- 172.21.15.44:0/3619806350 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71cc0a3d60 con 0x5582e4fa6580 2024-05-03T22:45:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.947+0000 7f71c6000700 1 -- 172.21.15.44:0/3619806350 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f71cc0b0d10 con 0x5582e4fa6580 2024-05-03T22:45:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.947+0000 7f71ed347b80 1 -- 172.21.15.44:0/3619806350 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71cc013cc0 con 0x5582e4fa6580 2024-05-03T22:45:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.948+0000 7f71c6000700 1 -- 172.21.15.44:0/3619806350 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f71cc0ad780 con 0x5582e4fa6580 2024-05-03T22:45:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.948+0000 7f71ed347b80 10 client.24991 fetch_fsmap learned FSMap version 30 2024-05-03T22:45:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.948+0000 7f71ed347b80 1 -- 172.21.15.44:0/3619806350 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5582e4fa2050 con 0x5582e4fa6580 2024-05-03T22:45:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.948+0000 7f71c6000700 1 -- 172.21.15.44:0/3619806350 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f71cc013cc0 con 0x5582e4fa6580 2024-05-03T22:45:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.948+0000 7f71c6000700 1 -- 172.21.15.44:0/3619806350 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f71cc0a80a0 con 0x5582e4fa6580 2024-05-03T22:45:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.948+0000 7f71ed347b80 10 client.24991 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:45:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.949+0000 7f71ed347b80 10 client.24991 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-03T22:45:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.949+0000 7f71ed347b80 20 client.24991 populate_metadata read hostname 'smithi044' 2024-05-03T22:45:22.951 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.949+0000 7f71ed347b80 1 --2- 172.21.15.44:0/3619806350 >> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] conn(0x5582e502f490 0x5582e502e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:22.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.949+0000 7f71ed347b80 4 client.24991 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:45:22.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.949+0000 7f71ed347b80 1 -- 172.21.15.44:0/3619806350 --> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] -- command(tid 0: {"prefix": "status"}) -- 0x5582e4f063b0 con 0x5582e502f490 2024-05-03T22:45:22.952 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.949+0000 7f71db400700 1 --2- 172.21.15.44:0/3619806350 >> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] conn(0x5582e502f490 0x5582e502e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:22.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.950+0000 7f71db400700 1 --2- 172.21.15.44:0/3619806350 >> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] conn(0x5582e502f490 0x5582e502e1a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d3ab90267a5ec83d server_cookie=4fd0794a405545db in_seq=0 out_seq=0 2024-05-03T22:45:22.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.950+0000 7f71c6000700 10 client.24991 ms_handle_connect on v2:172.21.15.60:6834/3390425489 2024-05-03T22:45:22.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.950+0000 7f71c6000700 1 -- 172.21.15.44:0/3619806350 <== mds.2 v2:172.21.15.60:6834/3390425489 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5582e4f063b0 con 0x5582e502f490 2024-05-03T22:45:22.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.950+0000 7f71c6000700 10 client.24991 handle_command_reply: tid=0 2024-05-03T22:45:22.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.951+0000 7f71ed347b80 1 client.24991 shutdown 2024-05-03T22:45:22.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.951+0000 7f71ed347b80 1 -- 172.21.15.44:0/3619806350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fa6580 msgr2=0x5582e4fc9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:22.953 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.951+0000 7f71ed347b80 1 --2- 172.21.15.44:0/3619806350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fa6580 0x5582e4fc9ec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f71cc010fd0 tx=0x7f71cc00dee0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.951+0000 7f71ed347b80 1 -- 172.21.15.44:0/3619806350 shutdown_connections 2024-05-03T22:45:22.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.951+0000 7f71ed347b80 1 --2- 172.21.15.44:0/3619806350 >> [v2:172.21.15.60:6834/3390425489,v1:172.21.15.60:6835/3390425489] conn(0x5582e502f490 0x5582e502e1a0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.951+0000 7f71ed347b80 1 --2- 172.21.15.44:0/3619806350 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x5582e4fab080 0x5582e4fc51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.951+0000 7f71ed347b80 1 --2- 172.21.15.44:0/3619806350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582e4fa6580 0x5582e4fc9ec0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.951+0000 7f71ed347b80 1 --2- 172.21.15.44:0/3619806350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5582e4faa760 0x5582e4fc4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.951+0000 7f71ed347b80 1 -- 172.21.15.44:0/3619806350 >> 172.21.15.44:0/3619806350 conn(0x5582e4ed4b10 msgr2=0x5582e4fa0660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:22.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.951+0000 7f71c6000700 0 client.24991 ms_handle_reset on v2:172.21.15.60:6834/3390425489 2024-05-03T22:45:22.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.951+0000 7f71ed347b80 1 -- 172.21.15.44:0/3619806350 shutdown_connections 2024-05-03T22:45:22.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.951+0000 7f71ed347b80 1 -- 172.21.15.44:0/3619806350 wait complete. 2024-05-03T22:45:22.954 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.951+0000 7f71ed347b80 20 client.24991 trim_cache size 0 max 16384 2024-05-03T22:45:22.955 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-03T22:45:22.955 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "5b0efdca-099c-11ef-bc97-c7b262605968", 2024-05-03T22:45:22.955 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 2, 2024-05-03T22:45:22.955 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 34409, 2024-05-03T22:45:22.955 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-05-03T22:45:22.955 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-05-03T22:45:22.955 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-05-03T22:45:22.955 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 223.78550567600001, 2024-05-03T22:45:22.955 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 30, 2024-05-03T22:45:22.955 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 89, 2024-05-03T22:45:22.955 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 87, 2024-05-03T22:45:22.955 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 363.17793832299998 2024-05-03T22:45:22.956 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-03T22:45:22.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.952+0000 7f71e2a00700 1 -- 172.21.15.44:0/405538378 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f71c00b2910 msgr2=0x7f71c00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:22.956 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.952+0000 7f71e2a00700 1 --2- 172.21.15.44:0/405538378 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f71c00b2910 0x7f71c00b4dd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f71d40060b0 tx=0x7f71d4007a50 comp rx=0 tx=0).stop 2024-05-03T22:45:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.952+0000 7f71e2a00700 1 -- 172.21.15.44:0/405538378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71dc103550 msgr2=0x7f71dc19bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.952+0000 7f71e2a00700 1 --2- 172.21.15.44:0/405538378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71dc103550 0x7f71dc19bed0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00d980 tx=0x7f71cc00dd40 comp rx=0 tx=0).stop 2024-05-03T22:45:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.952+0000 7f71e2a00700 1 -- 172.21.15.44:0/405538378 shutdown_connections 2024-05-03T22:45:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.952+0000 7f71e2a00700 1 --2- 172.21.15.44:0/405538378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71dc108460 0x7f71dc1a07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.952+0000 7f71e2a00700 1 --2- 172.21.15.44:0/405538378 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f71dc103550 0x7f71dc19bed0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.952+0000 7f71e2a00700 1 --2- 172.21.15.44:0/405538378 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f71c00b2910 0x7f71c00b4dd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.952+0000 7f71e2a00700 1 --2- 172.21.15.44:0/405538378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71dc103ef0 0x7f71dc19c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.952+0000 7f71e2a00700 1 -- 172.21.15.44:0/405538378 >> 172.21.15.44:0/405538378 conn(0x7f71dc07a600 msgr2=0x7f71dc1013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.953+0000 7f71e2a00700 1 -- 172.21.15.44:0/405538378 shutdown_connections 2024-05-03T22:45:22.957 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:22.953+0000 7f71e2a00700 1 -- 172.21.15.44:0/405538378 wait complete. 2024-05-03T22:45:23.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:23 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:45:23.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:23 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:45:23.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:23 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:45:23.834 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell mds.h status 2024-05-03T22:45:24.332 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:45:24.711 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:24 smithi044 ceph-mon[28604]: pgmap v536: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:24.712 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:24 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:45:24.712 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:24 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:45:24.712 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:24 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:45:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:24 smithi060 ceph-mon[31721]: pgmap v536: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:24 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:45:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:24 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:45:24.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:24 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:45:24.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:24 smithi160 ceph-mon[32531]: pgmap v536: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:24.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:24 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:45:24.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:24 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:45:24.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:24 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:45:26.475 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:26 smithi044 ceph-mon[28604]: pgmap v537: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:45:26.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:26 smithi060 ceph-mon[31721]: pgmap v537: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:45:26.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:26 smithi160 ceph-mon[32531]: pgmap v537: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:45:26.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.784+0000 7f7b24600700 1 -- 172.21.15.44:0/713051570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b1c114360 msgr2=0x7f7b1c116750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:26.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.784+0000 7f7b24600700 1 --2- 172.21.15.44:0/713051570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b1c114360 0x7f7b1c116750 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400b0a0 tx=0x7f7b1400b3b0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.784+0000 7f7b24600700 1 -- 172.21.15.44:0/713051570 shutdown_connections 2024-05-03T22:45:26.786 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.784+0000 7f7b24600700 1 --2- 172.21.15.44:0/713051570 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b1c114360 0x7f7b1c116750 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.784+0000 7f7b24600700 1 --2- 172.21.15.44:0/713051570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b1c0779d0 0x7f7b1c077db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.784+0000 7f7b24600700 1 --2- 172.21.15.44:0/713051570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b1c0782f0 0x7f7b1c113e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.784+0000 7f7b24600700 1 -- 172.21.15.44:0/713051570 >> 172.21.15.44:0/713051570 conn(0x7f7b1c1011d0 msgr2=0x7f7b1c1035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:26.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.785+0000 7f7b24600700 1 -- 172.21.15.44:0/713051570 shutdown_connections 2024-05-03T22:45:26.787 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.785+0000 7f7b24600700 1 -- 172.21.15.44:0/713051570 wait complete. 2024-05-03T22:45:26.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.786+0000 7f7b24600700 1 Processor -- start 2024-05-03T22:45:26.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.786+0000 7f7b24600700 1 -- start start 2024-05-03T22:45:26.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.786+0000 7f7b24600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b1c0779d0 0x7f7b1c1a0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:26.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.786+0000 7f7b24600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b1c0782f0 0x7f7b1c1a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:26.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.786+0000 7f7b24600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b1c114360 0x7f7b1c1a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:26.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.786+0000 7f7b24600700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c119f20 con 0x7f7b1c0782f0 2024-05-03T22:45:26.788 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.786+0000 7f7b24600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c119da0 con 0x7f7b1c114360 2024-05-03T22:45:26.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.786+0000 7f7b24600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c11a0a0 con 0x7f7b1c0779d0 2024-05-03T22:45:26.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.787+0000 7f7b21200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b1c0782f0 0x7f7b1c1a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:26.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.787+0000 7f7b21200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b1c0782f0 0x7f7b1c1a0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48334/0 (socket says 172.21.15.44:48334) 2024-05-03T22:45:26.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.787+0000 7f7b21200700 1 -- 172.21.15.44:0/3250211520 learned_addr learned my addr 172.21.15.44:0/3250211520 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:26.789 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.787+0000 7f7b21c00700 1 --2- 172.21.15.44:0/3250211520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b1c0779d0 0x7f7b1c1a0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:26.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.787+0000 7f7b22600700 1 --2- 172.21.15.44:0/3250211520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b1c114360 0x7f7b1c1a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:26.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.787+0000 7f7b21200700 1 -- 172.21.15.44:0/3250211520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b1c0779d0 msgr2=0x7f7b1c1a0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:26.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.787+0000 7f7b21200700 1 --2- 172.21.15.44:0/3250211520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b1c0779d0 0x7f7b1c1a0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.787+0000 7f7b21200700 1 -- 172.21.15.44:0/3250211520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b1c114360 msgr2=0x7f7b1c1a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:26.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.787+0000 7f7b21200700 1 --2- 172.21.15.44:0/3250211520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b1c114360 0x7f7b1c1a4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.787+0000 7f7b21200700 1 -- 172.21.15.44:0/3250211520 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c1a5410 con 0x7f7b1c0782f0 2024-05-03T22:45:26.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.788+0000 7f7b21200700 1 --2- 172.21.15.44:0/3250211520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b1c0782f0 0x7f7b1c1a0990 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800b530 tx=0x7f7b0800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:26.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.788+0000 7f7b1a000700 1 -- 172.21.15.44:0/3250211520 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b08015020 con 0x7f7b1c0782f0 2024-05-03T22:45:26.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.788+0000 7f7b1a000700 1 -- 172.21.15.44:0/3250211520 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f7b08011d00 con 0x7f7b1c0782f0 2024-05-03T22:45:26.790 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.788+0000 7f7b24600700 1 -- 172.21.15.44:0/3250211520 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1c1a5700 con 0x7f7b1c0782f0 2024-05-03T22:45:26.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.788+0000 7f7b1a000700 1 -- 172.21.15.44:0/3250211520 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b08010dd0 con 0x7f7b1c0782f0 2024-05-03T22:45:26.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.788+0000 7f7b24600700 1 -- 172.21.15.44:0/3250211520 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1c1acf80 con 0x7f7b1c0782f0 2024-05-03T22:45:26.793 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.792+0000 7f7b1a000700 1 -- 172.21.15.44:0/3250211520 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f7b08018020 con 0x7f7b1c0782f0 2024-05-03T22:45:26.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.793+0000 7f7b2f004b80 1 Processor -- start 2024-05-03T22:45:26.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.793+0000 7f7b2f004b80 1 -- start start 2024-05-03T22:45:26.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.793+0000 7f7b1a000700 1 --2- 172.21.15.44:0/3250211520 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7b040b2990 0x7f7b040b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:26.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.793+0000 7f7b1a000700 1 -- 172.21.15.44:0/3250211520 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f7b080e1ed0 con 0x7f7b1c0782f0 2024-05-03T22:45:26.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.793+0000 7f7b2f004b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f86760 0x562e18f86b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:26.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.794+0000 7f7b2f004b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f87080 0x562e18f81f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:26.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.794+0000 7f7b2f004b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f82580 0x562e18f829e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:26.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.794+0000 7f7b22600700 1 --2- 172.21.15.44:0/3250211520 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7b040b2990 0x7f7b040b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:26.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.794+0000 7f7b2f004b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562e18ed49d0 con 0x562e18f86760 2024-05-03T22:45:26.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.794+0000 7f7b2f004b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x562e18e72710 con 0x562e18f87080 2024-05-03T22:45:26.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.794+0000 7f7b2f004b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562e18ed0990 con 0x562e18f82580 2024-05-03T22:45:26.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.794+0000 7f7b21c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f86760 0x562e18f86b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:26.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.794+0000 7f7b21c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f86760 0x562e18f86b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48338/0 (socket says 172.21.15.44:48338) 2024-05-03T22:45:26.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.794+0000 7f7b21c00700 1 -- 172.21.15.44:0/142899723 learned_addr learned my addr 172.21.15.44:0/142899723 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:26.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.794+0000 7f7b21200700 1 --2- 172.21.15.44:0/142899723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f87080 0x562e18f81f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:26.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.795+0000 7f7b21c00700 1 -- 172.21.15.44:0/142899723 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f82580 msgr2=0x562e18f829e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:26.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.795+0000 7f7b22600700 1 --2- 172.21.15.44:0/142899723 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f82580 0x562e18f829e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:26.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.795+0000 7f7b21c00700 1 --2- 172.21.15.44:0/142899723 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f82580 0x562e18f829e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.795+0000 7f7b21c00700 1 -- 172.21.15.44:0/142899723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f87080 msgr2=0x562e18f81f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:26.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.795+0000 7f7b21c00700 1 --2- 172.21.15.44:0/142899723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f87080 0x562e18f81f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.795+0000 7f7b21c00700 1 -- 172.21.15.44:0/142899723 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e18e21880 con 0x562e18f86760 2024-05-03T22:45:26.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.795+0000 7f7b21200700 1 --2- 172.21.15.44:0/142899723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f87080 0x562e18f81f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T22:45:26.798 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.795+0000 7f7b22600700 1 --2- 172.21.15.44:0/142899723 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f82580 0x562e18f829e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:45:26.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.795+0000 7f7b22600700 1 --2- 172.21.15.44:0/3250211520 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7b040b2990 0x7f7b040b4e50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400b830 tx=0x7f7b140091d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:26.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.795+0000 7f7b21c00700 1 --2- 172.21.15.44:0/142899723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f86760 0x562e18f86b40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7b10007810 tx=0x7f7b10007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fffd106a7eb70b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:26.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.795+0000 7f7b0ea00700 1 -- 172.21.15.44:0/142899723 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b100125f0 con 0x562e18f86760 2024-05-03T22:45:26.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.795+0000 7f7b0ea00700 1 -- 172.21.15.44:0/142899723 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f7b10018070 con 0x562e18f86760 2024-05-03T22:45:26.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.796+0000 7f7b0ea00700 1 -- 172.21.15.44:0/142899723 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10013da0 con 0x562e18f86760 2024-05-03T22:45:26.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.796+0000 7f7b2f004b80 1 -- 172.21.15.44:0/142899723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f86760 msgr2=0x562e18f86b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:26.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.796+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/142899723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f86760 0x562e18f86b40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f7b10007810 tx=0x7f7b10007b20 comp rx=0 tx=0).stop 2024-05-03T22:45:26.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.797+0000 7f7b2f004b80 1 -- 172.21.15.44:0/142899723 shutdown_connections 2024-05-03T22:45:26.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.797+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/142899723 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f82580 0x562e18f829e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.797+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/142899723 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f86760 0x562e18f86b40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.797+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/142899723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f87080 0x562e18f81f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.797+0000 7f7b2f004b80 1 -- 172.21.15.44:0/142899723 >> 172.21.15.44:0/142899723 conn(0x562e18eb0b10 msgr2=0x562e18f7c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:26.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.797+0000 7f7b2f004b80 1 -- 172.21.15.44:0/142899723 shutdown_connections 2024-05-03T22:45:26.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.797+0000 7f7b2f004b80 1 -- 172.21.15.44:0/142899723 wait complete. 2024-05-03T22:45:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.797+0000 7f7b2f004b80 1 -- start start 2024-05-03T22:45:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.798+0000 7f7b2f004b80 1 Processor -- start 2024-05-03T22:45:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.798+0000 7f7b2f004b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f82580 0x562e18f8de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.798+0000 7f7b2f004b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f86760 0x562e18f8b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.798+0000 7f7b2f004b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f87080 0x562e18f8b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.798+0000 7f7b2f004b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562e18f8ec50 con 0x562e18f86760 2024-05-03T22:45:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.798+0000 7f7b2f004b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x562e18e3aad0 con 0x562e18f82580 2024-05-03T22:45:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.798+0000 7f7b2f004b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562e18f8edd0 con 0x562e18f87080 2024-05-03T22:45:26.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.798+0000 7f7b2f004b80 10 client.0 _ll_register_callbacks cb 0x562e18e7bc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:45:26.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.799+0000 7f7b21200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f86760 0x562e18f8b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:26.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.799+0000 7f7b21200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f86760 0x562e18f8b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48352/0 (socket says 172.21.15.44:48352) 2024-05-03T22:45:26.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.799+0000 7f7b21200700 1 -- 172.21.15.44:0/1562907156 learned_addr learned my addr 172.21.15.44:0/1562907156 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:26.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.799+0000 7f7b21c00700 1 --2- 172.21.15.44:0/1562907156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f82580 0x562e18f8de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:26.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.799+0000 7f7b22600700 1 --2- 172.21.15.44:0/1562907156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f87080 0x562e18f8b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:26.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.799+0000 7f7b21200700 1 -- 172.21.15.44:0/1562907156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f87080 msgr2=0x562e18f8b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:26.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.799+0000 7f7b21200700 1 --2- 172.21.15.44:0/1562907156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f87080 0x562e18f8b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.799+0000 7f7b21200700 1 -- 172.21.15.44:0/1562907156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f82580 msgr2=0x562e18f8de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:26.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.799+0000 7f7b21200700 1 --2- 172.21.15.44:0/1562907156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f82580 0x562e18f8de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.799+0000 7f7b21200700 1 -- 172.21.15.44:0/1562907156 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e18e9a3d0 con 0x562e18f86760 2024-05-03T22:45:26.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.799+0000 7f7b21c00700 1 --2- 172.21.15.44:0/1562907156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f82580 0x562e18f8de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:45:26.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.799+0000 7f7b22600700 1 --2- 172.21.15.44:0/1562907156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f87080 0x562e18f8b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:45:26.802 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.799+0000 7f7b21200700 1 --2- 172.21.15.44:0/1562907156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f86760 0x562e18f8b220 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7b080a8d30 tx=0x7f7b080a88a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9bf1f645e5c7dd server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:26.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.799+0000 7f7b03400700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:45:26.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.801+0000 7f7b03400700 1 -- 172.21.15.44:0/1562907156 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b080c2020 con 0x562e18f86760 2024-05-03T22:45:26.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.801+0000 7f7b03400700 1 -- 172.21.15.44:0/1562907156 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f7b080b1c10 con 0x562e18f86760 2024-05-03T22:45:26.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.801+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1562907156 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b10018070 con 0x562e18f86760 2024-05-03T22:45:26.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.801+0000 7f7b03400700 1 -- 172.21.15.44:0/1562907156 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7b080a9030 con 0x562e18f86760 2024-05-03T22:45:26.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.801+0000 7f7b2f004b80 10 client.15267 fetch_fsmap learned FSMap version 30 2024-05-03T22:45:26.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.801+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1562907156 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562e18f99450 con 0x562e18f86760 2024-05-03T22:45:26.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.801+0000 7f7b03400700 1 -- 172.21.15.44:0/1562907156 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f7b10018070 con 0x562e18f86760 2024-05-03T22:45:26.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.802+0000 7f7b03400700 1 -- 172.21.15.44:0/1562907156 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f7b080a49a0 con 0x562e18f86760 2024-05-03T22:45:26.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.802+0000 7f7b2f004b80 10 client.15267 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:45:26.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.802+0000 7f7b2f004b80 10 client.15267 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-03T22:45:26.804 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.802+0000 7f7b2f004b80 20 client.15267 populate_metadata read hostname 'smithi044' 2024-05-03T22:45:26.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.802+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/1562907156 >> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] conn(0x562e18f9ba80 0x562e18f9cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:26.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.802+0000 7f7b2f004b80 4 client.15267 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:45:26.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.802+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1562907156 --> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e18f4f180 con 0x562e18f9ba80 2024-05-03T22:45:26.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.802+0000 7f7b21c00700 1 --2- 172.21.15.44:0/1562907156 >> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] conn(0x562e18f9ba80 0x562e18f9cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:26.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.803+0000 7f7b21c00700 1 --2- 172.21.15.44:0/1562907156 >> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] conn(0x562e18f9ba80 0x562e18f9cef0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=57b234788a5e34e2 server_cookie=2575bf0614ca76d in_seq=0 out_seq=0 2024-05-03T22:45:26.805 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.803+0000 7f7b03400700 10 client.15267 ms_handle_connect on v2:172.21.15.60:6836/3568217572 2024-05-03T22:45:26.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.805+0000 7f7b03400700 1 -- 172.21.15.44:0/1562907156 <== mds.1 v2:172.21.15.60:6836/3568217572 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562e18f4f180 con 0x562e18f9ba80 2024-05-03T22:45:26.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.806+0000 7f7b03400700 10 client.15267 handle_command_reply: tid=0 2024-05-03T22:45:26.807 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.806+0000 7f7b2f004b80 1 client.15267 shutdown 2024-05-03T22:45:26.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.806+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1562907156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f86760 msgr2=0x562e18f8b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:26.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.806+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/1562907156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f86760 0x562e18f8b220 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7b080a8d30 tx=0x7f7b080a88a0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.806+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1562907156 shutdown_connections 2024-05-03T22:45:26.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.806+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/1562907156 >> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] conn(0x562e18f9ba80 0x562e18f9cef0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.806+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/1562907156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f87080 0x562e18f8b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.806+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/1562907156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f82580 0x562e18f8de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.806+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/1562907156 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f86760 0x562e18f8b220 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.806+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1562907156 >> 172.21.15.44:0/1562907156 conn(0x562e18eb0b10 msgr2=0x562e18f7b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:26.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.806+0000 7f7b03400700 0 client.15267 ms_handle_reset on v2:172.21.15.60:6836/3568217572 2024-05-03T22:45:26.808 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.806+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1562907156 shutdown_connections 2024-05-03T22:45:26.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.806+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1562907156 wait complete. 2024-05-03T22:45:26.809 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.806+0000 7f7b2f004b80 20 client.15267 trim_cache size 0 max 16384 2024-05-03T22:45:26.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.830+0000 7f7b2f004b80 1 Processor -- start 2024-05-03T22:45:26.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.830+0000 7f7b2f004b80 1 -- start start 2024-05-03T22:45:26.833 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.830+0000 7f7b2f004b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f82580 0x562e18f9ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.830+0000 7f7b2f004b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f86760 0x562e18f7c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.830+0000 7f7b2f004b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f87080 0x562e18f8b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.830+0000 7f7b2f004b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562e18f9b230 con 0x562e18f82580 2024-05-03T22:45:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.830+0000 7f7b2f004b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x562e18f9b900 con 0x562e18f86760 2024-05-03T22:45:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.830+0000 7f7b2f004b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562e18f9bfd0 con 0x562e18f87080 2024-05-03T22:45:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.831+0000 7f7b21c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f82580 0x562e18f9ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.831+0000 7f7b21c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f82580 0x562e18f9ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48354/0 (socket says 172.21.15.44:48354) 2024-05-03T22:45:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.831+0000 7f7b21c00700 1 -- 172.21.15.44:0/1368434077 learned_addr learned my addr 172.21.15.44:0/1368434077 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.831+0000 7f7b22600700 1 --2- 172.21.15.44:0/1368434077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f87080 0x562e18f8b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.831+0000 7f7b21200700 1 --2- 172.21.15.44:0/1368434077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f86760 0x562e18f7c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.831+0000 7f7b21c00700 1 -- 172.21.15.44:0/1368434077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f87080 msgr2=0x562e18f8b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.831+0000 7f7b21c00700 1 --2- 172.21.15.44:0/1368434077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f87080 0x562e18f8b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.834 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.831+0000 7f7b21c00700 1 -- 172.21.15.44:0/1368434077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f86760 msgr2=0x562e18f7c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:26.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.831+0000 7f7b21c00700 1 --2- 172.21.15.44:0/1368434077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f86760 0x562e18f7c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.831+0000 7f7b21c00700 1 -- 172.21.15.44:0/1368434077 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e18f863b0 con 0x562e18f82580 2024-05-03T22:45:26.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.831+0000 7f7b21c00700 1 --2- 172.21.15.44:0/1368434077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f82580 0x562e18f9ac30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7b10007810 tx=0x7f7b10008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7fbfe662209cda3 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:26.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.832+0000 7f7b0e000700 1 -- 172.21.15.44:0/1368434077 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10013970 con 0x562e18f82580 2024-05-03T22:45:26.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.832+0000 7f7b0e000700 1 -- 172.21.15.44:0/1368434077 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f7b1002c070 con 0x562e18f82580 2024-05-03T22:45:26.835 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.832+0000 7f7b0e000700 1 -- 172.21.15.44:0/1368434077 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b100125f0 con 0x562e18f82580 2024-05-03T22:45:26.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.833+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1368434077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f82580 msgr2=0x562e18f9ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:26.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.833+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/1368434077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f82580 0x562e18f9ac30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7b10007810 tx=0x7f7b10008040 comp rx=0 tx=0).stop 2024-05-03T22:45:26.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.833+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1368434077 shutdown_connections 2024-05-03T22:45:26.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.833+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/1368434077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f87080 0x562e18f8b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.833+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/1368434077 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f82580 0x562e18f9ac30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.833+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/1368434077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f86760 0x562e18f7c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.833+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1368434077 >> 172.21.15.44:0/1368434077 conn(0x562e18eb0b10 msgr2=0x562e18f8a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:26.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.833+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1368434077 shutdown_connections 2024-05-03T22:45:26.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.833+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1368434077 wait complete. 2024-05-03T22:45:26.837 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.833+0000 7f7b2f004b80 1 -- start start 2024-05-03T22:45:26.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.834+0000 7f7b2f004b80 1 Processor -- start 2024-05-03T22:45:26.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.834+0000 7f7b2f004b80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f82580 0x562e18fa0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:26.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.834+0000 7f7b2f004b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f86760 0x562e18fa0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:26.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.834+0000 7f7b2f004b80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f87080 0x562e18fa4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:26.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.834+0000 7f7b2f004b80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x562e18f9cd70 con 0x562e18f82580 2024-05-03T22:45:26.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.834+0000 7f7b2f004b80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x562e18f9c6a0 con 0x562e18f87080 2024-05-03T22:45:26.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.834+0000 7f7b2f004b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562e18f9d440 con 0x562e18f86760 2024-05-03T22:45:26.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.834+0000 7f7b2f004b80 10 client.0 _ll_register_callbacks cb 0x562e18e7bc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:45:26.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.834+0000 7f7b21c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f82580 0x562e18fa0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:26.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.834+0000 7f7b21c00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f82580 0x562e18fa0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48356/0 (socket says 172.21.15.44:48356) 2024-05-03T22:45:26.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.834+0000 7f7b21c00700 1 -- 172.21.15.44:0/1881670921 learned_addr learned my addr 172.21.15.44:0/1881670921 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:26.838 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.835+0000 7f7b21200700 1 --2- 172.21.15.44:0/1881670921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f86760 0x562e18fa0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.835+0000 7f7b22600700 1 --2- 172.21.15.44:0/1881670921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f87080 0x562e18fa4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.835+0000 7f7b21c00700 1 -- 172.21.15.44:0/1881670921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f86760 msgr2=0x562e18fa0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.835+0000 7f7b21c00700 1 --2- 172.21.15.44:0/1881670921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f86760 0x562e18fa0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.835+0000 7f7b21c00700 1 -- 172.21.15.44:0/1881670921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f87080 msgr2=0x562e18fa4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.835+0000 7f7b21c00700 1 --2- 172.21.15.44:0/1881670921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f87080 0x562e18fa4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.835+0000 7f7b21c00700 1 -- 172.21.15.44:0/1881670921 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e18fa53a0 con 0x562e18f82580 2024-05-03T22:45:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.835+0000 7f7b21c00700 1 --2- 172.21.15.44:0/1881670921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f82580 0x562e18fa0710 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7b10008010 tx=0x7f7b10013810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eed46477b8ea132 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.835+0000 7f7b03400700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:45:26.839 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.835+0000 7f7b03400700 1 -- 172.21.15.44:0/1881670921 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b10034070 con 0x562e18f82580 2024-05-03T22:45:26.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.836+0000 7f7b03400700 1 -- 172.21.15.44:0/1881670921 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f7b10013b10 con 0x562e18f82580 2024-05-03T22:45:26.840 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.836+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1881670921 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b1002c070 con 0x562e18f82580 2024-05-03T22:45:26.841 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.836+0000 7f7b03400700 1 -- 172.21.15.44:0/1881670921 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7b10027350 con 0x562e18f82580 2024-05-03T22:45:26.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.836+0000 7f7b2f004b80 10 client.15273 fetch_fsmap learned FSMap version 30 2024-05-03T22:45:26.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.836+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1881670921 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x562e19007880 con 0x562e18f82580 2024-05-03T22:45:26.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.836+0000 7f7b03400700 1 -- 172.21.15.44:0/1881670921 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f7b1002c070 con 0x562e18f82580 2024-05-03T22:45:26.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.836+0000 7f7b03400700 1 -- 172.21.15.44:0/1881670921 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f7b10030420 con 0x562e18f82580 2024-05-03T22:45:26.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.836+0000 7f7b2f004b80 10 client.15273 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:45:26.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.837+0000 7f7b2f004b80 10 client.15273 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-03T22:45:26.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.837+0000 7f7b2f004b80 20 client.15273 populate_metadata read hostname 'smithi044' 2024-05-03T22:45:26.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.837+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/1881670921 >> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] conn(0x562e1900bd70 0x562e1900aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:26.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.837+0000 7f7b2f004b80 4 client.15273 mds_command: new command op to 34427 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:45:26.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.837+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1881670921 --> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] -- command(tid 0: {"prefix": "status"}) -- 0x562e18ee23b0 con 0x562e1900bd70 2024-05-03T22:45:26.842 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.837+0000 7f7b21200700 1 --2- 172.21.15.44:0/1881670921 >> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] conn(0x562e1900bd70 0x562e1900aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:26.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.838+0000 7f7b21200700 1 --2- 172.21.15.44:0/1881670921 >> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] conn(0x562e1900bd70 0x562e1900aa80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cc5d3f394a51d397 server_cookie=9882e5db1177ea49 in_seq=0 out_seq=0 2024-05-03T22:45:26.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.838+0000 7f7b03400700 10 client.15273 ms_handle_connect on v2:172.21.15.60:6836/3568217572 2024-05-03T22:45:26.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.839+0000 7f7b03400700 1 -- 172.21.15.44:0/1881670921 <== mds.1 v2:172.21.15.60:6836/3568217572 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562e18ee23b0 con 0x562e1900bd70 2024-05-03T22:45:26.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.839+0000 7f7b03400700 10 client.15273 handle_command_reply: tid=0 2024-05-03T22:45:26.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.839+0000 7f7b2f004b80 1 client.15273 shutdown 2024-05-03T22:45:26.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.839+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1881670921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f82580 msgr2=0x562e18fa0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:26.843 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.839+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/1881670921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f82580 0x562e18fa0710 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7b10008010 tx=0x7f7b10013810 comp rx=0 tx=0).stop 2024-05-03T22:45:26.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.839+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1881670921 shutdown_connections 2024-05-03T22:45:26.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.839+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/1881670921 >> [v2:172.21.15.60:6836/3568217572,v1:172.21.15.60:6837/3568217572] conn(0x562e1900bd70 0x562e1900aa80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.839+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/1881670921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562e18f87080 0x562e18fa4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.839+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/1881670921 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x562e18f82580 0x562e18fa0710 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.839+0000 7f7b2f004b80 1 --2- 172.21.15.44:0/1881670921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e18f86760 0x562e18fa0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.839+0000 7f7b03400700 0 client.15273 ms_handle_reset on v2:172.21.15.60:6836/3568217572 2024-05-03T22:45:26.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.839+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1881670921 >> 172.21.15.44:0/1881670921 conn(0x562e18eb0b10 msgr2=0x562e18f8b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:26.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.839+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1881670921 shutdown_connections 2024-05-03T22:45:26.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.839+0000 7f7b2f004b80 1 -- 172.21.15.44:0/1881670921 wait complete. 2024-05-03T22:45:26.844 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.839+0000 7f7b2f004b80 20 client.15273 trim_cache size 0 max 16384 2024-05-03T22:45:26.845 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-03T22:45:26.845 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "5b0efdca-099c-11ef-bc97-c7b262605968", 2024-05-03T22:45:26.845 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 1, 2024-05-03T22:45:26.845 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 34427, 2024-05-03T22:45:26.845 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-05-03T22:45:26.845 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-05-03T22:45:26.845 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-05-03T22:45:26.845 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 228.686935815, 2024-05-03T22:45:26.845 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 30, 2024-05-03T22:45:26.845 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 89, 2024-05-03T22:45:26.845 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 87, 2024-05-03T22:45:26.845 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 354.57571406599999 2024-05-03T22:45:26.846 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-03T22:45:26.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.840+0000 7f7b24600700 1 -- 172.21.15.44:0/3250211520 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7b040b2990 msgr2=0x7f7b040b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:26.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.840+0000 7f7b24600700 1 --2- 172.21.15.44:0/3250211520 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7b040b2990 0x7f7b040b4e50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400b830 tx=0x7f7b140091d0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.840+0000 7f7b24600700 1 -- 172.21.15.44:0/3250211520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b1c0782f0 msgr2=0x7f7b1c1a0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:26.846 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.840+0000 7f7b24600700 1 --2- 172.21.15.44:0/3250211520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b1c0782f0 0x7f7b1c1a0990 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800b530 tx=0x7f7b0800b8f0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.840+0000 7f7b24600700 1 -- 172.21.15.44:0/3250211520 shutdown_connections 2024-05-03T22:45:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.840+0000 7f7b24600700 1 --2- 172.21.15.44:0/3250211520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b1c114360 0x7f7b1c1a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.840+0000 7f7b24600700 1 --2- 172.21.15.44:0/3250211520 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7b040b2990 0x7f7b040b4e50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.840+0000 7f7b24600700 1 --2- 172.21.15.44:0/3250211520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b1c0779d0 0x7f7b1c1a0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.840+0000 7f7b24600700 1 --2- 172.21.15.44:0/3250211520 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7b1c0782f0 0x7f7b1c1a0990 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.840+0000 7f7b24600700 1 -- 172.21.15.44:0/3250211520 >> 172.21.15.44:0/3250211520 conn(0x7f7b1c1011d0 msgr2=0x7f7b1c1035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.840+0000 7f7b24600700 1 -- 172.21.15.44:0/3250211520 shutdown_connections 2024-05-03T22:45:26.847 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:26.840+0000 7f7b24600700 1 -- 172.21.15.44:0/3250211520 wait complete. 2024-05-03T22:45:27.865 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-03T22:45:28.323 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:45:28.680 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:28 smithi044 ceph-mon[28604]: pgmap v538: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:28.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:28 smithi060 ceph-mon[31721]: pgmap v538: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:28.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:28 smithi160 ceph-mon[32531]: pgmap v538: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:30.491 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:30 smithi044 ceph-mon[28604]: pgmap v539: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:45:30.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.661+0000 7f0234a00700 1 -- 172.21.15.44:0/3174298703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023010a3a0 msgr2=0x7f0230116840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:30.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.661+0000 7f0234a00700 1 --2- 172.21.15.44:0/3174298703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023010a3a0 0x7f0230116840 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f022800b0a0 tx=0x7f022800b3b0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.663 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.661+0000 7f0234a00700 1 -- 172.21.15.44:0/3174298703 shutdown_connections 2024-05-03T22:45:30.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.661+0000 7f0234a00700 1 --2- 172.21.15.44:0/3174298703 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023010a3a0 0x7f0230116840 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.661+0000 7f0234a00700 1 --2- 172.21.15.44:0/3174298703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f023010e8b0 0x7f023010ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.661+0000 7f0234a00700 1 --2- 172.21.15.44:0/3174298703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02301099e0 0x7f0230109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.661+0000 7f0234a00700 1 -- 172.21.15.44:0/3174298703 >> 172.21.15.44:0/3174298703 conn(0x7f0230079230 msgr2=0x7f02301082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:30.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.661+0000 7f0234a00700 1 -- 172.21.15.44:0/3174298703 shutdown_connections 2024-05-03T22:45:30.664 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.661+0000 7f0234a00700 1 -- 172.21.15.44:0/3174298703 wait complete. 2024-05-03T22:45:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.662+0000 7f0234a00700 1 Processor -- start 2024-05-03T22:45:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.662+0000 7f0234a00700 1 -- start start 2024-05-03T22:45:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.663+0000 7f0234a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02301099e0 0x7f02301a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.663+0000 7f0234a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023010a3a0 0x7f02301a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.663+0000 7f0234a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f023010e8b0 0x7f02301a49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.663+0000 7f0234a00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f0230119d20 con 0x7f023010a3a0 2024-05-03T22:45:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.663+0000 7f0234a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0230119ba0 con 0x7f023010e8b0 2024-05-03T22:45:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.663+0000 7f0234a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0230119ea0 con 0x7f02301099e0 2024-05-03T22:45:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.663+0000 7f0226a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023010a3a0 0x7f02301a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:30.666 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.663+0000 7f0226a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023010a3a0 0x7f02301a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59208/0 (socket says 172.21.15.44:59208) 2024-05-03T22:45:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.663+0000 7f0226a00700 1 -- 172.21.15.44:0/1842330998 learned_addr learned my addr 172.21.15.44:0/1842330998 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.663+0000 7f022f400700 1 --2- 172.21.15.44:0/1842330998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02301099e0 0x7f02301a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.664+0000 7f022fe00700 1 --2- 172.21.15.44:0/1842330998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f023010e8b0 0x7f02301a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.664+0000 7f0226a00700 1 -- 172.21.15.44:0/1842330998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02301099e0 msgr2=0x7f02301a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.664+0000 7f0226a00700 1 --2- 172.21.15.44:0/1842330998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02301099e0 0x7f02301a0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.664+0000 7f0226a00700 1 -- 172.21.15.44:0/1842330998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f023010e8b0 msgr2=0x7f02301a49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.664+0000 7f0226a00700 1 --2- 172.21.15.44:0/1842330998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f023010e8b0 0x7f02301a49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.664+0000 7f0226a00700 1 -- 172.21.15.44:0/1842330998 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02301a50f0 con 0x7f023010a3a0 2024-05-03T22:45:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.664+0000 7f0226a00700 1 --2- 172.21.15.44:0/1842330998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023010a3a0 0x7f02301a0670 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f021800d980 tx=0x7f021800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.664+0000 7f022cc00700 1 -- 172.21.15.44:0/1842330998 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0218016070 con 0x7f023010a3a0 2024-05-03T22:45:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.664+0000 7f022cc00700 1 -- 172.21.15.44:0/1842330998 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f02180044f0 con 0x7f023010a3a0 2024-05-03T22:45:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.664+0000 7f022cc00700 1 -- 172.21.15.44:0/1842330998 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0218004cf0 con 0x7f023010a3a0 2024-05-03T22:45:30.667 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.664+0000 7f0234a00700 1 -- 172.21.15.44:0/1842330998 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02301a53e0 con 0x7f023010a3a0 2024-05-03T22:45:30.668 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.665+0000 7f0234a00700 1 -- 172.21.15.44:0/1842330998 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02301acc60 con 0x7f023010a3a0 2024-05-03T22:45:30.669 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.668+0000 7f022cc00700 1 -- 172.21.15.44:0/1842330998 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f021800bc80 con 0x7f023010a3a0 2024-05-03T22:45:30.670 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.669+0000 7f0240a5eb80 1 Processor -- start 2024-05-03T22:45:30.671 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.670+0000 7f0240a5eb80 1 -- start start 2024-05-03T22:45:30.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.670+0000 7f0240a5eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf0379f9f0 0x55cf0379fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:30.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.670+0000 7f0240a5eb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf037a0310 0x55cf03799f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:30.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.670+0000 7f0240a5eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf0379a580 0x55cf0379a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:30.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.670+0000 7f0240a5eb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cf036ec9d0 con 0x55cf037a0310 2024-05-03T22:45:30.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.670+0000 7f0240a5eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55cf0368a710 con 0x55cf0379f9f0 2024-05-03T22:45:30.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.670+0000 7f0240a5eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55cf036e8990 con 0x55cf0379a580 2024-05-03T22:45:30.672 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.670+0000 7f022cc00700 1 --2- 172.21.15.44:0/1842330998 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f02140b2910 0x7f02140b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:30.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.670+0000 7f022f400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf037a0310 0x55cf03799f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:30.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.670+0000 7f022f400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf037a0310 0x55cf03799f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59218/0 (socket says 172.21.15.44:59218) 2024-05-03T22:45:30.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.670+0000 7f022f400700 1 -- 172.21.15.44:0/3523212059 learned_addr learned my addr 172.21.15.44:0/3523212059 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:30.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.671+0000 7f022fe00700 1 --2- 172.21.15.44:0/3523212059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf0379f9f0 0x55cf0379fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:30.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.671+0000 7f0226a00700 1 --2- 172.21.15.44:0/3523212059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf0379a580 0x55cf0379a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:30.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.671+0000 7f022cc00700 1 -- 172.21.15.44:0/1842330998 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f02180e26b0 con 0x7f023010a3a0 2024-05-03T22:45:30.673 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.671+0000 7f022fe00700 1 --2- 172.21.15.44:0/1842330998 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f02140b2910 0x7f02140b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:30.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.671+0000 7f022f400700 1 -- 172.21.15.44:0/3523212059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf0379a580 msgr2=0x55cf0379a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:30.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.671+0000 7f022f400700 1 --2- 172.21.15.44:0/3523212059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf0379a580 0x55cf0379a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.671+0000 7f022f400700 1 -- 172.21.15.44:0/3523212059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf0379f9f0 msgr2=0x55cf0379fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:30.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.671+0000 7f022f400700 1 --2- 172.21.15.44:0/3523212059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf0379f9f0 0x55cf0379fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.671+0000 7f022f400700 1 -- 172.21.15.44:0/3523212059 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf03639880 con 0x55cf037a0310 2024-05-03T22:45:30.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.672+0000 7f022f400700 1 --2- 172.21.15.44:0/3523212059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf037a0310 0x55cf03799f60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f022000dcb0 tx=0x7f022000f360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e4bbf34e4cf667 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:30.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.672+0000 7f0224c00700 1 -- 172.21.15.44:0/3523212059 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022000fbe0 con 0x55cf037a0310 2024-05-03T22:45:30.675 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.672+0000 7f022fe00700 1 --2- 172.21.15.44:0/1842330998 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f02140b2910 0x7f02140b4dd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f022800bf50 tx=0x7f02280061f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.672+0000 7f0224c00700 1 -- 172.21.15.44:0/3523212059 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f022000fd80 con 0x55cf037a0310 2024-05-03T22:45:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.672+0000 7f0224c00700 1 -- 172.21.15.44:0/3523212059 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0220011440 con 0x55cf037a0310 2024-05-03T22:45:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.673+0000 7f0240a5eb80 1 -- 172.21.15.44:0/3523212059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf037a0310 msgr2=0x55cf03799f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.673+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/3523212059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf037a0310 0x55cf03799f60 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f022000dcb0 tx=0x7f022000f360 comp rx=0 tx=0).stop 2024-05-03T22:45:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.673+0000 7f0240a5eb80 1 -- 172.21.15.44:0/3523212059 shutdown_connections 2024-05-03T22:45:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.673+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/3523212059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf0379a580 0x55cf0379a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.673+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/3523212059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf0379f9f0 0x55cf0379fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.673+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/3523212059 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf037a0310 0x55cf03799f60 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.673+0000 7f0240a5eb80 1 -- 172.21.15.44:0/3523212059 >> 172.21.15.44:0/3523212059 conn(0x55cf036c8b10 msgr2=0x55cf03794980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.673+0000 7f0240a5eb80 1 -- 172.21.15.44:0/3523212059 shutdown_connections 2024-05-03T22:45:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.673+0000 7f0240a5eb80 1 -- 172.21.15.44:0/3523212059 wait complete. 2024-05-03T22:45:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.674+0000 7f0240a5eb80 1 -- start start 2024-05-03T22:45:30.676 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.674+0000 7f0240a5eb80 1 Processor -- start 2024-05-03T22:45:30.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.674+0000 7f0240a5eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf0379a580 0x55cf037a5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:30.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.674+0000 7f0240a5eb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 0x55cf037a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:30.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.674+0000 7f0240a5eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf037a0310 0x55cf037a38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:30.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.674+0000 7f0240a5eb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cf037a6d80 con 0x55cf0379f9f0 2024-05-03T22:45:30.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.674+0000 7f0240a5eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55cf03652ad0 con 0x55cf037a0310 2024-05-03T22:45:30.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.674+0000 7f0240a5eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55cf037a6f00 con 0x55cf0379a580 2024-05-03T22:45:30.679 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.674+0000 7f0240a5eb80 10 client.0 _ll_register_callbacks cb 0x55cf03693c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:45:30.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.675+0000 7f0226a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 0x55cf037a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:30.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.675+0000 7f0226a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 0x55cf037a33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59222/0 (socket says 172.21.15.44:59222) 2024-05-03T22:45:30.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.675+0000 7f0226a00700 1 -- 172.21.15.44:0/2055740657 learned_addr learned my addr 172.21.15.44:0/2055740657 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:30.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.675+0000 7f022f400700 1 --2- 172.21.15.44:0/2055740657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf0379a580 0x55cf037a5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:30.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.675+0000 7f022fe00700 1 --2- 172.21.15.44:0/2055740657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf037a0310 0x55cf037a38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:30.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.675+0000 7f0226a00700 1 -- 172.21.15.44:0/2055740657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf0379a580 msgr2=0x55cf037a5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:30.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.675+0000 7f0226a00700 1 --2- 172.21.15.44:0/2055740657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf0379a580 0x55cf037a5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.675+0000 7f0226a00700 1 -- 172.21.15.44:0/2055740657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf037a0310 msgr2=0x55cf037a38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:30.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.675+0000 7f0226a00700 1 --2- 172.21.15.44:0/2055740657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf037a0310 0x55cf037a38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.675+0000 7f0226a00700 1 -- 172.21.15.44:0/2055740657 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf036b23d0 con 0x55cf0379f9f0 2024-05-03T22:45:30.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.675+0000 7f022fe00700 1 --2- 172.21.15.44:0/2055740657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf037a0310 0x55cf037a38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:45:30.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.676+0000 7f0226a00700 1 --2- 172.21.15.44:0/2055740657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 0x55cf037a33a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f02180046a0 tx=0x7f02180a9170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3002a4f73cfa53 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:30.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.676+0000 7f021d600700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:45:30.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.676+0000 7f021d600700 1 -- 172.21.15.44:0/2055740657 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02180a9e00 con 0x55cf0379f9f0 2024-05-03T22:45:30.680 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.676+0000 7f021d600700 1 -- 172.21.15.44:0/2055740657 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f021800fc70 con 0x55cf0379f9f0 2024-05-03T22:45:30.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.676+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2055740657 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f022000fd80 con 0x55cf0379f9f0 2024-05-03T22:45:30.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.676+0000 7f021d600700 1 -- 172.21.15.44:0/2055740657 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f021806a030 con 0x55cf0379f9f0 2024-05-03T22:45:30.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.676+0000 7f0240a5eb80 10 client.15285 fetch_fsmap learned FSMap version 30 2024-05-03T22:45:30.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.676+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2055740657 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cf037b1600 con 0x55cf0379f9f0 2024-05-03T22:45:30.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.677+0000 7f021d600700 1 -- 172.21.15.44:0/2055740657 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f022000fd80 con 0x55cf0379f9f0 2024-05-03T22:45:30.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.677+0000 7f021d600700 1 -- 172.21.15.44:0/2055740657 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f02180a9960 con 0x55cf0379f9f0 2024-05-03T22:45:30.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.677+0000 7f0240a5eb80 10 client.15285 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:45:30.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.677+0000 7f0240a5eb80 10 client.15285 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-03T22:45:30.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.677+0000 7f0240a5eb80 20 client.15285 populate_metadata read hostname 'smithi044' 2024-05-03T22:45:30.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.677+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/2055740657 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x55cf037b3c10 0x55cf037b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:30.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.677+0000 7f0240a5eb80 4 client.15285 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-03T22:45:30.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.677+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2055740657 --> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf03767180 con 0x55cf037b3c10 2024-05-03T22:45:30.681 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.678+0000 7f022f400700 1 --2- 172.21.15.44:0/2055740657 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x55cf037b3c10 0x55cf037b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:30.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.679+0000 7f022f400700 1 --2- 172.21.15.44:0/2055740657 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x55cf037b3c10 0x55cf037b5080 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d579a464f4718d1 server_cookie=4f893ab4b6b6addb in_seq=0 out_seq=0 2024-05-03T22:45:30.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.679+0000 7f021d600700 10 client.15285 ms_handle_connect on v2:172.21.15.60:6838/2420093605 2024-05-03T22:45:30.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.681+0000 7f021d600700 1 -- 172.21.15.44:0/2055740657 <== mds.0 v2:172.21.15.60:6838/2420093605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cf03767180 con 0x55cf037b3c10 2024-05-03T22:45:30.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.681+0000 7f021d600700 10 client.15285 handle_command_reply: tid=0 2024-05-03T22:45:30.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.681+0000 7f0240a5eb80 1 client.15285 shutdown 2024-05-03T22:45:30.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.681+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2055740657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 msgr2=0x55cf037a33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:30.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.681+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/2055740657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 0x55cf037a33a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f02180046a0 tx=0x7f02180a9170 comp rx=0 tx=0).stop 2024-05-03T22:45:30.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.681+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2055740657 shutdown_connections 2024-05-03T22:45:30.683 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.681+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/2055740657 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x55cf037b3c10 0x55cf037b5080 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.681+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/2055740657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf037a0310 0x55cf037a38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.681+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/2055740657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf0379a580 0x55cf037a5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.681+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/2055740657 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 0x55cf037a33a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.681+0000 7f021d600700 0 client.15285 ms_handle_reset on v2:172.21.15.60:6838/2420093605 2024-05-03T22:45:30.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.681+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2055740657 >> 172.21.15.44:0/2055740657 conn(0x55cf036c8b10 msgr2=0x55cf03794030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:30.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.681+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2055740657 shutdown_connections 2024-05-03T22:45:30.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.681+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2055740657 wait complete. 2024-05-03T22:45:30.684 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.682+0000 7f0240a5eb80 20 client.15285 trim_cache size 0 max 16384 2024-05-03T22:45:30.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.705+0000 7f0240a5eb80 1 Processor -- start 2024-05-03T22:45:30.706 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.705+0000 7f0240a5eb80 1 -- start start 2024-05-03T22:45:30.707 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.706+0000 7f0240a5eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf0379a580 0x55cf03799f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.706+0000 7f0240a5eb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 0x55cf0379d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.706+0000 7f0240a5eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf037a0310 0x55cf0379d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.706+0000 7f0240a5eb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cf037b33c0 con 0x55cf0379f9f0 2024-05-03T22:45:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.706+0000 7f0240a5eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55cf037b3a90 con 0x55cf0379a580 2024-05-03T22:45:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.706+0000 7f0240a5eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55cf037b4160 con 0x55cf037a0310 2024-05-03T22:45:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.706+0000 7f0226a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 0x55cf0379d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.706+0000 7f0226a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 0x55cf0379d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59238/0 (socket says 172.21.15.44:59238) 2024-05-03T22:45:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.706+0000 7f0226a00700 1 -- 172.21.15.44:0/2036420858 learned_addr learned my addr 172.21.15.44:0/2036420858 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.706+0000 7f022f400700 1 --2- 172.21.15.44:0/2036420858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf0379a580 0x55cf03799f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:30.708 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.706+0000 7f022fe00700 1 --2- 172.21.15.44:0/2036420858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf037a0310 0x55cf0379d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.707+0000 7f0226a00700 1 -- 172.21.15.44:0/2036420858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf037a0310 msgr2=0x55cf0379d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.707+0000 7f0226a00700 1 --2- 172.21.15.44:0/2036420858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf037a0310 0x55cf0379d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.707+0000 7f0226a00700 1 -- 172.21.15.44:0/2036420858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf0379a580 msgr2=0x55cf03799f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.707+0000 7f0226a00700 1 --2- 172.21.15.44:0/2036420858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf0379a580 0x55cf03799f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.707+0000 7f0226a00700 1 -- 172.21.15.44:0/2036420858 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf037a0110 con 0x55cf0379f9f0 2024-05-03T22:45:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.707+0000 7f0226a00700 1 --2- 172.21.15.44:0/2036420858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 0x55cf0379d490 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f02180a9400 tx=0x7f021800b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e2dcefc0a5220d server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.707+0000 7f021fe00700 1 -- 172.21.15.44:0/2036420858 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02180c9030 con 0x55cf0379f9f0 2024-05-03T22:45:30.710 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.707+0000 7f021fe00700 1 -- 172.21.15.44:0/2036420858 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f02180a9e00 con 0x55cf0379f9f0 2024-05-03T22:45:30.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.707+0000 7f021fe00700 1 -- 172.21.15.44:0/2036420858 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02180912d0 con 0x55cf0379f9f0 2024-05-03T22:45:30.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.708+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2036420858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 msgr2=0x55cf0379d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:30.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.708+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/2036420858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 0x55cf0379d490 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f02180a9400 tx=0x7f021800b6e0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.708+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2036420858 shutdown_connections 2024-05-03T22:45:30.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.708+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/2036420858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf037a0310 0x55cf0379d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.708+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/2036420858 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf0379a580 0x55cf03799f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.708+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/2036420858 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 0x55cf0379d490 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.708+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2036420858 >> 172.21.15.44:0/2036420858 conn(0x55cf036c8b10 msgr2=0x55cf037a3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:30.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.708+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2036420858 shutdown_connections 2024-05-03T22:45:30.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.708+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2036420858 wait complete. 2024-05-03T22:45:30.711 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.709+0000 7f0240a5eb80 1 -- start start 2024-05-03T22:45:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.709+0000 7f0240a5eb80 1 Processor -- start 2024-05-03T22:45:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.709+0000 7f0240a5eb80 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf0379a580 0x55cf037a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.709+0000 7f0240a5eb80 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 0x55cf037a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.709+0000 7f0240a5eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf037a0310 0x55cf037a5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.709+0000 7f0240a5eb80 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x55cf037b4f00 con 0x55cf0379f9f0 2024-05-03T22:45:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.709+0000 7f0240a5eb80 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55cf037b4830 con 0x55cf0379a580 2024-05-03T22:45:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.709+0000 7f0240a5eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55cf037b55d0 con 0x55cf037a0310 2024-05-03T22:45:30.714 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.710+0000 7f0240a5eb80 10 client.0 _ll_register_callbacks cb 0x55cf03693c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-03T22:45:30.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.710+0000 7f0226a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 0x55cf037a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:30.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.710+0000 7f0226a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 0x55cf037a4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59240/0 (socket says 172.21.15.44:59240) 2024-05-03T22:45:30.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.710+0000 7f0226a00700 1 -- 172.21.15.44:0/2672626622 learned_addr learned my addr 172.21.15.44:0/2672626622 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:30.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.710+0000 7f022f400700 1 --2- 172.21.15.44:0/2672626622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf0379a580 0x55cf037a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:30.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.710+0000 7f022fe00700 1 --2- 172.21.15.44:0/2672626622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf037a0310 0x55cf037a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:30.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.710+0000 7f0226a00700 1 -- 172.21.15.44:0/2672626622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf037a0310 msgr2=0x55cf037a5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:30.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.710+0000 7f0226a00700 1 --2- 172.21.15.44:0/2672626622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf037a0310 0x55cf037a5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.710+0000 7f0226a00700 1 -- 172.21.15.44:0/2672626622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf0379a580 msgr2=0x55cf037a4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-03T22:45:30.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.710+0000 7f0226a00700 1 --2- 172.21.15.44:0/2672626622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf0379a580 0x55cf037a4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.710+0000 7f0226a00700 1 -- 172.21.15.44:0/2672626622 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf037bcc60 con 0x55cf0379f9f0 2024-05-03T22:45:30.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.710+0000 7f022fe00700 1 --2- 172.21.15.44:0/2672626622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf037a0310 0x55cf037a5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:45:30.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.711+0000 7f0226a00700 1 --2- 172.21.15.44:0/2672626622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 0x55cf037a4fd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f02180046a0 tx=0x7f021800df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359cc04a35b66f54 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:30.715 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.711+0000 7f021d600700 10 client.0 ms_handle_connect on v2:172.21.15.44:3300/0 2024-05-03T22:45:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.711+0000 7f021d600700 1 -- 172.21.15.44:0/2672626622 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02180c9030 con 0x55cf0379f9f0 2024-05-03T22:45:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.711+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2672626622 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02180a9e00 con 0x55cf0379f9f0 2024-05-03T22:45:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.711+0000 7f021d600700 1 -- 172.21.15.44:0/2672626622 <== mon.0 v2:172.21.15.44:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f021806b040 con 0x55cf0379f9f0 2024-05-03T22:45:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.711+0000 7f021d600700 1 -- 172.21.15.44:0/2672626622 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f02180a9700 con 0x55cf0379f9f0 2024-05-03T22:45:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.711+0000 7f0240a5eb80 10 client.15291 fetch_fsmap learned FSMap version 30 2024-05-03T22:45:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.711+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2672626622 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cf0381f5d0 con 0x55cf0379f9f0 2024-05-03T22:45:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.711+0000 7f021d600700 1 -- 172.21.15.44:0/2672626622 <== mon.0 v2:172.21.15.44:3300/0 4 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f02180a9e00 con 0x55cf0379f9f0 2024-05-03T22:45:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.712+0000 7f021d600700 1 -- 172.21.15.44:0/2672626622 <== mon.0 v2:172.21.15.44:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f0218004020 con 0x55cf0379f9f0 2024-05-03T22:45:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.712+0000 7f0240a5eb80 10 client.15291 fetch_fsmap finished waiting for FSMap version 30 2024-05-03T22:45:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.712+0000 7f0240a5eb80 10 client.15291 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-03T22:45:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.712+0000 7f0240a5eb80 20 client.15291 populate_metadata read hostname 'smithi044' 2024-05-03T22:45:30.716 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.712+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/2672626622 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x55cf03823d10 0x55cf03822a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:30.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.712+0000 7f0240a5eb80 4 client.15291 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-03T22:45:30.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.712+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2672626622 --> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] -- command(tid 0: {"prefix": "status"}) -- 0x55cf036fa3b0 con 0x55cf03823d10 2024-05-03T22:45:30.717 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.712+0000 7f022f400700 1 --2- 172.21.15.44:0/2672626622 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x55cf03823d10 0x55cf03822a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:30.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.713+0000 7f022f400700 1 --2- 172.21.15.44:0/2672626622 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x55cf03823d10 0x55cf03822a20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e032499c8a3c2f4 server_cookie=eaa927d3e44ac21f in_seq=0 out_seq=0 2024-05-03T22:45:30.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.713+0000 7f021d600700 10 client.15291 ms_handle_connect on v2:172.21.15.60:6838/2420093605 2024-05-03T22:45:30.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.714+0000 7f021d600700 1 -- 172.21.15.44:0/2672626622 <== mds.0 v2:172.21.15.60:6838/2420093605 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55cf036fa3b0 con 0x55cf03823d10 2024-05-03T22:45:30.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.714+0000 7f021d600700 10 client.15291 handle_command_reply: tid=0 2024-05-03T22:45:30.718 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.714+0000 7f0240a5eb80 1 client.15291 shutdown 2024-05-03T22:45:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.714+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2672626622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 msgr2=0x55cf037a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.714+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/2672626622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 0x55cf037a4fd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f02180046a0 tx=0x7f021800df60 comp rx=0 tx=0).stop 2024-05-03T22:45:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.714+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2672626622 shutdown_connections 2024-05-03T22:45:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.714+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/2672626622 >> [v2:172.21.15.60:6838/2420093605,v1:172.21.15.60:6839/2420093605] conn(0x55cf03823d10 0x55cf03822a20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.714+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/2672626622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf037a0310 0x55cf037a5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.714+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/2672626622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55cf0379a580 0x55cf037a4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.714+0000 7f0240a5eb80 1 --2- 172.21.15.44:0/2672626622 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x55cf0379f9f0 0x55cf037a4fd0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.714+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2672626622 >> 172.21.15.44:0/2672626622 conn(0x55cf036c8b10 msgr2=0x55cf037a3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.714+0000 7f021d600700 0 client.15291 ms_handle_reset on v2:172.21.15.60:6838/2420093605 2024-05-03T22:45:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.714+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2672626622 shutdown_connections 2024-05-03T22:45:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.714+0000 7f0240a5eb80 1 -- 172.21.15.44:0/2672626622 wait complete. 2024-05-03T22:45:30.719 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.715+0000 7f0240a5eb80 20 client.15291 trim_cache size 0 max 16384 2024-05-03T22:45:30.719 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-03T22:45:30.720 INFO:teuthology.orchestra.run.smithi044.stdout: "cluster_fsid": "5b0efdca-099c-11ef-bc97-c7b262605968", 2024-05-03T22:45:30.720 INFO:teuthology.orchestra.run.smithi044.stdout: "whoami": 0, 2024-05-03T22:45:30.720 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 34463, 2024-05-03T22:45:30.720 INFO:teuthology.orchestra.run.smithi044.stdout: "want_state": "up:active", 2024-05-03T22:45:30.720 INFO:teuthology.orchestra.run.smithi044.stdout: "state": "up:active", 2024-05-03T22:45:30.720 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs", 2024-05-03T22:45:30.720 INFO:teuthology.orchestra.run.smithi044.stdout: "rank_uptime": 315.89707978600001, 2024-05-03T22:45:30.720 INFO:teuthology.orchestra.run.smithi044.stdout: "mdsmap_epoch": 30, 2024-05-03T22:45:30.720 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch": 89, 2024-05-03T22:45:30.720 INFO:teuthology.orchestra.run.smithi044.stdout: "osdmap_epoch_barrier": 87, 2024-05-03T22:45:30.720 INFO:teuthology.orchestra.run.smithi044.stdout: "uptime": 338.95380455100002 2024-05-03T22:45:30.720 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-03T22:45:30.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.715+0000 7f0234a00700 1 -- 172.21.15.44:0/1842330998 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f02140b2910 msgr2=0x7f02140b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:30.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.715+0000 7f0234a00700 1 --2- 172.21.15.44:0/1842330998 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f02140b2910 0x7f02140b4dd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f022800bf50 tx=0x7f02280061f0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.715+0000 7f0234a00700 1 -- 172.21.15.44:0/1842330998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023010a3a0 msgr2=0x7f02301a0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:30.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.715+0000 7f0234a00700 1 --2- 172.21.15.44:0/1842330998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023010a3a0 0x7f02301a0670 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f021800d980 tx=0x7f021800dd40 comp rx=0 tx=0).stop 2024-05-03T22:45:30.721 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.715+0000 7f0234a00700 1 -- 172.21.15.44:0/1842330998 shutdown_connections 2024-05-03T22:45:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.715+0000 7f0234a00700 1 --2- 172.21.15.44:0/1842330998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f023010e8b0 0x7f02301a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.715+0000 7f0234a00700 1 --2- 172.21.15.44:0/1842330998 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f02140b2910 0x7f02140b4dd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.715+0000 7f0234a00700 1 --2- 172.21.15.44:0/1842330998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02301099e0 0x7f02301a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.715+0000 7f0234a00700 1 --2- 172.21.15.44:0/1842330998 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f023010a3a0 0x7f02301a0670 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.715+0000 7f0234a00700 1 -- 172.21.15.44:0/1842330998 >> 172.21.15.44:0/1842330998 conn(0x7f0230079230 msgr2=0x7f02300797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.716+0000 7f0234a00700 1 -- 172.21.15.44:0/1842330998 shutdown_connections 2024-05-03T22:45:30.722 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:30.716+0000 7f0234a00700 1 -- 172.21.15.44:0/1842330998 wait complete. 2024-05-03T22:45:30.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:30 smithi060 ceph-mon[31721]: pgmap v539: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:45:30.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:30 smithi160 ceph-mon[32531]: pgmap v539: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:45:31.630 INFO:teuthology.run_tasks:Running task sequential... 2024-05-03T22:45:31.640 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-03T22:45:31.640 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-03T22:45:31.641 INFO:teuthology.task.print:Enabling mgr modules 2024-05-03T22:45:31.641 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-03T22:45:31.703 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-03T22:45:31.704 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-03T22:45:31.704 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-05-03T22:45:31.704 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-03T22:45:31.704 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-03T22:45:31.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:45:31.704 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-05-03T22:45:31.766 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-03T22:45:31.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:45:31.767 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-03T22:45:31.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:45:31.869 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2024-05-03T22:45:31.983 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-03T22:45:31.984 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-03T22:45:32.442 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T22:45:32.665 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:32 smithi044 ceph-mon[28604]: pgmap v540: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:45:32.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:32 smithi060 ceph-mon[31721]: pgmap v540: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:45:32.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:32 smithi160 ceph-mon[32531]: pgmap v540: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:45:34.485 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:34 smithi044 ceph-mon[28604]: pgmap v541: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:34.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:34 smithi060 ceph-mon[31721]: pgmap v541: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:34.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:34 smithi160 ceph-mon[32531]: pgmap v541: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:34.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.789+0000 7fb996800700 1 -- 172.21.15.44:0/1185791055 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb99010a490 msgr2=0x7fb9901169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:34.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.789+0000 7fb996800700 1 --2- 172.21.15.44:0/1185791055 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb99010a490 0x7fb9901169a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb98800b0a0 tx=0x7fb98800b3b0 comp rx=0 tx=0).stop 2024-05-03T22:45:34.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.789+0000 7fb996800700 1 -- 172.21.15.44:0/1185791055 shutdown_connections 2024-05-03T22:45:34.791 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.789+0000 7fb996800700 1 --2- 172.21.15.44:0/1185791055 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb99010a490 0x7fb9901169a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:34.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.789+0000 7fb996800700 1 --2- 172.21.15.44:0/1185791055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb99010fb60 0x7fb99010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:34.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.789+0000 7fb996800700 1 --2- 172.21.15.44:0/1185791055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb990109ad0 0x7fb990109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:34.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.789+0000 7fb996800700 1 -- 172.21.15.44:0/1185791055 >> 172.21.15.44:0/1185791055 conn(0x7fb990076c70 msgr2=0x7fb9901082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:34.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.789+0000 7fb996800700 1 -- 172.21.15.44:0/1185791055 shutdown_connections 2024-05-03T22:45:34.792 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.789+0000 7fb996800700 1 -- 172.21.15.44:0/1185791055 wait complete. 2024-05-03T22:45:34.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.790+0000 7fb996800700 1 Processor -- start 2024-05-03T22:45:34.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.790+0000 7fb996800700 1 -- start start 2024-05-03T22:45:34.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.791+0000 7fb996800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb990109ad0 0x7fb9901a0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:34.794 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.791+0000 7fb996800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb99010a490 0x7fb9901a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:34.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.791+0000 7fb996800700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb99010fb60 0x7fb9901a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:34.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.791+0000 7fb996800700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fb990119e30 con 0x7fb99010a490 2024-05-03T22:45:34.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.791+0000 7fb996800700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb990119cb0 con 0x7fb990109ad0 2024-05-03T22:45:34.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.791+0000 7fb996800700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb990119fb0 con 0x7fb99010fb60 2024-05-03T22:45:34.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.791+0000 7fb987e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb99010a490 0x7fb9901a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:34.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.791+0000 7fb987e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb99010a490 0x7fb9901a0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:59256/0 (socket says 172.21.15.44:59256) 2024-05-03T22:45:34.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.791+0000 7fb987e00700 1 -- 172.21.15.44:0/2987658183 learned_addr learned my addr 172.21.15.44:0/2987658183 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:34.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.792+0000 7fb98fe00700 1 --2- 172.21.15.44:0/2987658183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb99010fb60 0x7fb9901a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:34.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.792+0000 7fb98f400700 1 --2- 172.21.15.44:0/2987658183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb990109ad0 0x7fb9901a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:34.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.792+0000 7fb987e00700 1 -- 172.21.15.44:0/2987658183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb99010fb60 msgr2=0x7fb9901a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:34.795 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.792+0000 7fb987e00700 1 --2- 172.21.15.44:0/2987658183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb99010fb60 0x7fb9901a4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:34.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.792+0000 7fb987e00700 1 -- 172.21.15.44:0/2987658183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb990109ad0 msgr2=0x7fb9901a0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:34.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.792+0000 7fb987e00700 1 --2- 172.21.15.44:0/2987658183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb990109ad0 0x7fb9901a0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:34.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.792+0000 7fb987e00700 1 -- 172.21.15.44:0/2987658183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9901a5210 con 0x7fb99010a490 2024-05-03T22:45:34.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.792+0000 7fb98f400700 1 --2- 172.21.15.44:0/2987658183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb990109ad0 0x7fb9901a0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:45:34.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.792+0000 7fb987e00700 1 --2- 172.21.15.44:0/2987658183 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb99010a490 0x7fb9901a0740 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb97800d950 tx=0x7fb97800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:34.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.792+0000 7fb98cc00700 1 -- 172.21.15.44:0/2987658183 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978016070 con 0x7fb99010a490 2024-05-03T22:45:34.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.792+0000 7fb98cc00700 1 -- 172.21.15.44:0/2987658183 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fb978009b40 con 0x7fb99010a490 2024-05-03T22:45:34.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.792+0000 7fb996800700 1 -- 172.21.15.44:0/2987658183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9901a5500 con 0x7fb99010a490 2024-05-03T22:45:34.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.792+0000 7fb98cc00700 1 -- 172.21.15.44:0/2987658183 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97800f620 con 0x7fb99010a490 2024-05-03T22:45:34.796 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.793+0000 7fb996800700 1 -- 172.21.15.44:0/2987658183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9901acd80 con 0x7fb99010a490 2024-05-03T22:45:34.797 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.794+0000 7fb996800700 1 -- 172.21.15.44:0/2987658183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb99006a190 con 0x7fb99010a490 2024-05-03T22:45:34.799 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.798+0000 7fb98cc00700 1 -- 172.21.15.44:0/2987658183 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb978019070 con 0x7fb99010a490 2024-05-03T22:45:34.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.799+0000 7fb98cc00700 1 --2- 172.21.15.44:0/2987658183 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb9740b2990 0x7fb9740b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:34.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.800+0000 7fb98cc00700 1 -- 172.21.15.44:0/2987658183 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fb9780e28b0 con 0x7fb99010a490 2024-05-03T22:45:34.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.800+0000 7fb98f400700 1 --2- 172.21.15.44:0/2987658183 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb9740b2990 0x7fb9740b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:34.801 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.800+0000 7fb98f400700 1 --2- 172.21.15.44:0/2987658183 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb9740b2990 0x7fb9740b4e50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb980009b50 tx=0x7fb980009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:34.803 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:34.802+0000 7fb98cc00700 1 -- 172.21.15.44:0/2987658183 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fb9780aa000 con 0x7fb99010a490 2024-05-03T22:45:35.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:35.089+0000 7fb996800700 1 -- 172.21.15.44:0/2987658183 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb99002e510 con 0x7fb99010a490 2024-05-03T22:45:35.091 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:35.090+0000 7fb98cc00700 1 -- 172.21.15.44:0/2987658183 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) ==== 53+0+88 (secure 0 0 0) 0x7fb9780a9900 con 0x7fb99010a490 2024-05-03T22:45:35.092 INFO:teuthology.orchestra.run.smithi044.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-03T22:45:35.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:35.093+0000 7fb996800700 1 -- 172.21.15.44:0/2987658183 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb9740b2990 msgr2=0x7fb9740b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:35.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:35.093+0000 7fb996800700 1 --2- 172.21.15.44:0/2987658183 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb9740b2990 0x7fb9740b4e50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb980009b50 tx=0x7fb980009550 comp rx=0 tx=0).stop 2024-05-03T22:45:35.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:35.093+0000 7fb996800700 1 -- 172.21.15.44:0/2987658183 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb99010a490 msgr2=0x7fb9901a0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:35.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:35.093+0000 7fb996800700 1 --2- 172.21.15.44:0/2987658183 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb99010a490 0x7fb9901a0740 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb97800d950 tx=0x7fb97800dd10 comp rx=0 tx=0).stop 2024-05-03T22:45:35.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:35.093+0000 7fb996800700 1 -- 172.21.15.44:0/2987658183 shutdown_connections 2024-05-03T22:45:35.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:35.093+0000 7fb996800700 1 --2- 172.21.15.44:0/2987658183 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fb9740b2990 0x7fb9740b4e50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:35.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:35.093+0000 7fb996800700 1 --2- 172.21.15.44:0/2987658183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb99010fb60 0x7fb9901a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:35.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:35.093+0000 7fb996800700 1 --2- 172.21.15.44:0/2987658183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb990109ad0 0x7fb9901a0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:35.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:35.093+0000 7fb996800700 1 --2- 172.21.15.44:0/2987658183 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fb99010a490 0x7fb9901a0740 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:35.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:35.093+0000 7fb996800700 1 -- 172.21.15.44:0/2987658183 >> 172.21.15.44:0/2987658183 conn(0x7fb990076c70 msgr2=0x7fb990077190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:35.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:35.094+0000 7fb996800700 1 -- 172.21.15.44:0/2987658183 shutdown_connections 2024-05-03T22:45:35.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:35.094+0000 7fb996800700 1 -- 172.21.15.44:0/2987658183 wait complete. 2024-05-03T22:45:35.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:35 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2987658183' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-03T22:45:35.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:35 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2987658183' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-03T22:45:35.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:35 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2987658183' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-03T22:45:36.068 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-03T22:45:36.068 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-03T22:45:36.068 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi044.front.sepia.ceph.com 2024-05-03T22:45:36.068 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-03T22:45:36.068 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-03T22:45:36.068 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-03T22:45:36.068 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-03T22:45:36.068 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-03T22:45:36.068 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-03T22:45:36.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:45:36.069 DEBUG:teuthology.orchestra.run.smithi044:> ip addr 2024-05-03T22:45:36.129 INFO:teuthology.orchestra.run.smithi044.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-03T22:45:36.129 INFO:teuthology.orchestra.run.smithi044.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-03T22:45:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: inet 127.0.0.1/8 scope host lo 2024-05-03T22:45:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-05-03T22:45:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 ::1/128 scope host 2024-05-03T22:45:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-05-03T22:45:36.130 INFO:teuthology.orchestra.run.smithi044.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-03T22:45:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8c brd ff:ff:ff:ff:ff:ff 2024-05-03T22:45:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f0 2024-05-03T22:45:36.130 INFO:teuthology.orchestra.run.smithi044.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-03T22:45:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:6b:f7:8d brd ff:ff:ff:ff:ff:ff 2024-05-03T22:45:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp7s0f1 2024-05-03T22:45:36.130 INFO:teuthology.orchestra.run.smithi044.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-03T22:45:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:72 brd ff:ff:ff:ff:ff:ff 2024-05-03T22:45:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f0 2024-05-03T22:45:36.130 INFO:teuthology.orchestra.run.smithi044.stdout: inet 172.21.15.44/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-03T22:45:36.131 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft 41593sec preferred_lft 41593sec 2024-05-03T22:45:36.131 INFO:teuthology.orchestra.run.smithi044.stdout: inet6 fe80::ec4:7aff:febd:1572/64 scope link noprefixroute 2024-05-03T22:45:36.131 INFO:teuthology.orchestra.run.smithi044.stdout: valid_lft forever preferred_lft forever 2024-05-03T22:45:36.131 INFO:teuthology.orchestra.run.smithi044.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-03T22:45:36.131 INFO:teuthology.orchestra.run.smithi044.stdout: link/ether 0c:c4:7a:bd:15:73 brd ff:ff:ff:ff:ff:ff 2024-05-03T22:45:36.131 INFO:teuthology.orchestra.run.smithi044.stdout: altname enp1s0f1 2024-05-03T22:45:36.132 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-03T22:45:36.132 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:45:36.132 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-05-03T22:45:36.132 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add name ceph-brx type bridge 2024-05-03T22:45:36.132 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr flush dev ceph-brx 2024-05-03T22:45:36.132 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set ceph-brx up 2024-05-03T22:45:36.132 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-03T22:45:36.132 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-05-03T22:45:36.249 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:45:36.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:45:36.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:45:36.401 DEBUG:teuthology.orchestra.run.smithi044:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-03T22:45:36.476 INFO:teuthology.orchestra.run.smithi044.stdout:1 2024-05-03T22:45:36.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:45:36.480 DEBUG:teuthology.orchestra.run.smithi044:> route 2024-05-03T22:45:36.534 INFO:teuthology.orchestra.run.smithi044.stdout:Kernel IP routing table 2024-05-03T22:45:36.535 INFO:teuthology.orchestra.run.smithi044.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-03T22:45:36.535 INFO:teuthology.orchestra.run.smithi044.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-03T22:45:36.535 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-03T22:45:36.535 INFO:teuthology.orchestra.run.smithi044.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-03T22:45:36.535 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:45:36.535 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-05-03T22:45:36.535 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-03T22:45:36.535 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-03T22:45:36.535 DEBUG:teuthology.orchestra.run.smithi044:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-03T22:45:36.536 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-05-03T22:45:36.640 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:45:36.666 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:36 smithi044 ceph-mon[28604]: pgmap v542: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:45:36.744 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:45:36.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:45:36.754 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-05-03T22:45:36.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:36 smithi060 ceph-mon[31721]: pgmap v542: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:45:36.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:36 smithi160 ceph-mon[32531]: pgmap v542: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:45:36.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:45:36.807 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list-id 2024-05-03T22:45:36.862 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:45:36.862 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-05-03T22:45:36.862 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T22:45:36.862 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-03T22:45:36.862 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-05-03T22:45:36.974 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:45:37.054 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:45:37.067 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-03T22:45:37.067 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:45:37.067 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-05-03T22:45:37.067 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-03T22:45:37.067 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-03T22:45:37.067 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-03T22:45:37.067 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-03T22:45:37.068 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-03T22:45:37.068 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-05-03T22:45:37.169 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:45:37.325 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:45:37.335 DEBUG:teuthology.orchestra.run.smithi044:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-03T22:45:37.335 DEBUG:teuthology.orchestra.run.smithi044:> set -e 2024-05-03T22:45:37.335 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set brx.0 up 2024-05-03T22:45:37.335 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link set dev brx.0 master ceph-brx 2024-05-03T22:45:37.335 DEBUG:teuthology.orchestra.run.smithi044:> ') 2024-05-03T22:45:37.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-03T22:45:37.508 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:37 smithi044 ceph-mon[28604]: pgmap v543: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:37.524 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:45:37.533 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-05-03T22:45:37.533 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-03T22:45:37.533 DEBUG:teuthology.orchestra.run.smithi044:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-03T22:45:37.579 INFO:teuthology.orchestra.run.smithi044.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-03T22:45:37.579 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-03T22:45:37.579 DEBUG:teuthology.orchestra.run.smithi044:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-03T22:45:37.666 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-05-03T22:45:37.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:37 smithi060 ceph-mon[31721]: pgmap v543: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:37.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:37 smithi160 ceph-mon[32531]: pgmap v543: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:37.786 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2024-05-03T22:45:37.837 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2024-05-03T22:45:37.837 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2024-05-03T22:45:37.837 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2024-05-03T22:45:37.838 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2024-05-03T22:45:37.838 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2024-05-03T22:45:37.838 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2024-05-03T22:45:37.838 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2024-05-03T22:45:37.838 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2024-05-03T22:45:37.838 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2024-05-03T22:45:37.838 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2024-05-03T22:45:37.838 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2024-05-03T22:45:37.838 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2024-05-03T22:45:37.838 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:45:37.838 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2024-05-03T22:45:37.838 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2024-05-03T22:45:37.838 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2024-05-03T22:45:37.839 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2024-05-03T22:45:37.839 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2024-05-03T22:45:37.839 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2024-05-03T22:45:37.839 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2024-05-03T22:45:37.839 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-03T22:45:37.839 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-03T22:45:37.839 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2024-05-03T22:45:37.839 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2024-05-03T22:45:37.839 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2024-05-03T22:45:37.839 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay 2024-05-03T22:45:37.839 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/0ea2a48e895445700f7c6d984c2a58ef4b24195cb5fb110ad65763e73cccfa8a/merged 2024-05-03T22:45:37.839 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/53330e09ce6a9454c5ed19cc9efe6665c8e7fef8a55876e8b5162e69f91bd934/merged 2024-05-03T22:45:37.839 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/0 2024-05-03T22:45:37.839 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:45:37.839 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/7174c4ec555050ccf6e3c43ec69c172e8bd96ad992ae43930c16c360cd478d99/merged 2024-05-03T22:45:37.840 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/05dc6aa61bcc7f06dbdb172a313c96a505fc8c85f32019792c932a72e1ffd829/merged 2024-05-03T22:45:37.840 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/255d587fca2dad33c52e23349192ee7a8f7e15e2580a44b4f7eb256b4f602e9c/merged 2024-05-03T22:45:37.840 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/fb1e24b165b5a1da4a958d4dfa8ae8d1d1c7b0df3cedb4d82909f142d5d840cc/merged 2024-05-03T22:45:37.840 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/c506b8d78ced46b166c1aad49d768cb18f6c9cca3bcb313364bebe4492093adb/merged 2024-05-03T22:45:37.840 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/d90015af22e21f2b49a08aa5a1ef53350d10a148dac17ccbc51d639e2a8157ee/merged 2024-05-03T22:45:37.840 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/493f4f9a51c8134b8576580f654d85963d8e6f3ce099468d5eb54a7f2cfeb795/merged 2024-05-03T22:45:37.840 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/ff4826b91a72da3ddde9eb0cdcd9d6066167f6c7e397354f8ab54d5675adeba8/merged 2024-05-03T22:45:37.840 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2024-05-03T22:45:37.840 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T22:45:37.840 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T22:45:37.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:45:37.841 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-05-03T22:45:37.885 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-03T22:45:37.885 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/850d9ff0-3c42-45c1-bfc3-bba2f51bc245 --client_fs=cephfs) 2024-05-03T22:45:37.933 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-05-03T22:45:38.007 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2024-05-03T22:45:38.049 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2024-05-03T22:45:38.050 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2024-05-03T22:45:38.050 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2024-05-03T22:45:38.050 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2024-05-03T22:45:38.050 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2024-05-03T22:45:38.050 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2024-05-03T22:45:38.050 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2024-05-03T22:45:38.050 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2024-05-03T22:45:38.050 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2024-05-03T22:45:38.050 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2024-05-03T22:45:38.050 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2024-05-03T22:45:38.050 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2024-05-03T22:45:38.051 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:45:38.051 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2024-05-03T22:45:38.051 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2024-05-03T22:45:38.051 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2024-05-03T22:45:38.051 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2024-05-03T22:45:38.051 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2024-05-03T22:45:38.051 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2024-05-03T22:45:38.051 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2024-05-03T22:45:38.051 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-03T22:45:38.051 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-03T22:45:38.051 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2024-05-03T22:45:38.051 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2024-05-03T22:45:38.051 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2024-05-03T22:45:38.052 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay 2024-05-03T22:45:38.052 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/0ea2a48e895445700f7c6d984c2a58ef4b24195cb5fb110ad65763e73cccfa8a/merged 2024-05-03T22:45:38.052 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/53330e09ce6a9454c5ed19cc9efe6665c8e7fef8a55876e8b5162e69f91bd934/merged 2024-05-03T22:45:38.052 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/0 2024-05-03T22:45:38.052 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:45:38.052 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/7174c4ec555050ccf6e3c43ec69c172e8bd96ad992ae43930c16c360cd478d99/merged 2024-05-03T22:45:38.052 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/05dc6aa61bcc7f06dbdb172a313c96a505fc8c85f32019792c932a72e1ffd829/merged 2024-05-03T22:45:38.052 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/255d587fca2dad33c52e23349192ee7a8f7e15e2580a44b4f7eb256b4f602e9c/merged 2024-05-03T22:45:38.052 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/fb1e24b165b5a1da4a958d4dfa8ae8d1d1c7b0df3cedb4d82909f142d5d840cc/merged 2024-05-03T22:45:38.052 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/c506b8d78ced46b166c1aad49d768cb18f6c9cca3bcb313364bebe4492093adb/merged 2024-05-03T22:45:38.052 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/d90015af22e21f2b49a08aa5a1ef53350d10a148dac17ccbc51d639e2a8157ee/merged 2024-05-03T22:45:38.052 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/493f4f9a51c8134b8576580f654d85963d8e6f3ce099468d5eb54a7f2cfeb795/merged 2024-05-03T22:45:38.052 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/ff4826b91a72da3ddde9eb0cdcd9d6066167f6c7e397354f8ab54d5675adeba8/merged 2024-05-03T22:45:38.053 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2024-05-03T22:45:38.053 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T22:45:38.053 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T22:45:38.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:45:38.054 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-05-03T22:45:38.111 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:2024-05-03T22:45:38.110+0000 7f547c6ec480 -1 init, newargv = 0x563655c35680 newargc=15 2024-05-03T22:45:38.112 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[89181]: starting ceph client 2024-05-03T22:45:38.171 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[89181]: starting fuse 2024-05-03T22:45:39.238 DEBUG:teuthology.orchestra.run.smithi044:> sudo modprobe fuse 2024-05-03T22:45:39.340 DEBUG:teuthology.orchestra.run.smithi044:> cat /proc/self/mounts | awk '{print $2}' 2024-05-03T22:45:39.401 INFO:teuthology.orchestra.run.smithi044.stdout:/proc 2024-05-03T22:45:39.401 INFO:teuthology.orchestra.run.smithi044.stdout:/sys 2024-05-03T22:45:39.401 INFO:teuthology.orchestra.run.smithi044.stdout:/dev 2024-05-03T22:45:39.401 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/security 2024-05-03T22:45:39.401 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/shm 2024-05-03T22:45:39.401 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/pts 2024-05-03T22:45:39.402 INFO:teuthology.orchestra.run.smithi044.stdout:/run 2024-05-03T22:45:39.402 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/cgroup 2024-05-03T22:45:39.402 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/pstore 2024-05-03T22:45:39.402 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/bpf 2024-05-03T22:45:39.402 INFO:teuthology.orchestra.run.smithi044.stdout:/ 2024-05-03T22:45:39.402 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/selinux 2024-05-03T22:45:39.402 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:45:39.402 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/mqueue 2024-05-03T22:45:39.402 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/debug 2024-05-03T22:45:39.402 INFO:teuthology.orchestra.run.smithi044.stdout:/dev/hugepages 2024-05-03T22:45:39.402 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/tracing 2024-05-03T22:45:39.403 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/fs/fuse/connections 2024-05-03T22:45:39.403 INFO:teuthology.orchestra.run.smithi044.stdout:/sys/kernel/config 2024-05-03T22:45:39.403 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-sysctl.service 2024-05-03T22:45:39.403 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-03T22:45:39.403 INFO:teuthology.orchestra.run.smithi044.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-03T22:45:39.403 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/nfs/rpc_pipefs 2024-05-03T22:45:39.403 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/1000 2024-05-03T22:45:39.403 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/ceph 2024-05-03T22:45:39.403 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay 2024-05-03T22:45:39.404 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/0ea2a48e895445700f7c6d984c2a58ef4b24195cb5fb110ad65763e73cccfa8a/merged 2024-05-03T22:45:39.404 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/53330e09ce6a9454c5ed19cc9efe6665c8e7fef8a55876e8b5162e69f91bd934/merged 2024-05-03T22:45:39.404 INFO:teuthology.orchestra.run.smithi044.stdout:/run/user/0 2024-05-03T22:45:39.404 INFO:teuthology.orchestra.run.smithi044.stdout:/proc/sys/fs/binfmt_misc 2024-05-03T22:45:39.404 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/7174c4ec555050ccf6e3c43ec69c172e8bd96ad992ae43930c16c360cd478d99/merged 2024-05-03T22:45:39.404 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/05dc6aa61bcc7f06dbdb172a313c96a505fc8c85f32019792c932a72e1ffd829/merged 2024-05-03T22:45:39.404 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/255d587fca2dad33c52e23349192ee7a8f7e15e2580a44b4f7eb256b4f602e9c/merged 2024-05-03T22:45:39.404 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/fb1e24b165b5a1da4a958d4dfa8ae8d1d1c7b0df3cedb4d82909f142d5d840cc/merged 2024-05-03T22:45:39.404 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/c506b8d78ced46b166c1aad49d768cb18f6c9cca3bcb313364bebe4492093adb/merged 2024-05-03T22:45:39.404 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/d90015af22e21f2b49a08aa5a1ef53350d10a148dac17ccbc51d639e2a8157ee/merged 2024-05-03T22:45:39.404 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/493f4f9a51c8134b8576580f654d85963d8e6f3ce099468d5eb54a7f2cfeb795/merged 2024-05-03T22:45:39.405 INFO:teuthology.orchestra.run.smithi044.stdout:/var/lib/containers/storage/overlay/ff4826b91a72da3ddde9eb0cdcd9d6066167f6c7e397354f8ab54d5675adeba8/merged 2024-05-03T22:45:39.405 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns 2024-05-03T22:45:39.405 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T22:45:39.405 INFO:teuthology.orchestra.run.smithi044.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T22:45:39.405 INFO:teuthology.orchestra.run.smithi044.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-03T22:45:39.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:45:39.406 DEBUG:teuthology.orchestra.run.smithi044:> ls /sys/fs/fuse/connections 2024-05-03T22:45:39.457 INFO:teuthology.orchestra.run.smithi044.stdout:114 2024-05-03T22:45:39.457 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [114] 2024-05-03T22:45:39.457 DEBUG:teuthology.orchestra.run.smithi044:> sudo stdin-killer -- python3 -c ' 2024-05-03T22:45:39.457 DEBUG:teuthology.orchestra.run.smithi044:> import glob 2024-05-03T22:45:39.457 DEBUG:teuthology.orchestra.run.smithi044:> import re 2024-05-03T22:45:39.457 DEBUG:teuthology.orchestra.run.smithi044:> import os 2024-05-03T22:45:39.457 DEBUG:teuthology.orchestra.run.smithi044:> import subprocess 2024-05-03T22:45:39.457 DEBUG:teuthology.orchestra.run.smithi044:> 2024-05-03T22:45:39.458 DEBUG:teuthology.orchestra.run.smithi044:> def _find_admin_socket(client_name): 2024-05-03T22:45:39.458 DEBUG:teuthology.orchestra.run.smithi044:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-03T22:45:39.458 DEBUG:teuthology.orchestra.run.smithi044:> files = glob.glob(asok_path) 2024-05-03T22:45:39.458 DEBUG:teuthology.orchestra.run.smithi044:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-03T22:45:39.458 DEBUG:teuthology.orchestra.run.smithi044:> 2024-05-03T22:45:39.458 DEBUG:teuthology.orchestra.run.smithi044:> # Given a non-glob path, it better be there 2024-05-03T22:45:39.458 DEBUG:teuthology.orchestra.run.smithi044:> if "*" not in asok_path: 2024-05-03T22:45:39.458 DEBUG:teuthology.orchestra.run.smithi044:> assert(len(files) == 1) 2024-05-03T22:45:39.458 DEBUG:teuthology.orchestra.run.smithi044:> return files[0] 2024-05-03T22:45:39.458 DEBUG:teuthology.orchestra.run.smithi044:> 2024-05-03T22:45:39.458 DEBUG:teuthology.orchestra.run.smithi044:> for f in files: 2024-05-03T22:45:39.458 DEBUG:teuthology.orchestra.run.smithi044:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-03T22:45:39.458 DEBUG:teuthology.orchestra.run.smithi044:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-03T22:45:39.458 DEBUG:teuthology.orchestra.run.smithi044:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-03T22:45:39.459 DEBUG:teuthology.orchestra.run.smithi044:> contents = proc_f.read() 2024-05-03T22:45:39.459 DEBUG:teuthology.orchestra.run.smithi044:> if mountpoint in contents: 2024-05-03T22:45:39.459 DEBUG:teuthology.orchestra.run.smithi044:> return f 2024-05-03T22:45:39.459 DEBUG:teuthology.orchestra.run.smithi044:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-03T22:45:39.459 DEBUG:teuthology.orchestra.run.smithi044:> 2024-05-03T22:45:39.459 DEBUG:teuthology.orchestra.run.smithi044:> print(_find_admin_socket("client.0")) 2024-05-03T22:45:39.459 DEBUG:teuthology.orchestra.run.smithi044:> ' 2024-05-03T22:45:39.627 INFO:teuthology.orchestra.run.smithi044.stdout:/var/run/ceph/ceph-client.0.89181.asok 2024-05-03T22:45:39.631 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-03T22:45:39.645 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.89181.asok 2024-05-03T22:45:39.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:45:39.645 DEBUG:teuthology.orchestra.run.smithi044:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.89181.asok status 2024-05-03T22:45:39.890 INFO:teuthology.orchestra.run.smithi044.stdout:{ 2024-05-03T22:45:39.890 INFO:teuthology.orchestra.run.smithi044.stdout: "metadata": { 2024-05-03T22:45:39.890 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_sha1": "9a047fe7599a549042d06a3fb5b6813a203eabea", 2024-05-03T22:45:39.890 INFO:teuthology.orchestra.run.smithi044.stdout: "ceph_version": "ceph version 19.0.0-3450-g9a047fe7 (9a047fe7599a549042d06a3fb5b6813a203eabea) squid (dev)", 2024-05-03T22:45:39.890 INFO:teuthology.orchestra.run.smithi044.stdout: "entity_id": "0", 2024-05-03T22:45:39.890 INFO:teuthology.orchestra.run.smithi044.stdout: "hostname": "smithi044", 2024-05-03T22:45:39.890 INFO:teuthology.orchestra.run.smithi044.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-03T22:45:39.890 INFO:teuthology.orchestra.run.smithi044.stdout: "pid": "89181", 2024-05-03T22:45:39.890 INFO:teuthology.orchestra.run.smithi044.stdout: "root": "/volumes/qa/sv_0/850d9ff0-3c42-45c1-bfc3-bba2f51bc245" 2024-05-03T22:45:39.891 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-03T22:45:39.891 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_count": 0, 2024-05-03T22:45:39.891 INFO:teuthology.orchestra.run.smithi044.stdout: "dentry_pinned_count": 0, 2024-05-03T22:45:39.891 INFO:teuthology.orchestra.run.smithi044.stdout: "id": 15303, 2024-05-03T22:45:39.891 INFO:teuthology.orchestra.run.smithi044.stdout: "inst": { 2024-05-03T22:45:39.891 INFO:teuthology.orchestra.run.smithi044.stdout: "name": { 2024-05-03T22:45:39.891 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "client", 2024-05-03T22:45:39.891 INFO:teuthology.orchestra.run.smithi044.stdout: "num": 15303 2024-05-03T22:45:39.891 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-03T22:45:39.891 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-05-03T22:45:39.891 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-05-03T22:45:39.891 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-05-03T22:45:39.891 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2661038315 2024-05-03T22:45:39.891 INFO:teuthology.orchestra.run.smithi044.stdout: } 2024-05-03T22:45:39.891 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-03T22:45:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": { 2024-05-03T22:45:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "v1", 2024-05-03T22:45:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: "addr": "192.168.0.1:0", 2024-05-03T22:45:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: "nonce": 2661038315 2024-05-03T22:45:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: }, 2024-05-03T22:45:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: "inst_str": "client.15303 192.168.0.1:0/2661038315", 2024-05-03T22:45:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: "addr_str": "192.168.0.1:0/2661038315", 2024-05-03T22:45:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: "inode_count": 5, 2024-05-03T22:45:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: "mds_epoch": 30, 2024-05-03T22:45:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch": 89, 2024-05-03T22:45:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: "osd_epoch_barrier": 0, 2024-05-03T22:45:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: "blocklisted": false, 2024-05-03T22:45:39.892 INFO:teuthology.orchestra.run.smithi044.stdout: "fs_name": "cephfs" 2024-05-03T22:45:39.892 INFO:teuthology.orchestra.run.smithi044.stdout:} 2024-05-03T22:45:39.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:45:39.906 DEBUG:teuthology.orchestra.run.smithi044:> stat --file-system '--printf=%T 2024-05-03T22:45:39.906 DEBUG:teuthology.orchestra.run.smithi044:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-03T22:45:39.962 INFO:teuthology.orchestra.run.smithi044.stdout:fuseblk 2024-05-03T22:45:39.962 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-03T22:45:39.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T22:45:39.963 DEBUG:teuthology.orchestra.run.smithi044:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-03T22:45:40.059 INFO:teuthology.run_tasks:Running task exec... 2024-05-03T22:45:40.071 INFO:teuthology.task.exec:Executing custom commands... 2024-05-03T22:45:40.071 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi044.front.sepia.ceph.com 2024-05-03T22:45:40.071 DEBUG:teuthology.orchestra.run.smithi044:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-05-03T22:45:40.285 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.283+0000 7f548e200640 1 -- 172.21.15.44:0/3089588307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5488109fb0 msgr2=0x7f548810a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:40.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.283+0000 7f548e200640 1 --2- 172.21.15.44:0/3089588307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5488109fb0 0x7f548810a430 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5474009900 tx=0x7f547402a410 comp rx=0 tx=0).stop 2024-05-03T22:45:40.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.283+0000 7f548e200640 1 -- 172.21.15.44:0/3089588307 shutdown_connections 2024-05-03T22:45:40.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.283+0000 7f548e200640 1 --2- 172.21.15.44:0/3089588307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f548810a970 0x7f5488111290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:40.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.283+0000 7f548e200640 1 --2- 172.21.15.44:0/3089588307 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5488109fb0 0x7f548810a430 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:40.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.283+0000 7f548e200640 1 --2- 172.21.15.44:0/3089588307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5488108e60 0x7f5488109280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:40.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.284+0000 7f548e200640 1 -- 172.21.15.44:0/3089588307 >> 172.21.15.44:0/3089588307 conn(0x7f5488077e40 msgr2=0x7f548807a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:40.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.284+0000 7f548e200640 1 -- 172.21.15.44:0/3089588307 shutdown_connections 2024-05-03T22:45:40.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.284+0000 7f548e200640 1 -- 172.21.15.44:0/3089588307 wait complete. 2024-05-03T22:45:40.286 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.285+0000 7f548e200640 1 Processor -- start 2024-05-03T22:45:40.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.285+0000 7f548e200640 1 -- start start 2024-05-03T22:45:40.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.285+0000 7f548e200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5488108e60 0x7f548819f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:40.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.285+0000 7f548e200640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5488109fb0 0x7f548819f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:40.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.285+0000 7f548e200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f548810a970 0x7f54881a6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:40.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.285+0000 7f548e200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f5488114b40 con 0x7f5488108e60 2024-05-03T22:45:40.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.285+0000 7f548e200640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f54881149c0 con 0x7f5488109fb0 2024-05-03T22:45:40.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.285+0000 7f548e200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5488114cc0 con 0x7f548810a970 2024-05-03T22:45:40.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.285+0000 7f548ce00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5488108e60 0x7f548819f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:40.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.285+0000 7f548ce00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5488108e60 0x7f548819f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60134/0 (socket says 172.21.15.44:60134) 2024-05-03T22:45:40.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.285+0000 7f548ce00640 1 -- 172.21.15.44:0/3494192763 learned_addr learned my addr 172.21.15.44:0/3494192763 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:40.289 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.286+0000 7f548d800640 1 --2- 172.21.15.44:0/3494192763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f548810a970 0x7f54881a6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:40.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.286+0000 7f5487e00640 1 --2- 172.21.15.44:0/3494192763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5488109fb0 0x7f548819f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:40.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.286+0000 7f548ce00640 1 -- 172.21.15.44:0/3494192763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f548810a970 msgr2=0x7f54881a6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:40.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.286+0000 7f548ce00640 1 --2- 172.21.15.44:0/3494192763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f548810a970 0x7f54881a6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:40.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.286+0000 7f548ce00640 1 -- 172.21.15.44:0/3494192763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5488109fb0 msgr2=0x7f548819f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:40.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.286+0000 7f548ce00640 1 --2- 172.21.15.44:0/3494192763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5488109fb0 0x7f548819f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:40.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.286+0000 7f548ce00640 1 -- 172.21.15.44:0/3494192763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54881a6da0 con 0x7f5488108e60 2024-05-03T22:45:40.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.286+0000 7f548d800640 1 --2- 172.21.15.44:0/3494192763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f548810a970 0x7f54881a6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T22:45:40.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.286+0000 7f548ce00640 1 --2- 172.21.15.44:0/3494192763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5488108e60 0x7f548819f180 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f547800ea80 tx=0x7f547800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:40.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.286+0000 7f5485600640 1 -- 172.21.15.44:0/3494192763 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547800ce40 con 0x7f5488108e60 2024-05-03T22:45:40.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.286+0000 7f5485600640 1 -- 172.21.15.44:0/3494192763 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f5478005020 con 0x7f5488108e60 2024-05-03T22:45:40.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.286+0000 7f548e200640 1 -- 172.21.15.44:0/3494192763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54881a7090 con 0x7f5488108e60 2024-05-03T22:45:40.290 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.286+0000 7f5485600640 1 -- 172.21.15.44:0/3494192763 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5478011760 con 0x7f5488108e60 2024-05-03T22:45:40.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.287+0000 7f548e200640 1 -- 172.21.15.44:0/3494192763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54881a7560 con 0x7f5488108e60 2024-05-03T22:45:40.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.288+0000 7f548e200640 1 -- 172.21.15.44:0/3494192763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5488110170 con 0x7f5488108e60 2024-05-03T22:45:40.291 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.290+0000 7f5485600640 1 -- 172.21.15.44:0/3494192763 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f54780051d0 con 0x7f5488108e60 2024-05-03T22:45:40.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.292+0000 7f5485600640 1 --2- 172.21.15.44:0/3494192763 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f546c0b2870 0x7f546c0b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:40.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.292+0000 7f5485600640 1 -- 172.21.15.44:0/3494192763 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f54780e2f60 con 0x7f5488108e60 2024-05-03T22:45:40.293 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.292+0000 7f5487e00640 1 --2- 172.21.15.44:0/3494192763 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f546c0b2870 0x7f546c0b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:40.295 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.293+0000 7f5487e00640 1 --2- 172.21.15.44:0/3494192763 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f546c0b2870 0x7f546c0b4d30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5474006010 tx=0x7f5474031510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:40.296 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.295+0000 7f5485600640 1 -- 172.21.15.44:0/3494192763 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f5478016030 con 0x7f5488108e60 2024-05-03T22:45:40.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:40 smithi044 ceph-mon[28604]: pgmap v544: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-03T22:45:40.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:40 smithi060 ceph-mon[31721]: pgmap v544: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-03T22:45:40.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:40 smithi160 ceph-mon[32531]: pgmap v544: 129 pgs: 129 active+clean; 643 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-03T22:45:40.553 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:40.552+0000 7f548e200640 1 -- 172.21.15.44:0/3494192763 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f548802db50 con 0x7f5488108e60 2024-05-03T22:45:41.195 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.193+0000 7f5485600640 1 -- 172.21.15.44:0/3494192763 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v31) ==== 118+0+0 (secure 0 0 0) 0x7f54780aa6b0 con 0x7f5488108e60 2024-05-03T22:45:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.199+0000 7f548e200640 1 -- 172.21.15.44:0/3494192763 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f546c0b2870 msgr2=0x7f546c0b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.199+0000 7f548e200640 1 --2- 172.21.15.44:0/3494192763 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f546c0b2870 0x7f546c0b4d30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5474006010 tx=0x7f5474031510 comp rx=0 tx=0).stop 2024-05-03T22:45:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.199+0000 7f548e200640 1 -- 172.21.15.44:0/3494192763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5488108e60 msgr2=0x7f548819f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.199+0000 7f548e200640 1 --2- 172.21.15.44:0/3494192763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5488108e60 0x7f548819f180 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f547800ea80 tx=0x7f547800ef40 comp rx=0 tx=0).stop 2024-05-03T22:45:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.199+0000 7f548e200640 1 -- 172.21.15.44:0/3494192763 shutdown_connections 2024-05-03T22:45:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.199+0000 7f548e200640 1 --2- 172.21.15.44:0/3494192763 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f546c0b2870 0x7f546c0b4d30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.199+0000 7f548e200640 1 --2- 172.21.15.44:0/3494192763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f548810a970 0x7f54881a6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.199+0000 7f548e200640 1 --2- 172.21.15.44:0/3494192763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5488109fb0 0x7f548819f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.199+0000 7f548e200640 1 --2- 172.21.15.44:0/3494192763 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f5488108e60 0x7f548819f180 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:41.201 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.199+0000 7f548e200640 1 -- 172.21.15.44:0/3494192763 >> 172.21.15.44:0/3494192763 conn(0x7f5488077e40 msgr2=0x7f548810d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:41.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.200+0000 7f548e200640 1 -- 172.21.15.44:0/3494192763 shutdown_connections 2024-05-03T22:45:41.202 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.200+0000 7f548e200640 1 -- 172.21.15.44:0/3494192763 wait complete. 2024-05-03T22:45:41.223 DEBUG:teuthology.orchestra.run.smithi044:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-05-03T22:45:41.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.431+0000 7fc467200640 1 -- 172.21.15.44:0/368720860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc468108e60 msgr2=0x7fc468109280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:41.432 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.431+0000 7fc467200640 1 --2- 172.21.15.44:0/368720860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc468108e60 0x7fc468109280 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc458009900 tx=0x7fc45802a3f0 comp rx=0 tx=0).stop 2024-05-03T22:45:41.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.431+0000 7fc467200640 1 -- 172.21.15.44:0/368720860 shutdown_connections 2024-05-03T22:45:41.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.431+0000 7fc467200640 1 --2- 172.21.15.44:0/368720860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc46810a970 0x7fc468111290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:41.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.431+0000 7fc467200640 1 --2- 172.21.15.44:0/368720860 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc468109fb0 0x7fc46810a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:41.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.431+0000 7fc467200640 1 --2- 172.21.15.44:0/368720860 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc468108e60 0x7fc468109280 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:41.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.431+0000 7fc467200640 1 -- 172.21.15.44:0/368720860 >> 172.21.15.44:0/368720860 conn(0x7fc468077e40 msgr2=0x7fc46807a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T22:45:41.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.431+0000 7fc467200640 1 -- 172.21.15.44:0/368720860 shutdown_connections 2024-05-03T22:45:41.433 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.431+0000 7fc467200640 1 -- 172.21.15.44:0/368720860 wait complete. 2024-05-03T22:45:41.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.432+0000 7fc467200640 1 Processor -- start 2024-05-03T22:45:41.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.432+0000 7fc467200640 1 -- start start 2024-05-03T22:45:41.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.432+0000 7fc467200640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc468108e60 0x7fc46819f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:41.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.432+0000 7fc467200640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc468109fb0 0x7fc46819f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:41.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.432+0000 7fc467200640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc46810a970 0x7fc4681a6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:41.434 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.432+0000 7fc467200640 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc468114ad0 con 0x7fc468108e60 2024-05-03T22:45:41.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.432+0000 7fc467200640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc468114950 con 0x7fc46810a970 2024-05-03T22:45:41.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.432+0000 7fc467200640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc468114c50 con 0x7fc468109fb0 2024-05-03T22:45:41.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.433+0000 7fc465e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc468108e60 0x7fc46819f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:41.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.433+0000 7fc465e00640 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc468108e60 0x7fc46819f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:60148/0 (socket says 172.21.15.44:60148) 2024-05-03T22:45:41.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.433+0000 7fc465e00640 1 -- 172.21.15.44:0/3783513548 learned_addr learned my addr 172.21.15.44:0/3783513548 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T22:45:41.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.433+0000 7fc466800640 1 --2- 172.21.15.44:0/3783513548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc46810a970 0x7fc4681a6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:41.435 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.433+0000 7fc45d400640 1 --2- 172.21.15.44:0/3783513548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc468109fb0 0x7fc46819f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:41.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.433+0000 7fc465e00640 1 -- 172.21.15.44:0/3783513548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc468109fb0 msgr2=0x7fc46819f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:41.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.433+0000 7fc465e00640 1 --2- 172.21.15.44:0/3783513548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc468109fb0 0x7fc46819f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:41.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.433+0000 7fc465e00640 1 -- 172.21.15.44:0/3783513548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc46810a970 msgr2=0x7fc4681a6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T22:45:41.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.433+0000 7fc465e00640 1 --2- 172.21.15.44:0/3783513548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc46810a970 0x7fc4681a6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T22:45:41.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.433+0000 7fc465e00640 1 -- 172.21.15.44:0/3783513548 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4681a6cd0 con 0x7fc468108e60 2024-05-03T22:45:41.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.434+0000 7fc465e00640 1 --2- 172.21.15.44:0/3783513548 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc468108e60 0x7fc46819f0b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc458031570 tx=0x7fc458004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:41.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.434+0000 7fc45f400640 1 -- 172.21.15.44:0/3783513548 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45803f030 con 0x7fc468108e60 2024-05-03T22:45:41.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.434+0000 7fc45f400640 1 -- 172.21.15.44:0/3783513548 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fc458003cd0 con 0x7fc468108e60 2024-05-03T22:45:41.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.434+0000 7fc45f400640 1 -- 172.21.15.44:0/3783513548 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc458035070 con 0x7fc468108e60 2024-05-03T22:45:41.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.434+0000 7fc467200640 1 -- 172.21.15.44:0/3783513548 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4681a6f60 con 0x7fc468108e60 2024-05-03T22:45:41.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.434+0000 7fc467200640 1 -- 172.21.15.44:0/3783513548 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4681a7370 con 0x7fc468108e60 2024-05-03T22:45:41.437 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.436+0000 7fc467200640 1 -- 172.21.15.44:0/3783513548 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc468110170 con 0x7fc468108e60 2024-05-03T22:45:41.439 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.438+0000 7fc45f400640 1 -- 172.21.15.44:0/3783513548 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc458003800 con 0x7fc468108e60 2024-05-03T22:45:41.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.440+0000 7fc45f400640 1 --2- 172.21.15.44:0/3783513548 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc44c0b2870 0x7fc44c0b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T22:45:41.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.441+0000 7fc45f400640 1 -- 172.21.15.44:0/3783513548 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fc458103550 con 0x7fc468108e60 2024-05-03T22:45:41.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.441+0000 7fc45d400640 1 --2- 172.21.15.44:0/3783513548 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc44c0b2870 0x7fc44c0b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T22:45:41.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.442+0000 7fc45d400640 1 --2- 172.21.15.44:0/3783513548 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc44c0b2870 0x7fc44c0b4d30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc45000a300 tx=0x7fc45000a290 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T22:45:41.445 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.444+0000 7fc45f400640 1 -- 172.21.15.44:0/3783513548 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc458003af0 con 0x7fc468108e60 2024-05-03T22:45:41.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:41 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3494192763' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-03T22:45:41.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:41 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3494192763' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-03T22:45:41.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:41 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3494192763' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-03T22:45:41.690 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:45:41.688+0000 7fc467200640 1 -- 172.21.15.44:0/3783513548 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7fc468062f50 con 0x7fc44c0b2870 2024-05-03T22:45:42.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:42 smithi044 ceph-mon[28604]: pgmap v545: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 852 B/s wr, 10 op/s 2024-05-03T22:45:42.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:42 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3494192763' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-03T22:45:42.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:42 smithi044 ceph-mon[28604]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T22:45:42.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:42 smithi060 ceph-mon[31721]: pgmap v545: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 852 B/s wr, 10 op/s 2024-05-03T22:45:42.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:42 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3494192763' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-03T22:45:42.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:42 smithi060 ceph-mon[31721]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T22:45:42.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:42 smithi160 ceph-mon[32531]: pgmap v545: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 852 B/s wr, 10 op/s 2024-05-03T22:45:42.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:42 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3494192763' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-03T22:45:42.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:42 smithi160 ceph-mon[32531]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-03T22:45:43.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:43 smithi044 ceph-mon[28604]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:45:43.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:43 smithi060 ceph-mon[31721]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:45:43.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:43 smithi160 ceph-mon[32531]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T22:45:44.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:44 smithi044 ceph-mon[28604]: pgmap v546: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-03T22:45:44.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:44 smithi060 ceph-mon[31721]: pgmap v546: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-03T22:45:44.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:44 smithi160 ceph-mon[32531]: pgmap v546: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-05-03T22:45:46.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:46 smithi044 ceph-mon[28604]: pgmap v547: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-05-03T22:45:46.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:46 smithi060 ceph-mon[31721]: pgmap v547: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-05-03T22:45:46.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:46 smithi160 ceph-mon[32531]: pgmap v547: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 13 op/s 2024-05-03T22:45:48.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:48 smithi044 ceph-mon[28604]: pgmap v548: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-05-03T22:45:48.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:48 smithi060 ceph-mon[31721]: pgmap v548: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-05-03T22:45:48.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:48 smithi160 ceph-mon[32531]: pgmap v548: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-05-03T22:45:50.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:50 smithi044 ceph-mon[28604]: pgmap v549: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-05-03T22:45:50.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:50 smithi060 ceph-mon[31721]: pgmap v549: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-05-03T22:45:50.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:50 smithi160 ceph-mon[32531]: pgmap v549: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-05-03T22:45:52.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:52 smithi044 ceph-mon[28604]: pgmap v550: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-03T22:45:52.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:52 smithi060 ceph-mon[31721]: pgmap v550: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-03T22:45:52.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:52 smithi160 ceph-mon[32531]: pgmap v550: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-03T22:45:54.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:54 smithi044 ceph-mon[28604]: pgmap v551: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-05-03T22:45:54.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:54 smithi060 ceph-mon[31721]: pgmap v551: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-05-03T22:45:54.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:54 smithi160 ceph-mon[32531]: pgmap v551: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-05-03T22:45:56.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:56 smithi160 ceph-mon[32531]: pgmap v552: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-03T22:45:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:56 smithi044 ceph-mon[28604]: pgmap v552: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-03T22:45:56.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:56 smithi060 ceph-mon[31721]: pgmap v552: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-03T22:45:58.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:45:58 smithi160 ceph-mon[32531]: pgmap v553: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:58.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:45:58 smithi044 ceph-mon[28604]: pgmap v553: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:45:58.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:45:58 smithi060 ceph-mon[31721]: pgmap v553: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:00.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:00 smithi044 ceph-mon[28604]: pgmap v554: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:46:00.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:00 smithi060 ceph-mon[31721]: pgmap v554: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:46:00.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:00 smithi160 ceph-mon[32531]: pgmap v554: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:46:02.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:02 smithi044 ceph-mon[28604]: pgmap v555: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:46:02.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:02 smithi060 ceph-mon[31721]: pgmap v555: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:46:02.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:02 smithi160 ceph-mon[32531]: pgmap v555: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:46:04.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:04 smithi044 ceph-mon[28604]: pgmap v556: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:04.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:04 smithi060 ceph-mon[31721]: pgmap v556: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:04.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:04 smithi160 ceph-mon[32531]: pgmap v556: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:06.555 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:06 smithi044 ceph-mon[28604]: pgmap v557: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:46:06.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:06 smithi060 ceph-mon[31721]: pgmap v557: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:46:06.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:06 smithi160 ceph-mon[32531]: pgmap v557: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:46:08.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:08 smithi044 ceph-mon[28604]: pgmap v558: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:08.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:08 smithi060 ceph-mon[31721]: pgmap v558: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:08.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:08 smithi160 ceph-mon[32531]: pgmap v558: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:10.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:10 smithi044 ceph-mon[28604]: pgmap v559: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:46:10.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:10 smithi060 ceph-mon[31721]: pgmap v559: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:46:10.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:10 smithi160 ceph-mon[32531]: pgmap v559: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:46:12.559 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:12 smithi060 ceph-mon[31721]: pgmap v560: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:46:12.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:12 smithi044 ceph-mon[28604]: pgmap v560: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:46:12.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:12 smithi160 ceph-mon[32531]: pgmap v560: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:46:14.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:14 smithi044 ceph-mon[28604]: pgmap v561: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:14.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:14 smithi060 ceph-mon[31721]: pgmap v561: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:14.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:14 smithi160 ceph-mon[32531]: pgmap v561: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:16.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:16 smithi044 ceph-mon[28604]: pgmap v562: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:46:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:16 smithi060 ceph-mon[31721]: pgmap v562: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:46:16.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:16 smithi160 ceph-mon[32531]: pgmap v562: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:46:18.686 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:18 smithi044 ceph-mon[28604]: pgmap v563: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:18.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:18 smithi060 ceph-mon[31721]: pgmap v563: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:18.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:18 smithi160 ceph-mon[32531]: pgmap v563: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:20.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:20 smithi044 ceph-mon[28604]: pgmap v564: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:46:20.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:20 smithi060 ceph-mon[31721]: pgmap v564: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:46:20.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:20 smithi160 ceph-mon[32531]: pgmap v564: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:46:22.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:22 smithi044 ceph-mon[28604]: pgmap v565: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:46:22.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:22 smithi060 ceph-mon[31721]: pgmap v565: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:46:22.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:22 smithi160 ceph-mon[32531]: pgmap v565: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:46:24.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:24 smithi044 ceph-mon[28604]: pgmap v566: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:24.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:24 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:46:24.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:24 smithi060 ceph-mon[31721]: pgmap v566: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:24 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:46:24.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:24 smithi160 ceph-mon[32531]: pgmap v566: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:24.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:24 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:46:26.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:26 smithi044 ceph-mon[28604]: pgmap v567: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:46:26.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:26 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:46:26.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:26 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:46:26.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:26 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:46:26.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:26 smithi060 ceph-mon[31721]: pgmap v567: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:46:26.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:26 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:46:26.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:26 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:46:26.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:26 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:46:26.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:26 smithi160 ceph-mon[32531]: pgmap v567: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:46:26.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:26 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:46:26.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:26 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:46:26.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:26 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:46:28.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:28 smithi044 ceph-mon[28604]: pgmap v568: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:28.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:28 smithi060 ceph-mon[31721]: pgmap v568: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:28.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:28 smithi160 ceph-mon[32531]: pgmap v568: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:30.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:30 smithi044 ceph-mon[28604]: pgmap v569: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:46:30.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:30 smithi060 ceph-mon[31721]: pgmap v569: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:46:30.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:30 smithi160 ceph-mon[32531]: pgmap v569: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:46:32.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:32 smithi044 ceph-mon[28604]: pgmap v570: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:46:32.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:32 smithi060 ceph-mon[31721]: pgmap v570: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:46:32.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:32 smithi160 ceph-mon[32531]: pgmap v570: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:46:34.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:34 smithi044 ceph-mon[28604]: pgmap v571: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:34.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:34 smithi060 ceph-mon[31721]: pgmap v571: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:34.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:34 smithi160 ceph-mon[32531]: pgmap v571: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:36.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:36 smithi044 ceph-mon[28604]: pgmap v572: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:46:36.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:36 smithi060 ceph-mon[31721]: pgmap v572: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:46:36.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:36 smithi160 ceph-mon[32531]: pgmap v572: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:46:38.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:38 smithi044 ceph-mon[28604]: pgmap v573: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:38.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:38 smithi060 ceph-mon[31721]: pgmap v573: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:38.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:38 smithi160 ceph-mon[32531]: pgmap v573: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:39.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:39 smithi044 ceph-mon[28604]: pgmap v574: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:46:39.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:39 smithi060 ceph-mon[31721]: pgmap v574: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:46:39.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:39 smithi160 ceph-mon[32531]: pgmap v574: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:46:42.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:42 smithi044 ceph-mon[28604]: pgmap v575: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:46:42.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:42 smithi060 ceph-mon[31721]: pgmap v575: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:46:42.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:42 smithi160 ceph-mon[32531]: pgmap v575: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:46:44.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:44 smithi044 ceph-mon[28604]: pgmap v576: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:44.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:44 smithi060 ceph-mon[31721]: pgmap v576: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:44.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:44 smithi160 ceph-mon[32531]: pgmap v576: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:46.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:46 smithi044 ceph-mon[28604]: pgmap v577: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:46:46.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:46 smithi060 ceph-mon[31721]: pgmap v577: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:46:46.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:46 smithi160 ceph-mon[32531]: pgmap v577: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:46:48.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:48 smithi044 ceph-mon[28604]: pgmap v578: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:48.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:48 smithi060 ceph-mon[31721]: pgmap v578: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:48.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:48 smithi160 ceph-mon[32531]: pgmap v578: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:50.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:50 smithi044 ceph-mon[28604]: pgmap v579: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:46:50.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:50 smithi060 ceph-mon[31721]: pgmap v579: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:46:50.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:50 smithi160 ceph-mon[32531]: pgmap v579: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:46:52.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:52 smithi044 ceph-mon[28604]: pgmap v580: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:46:52.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:52 smithi060 ceph-mon[31721]: pgmap v580: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:46:52.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:52 smithi160 ceph-mon[32531]: pgmap v580: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:46:54.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:54 smithi160 ceph-mon[32531]: pgmap v581: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:54.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:54 smithi044 ceph-mon[28604]: pgmap v581: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:54.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:54 smithi060 ceph-mon[31721]: pgmap v581: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:56.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:56 smithi160 ceph-mon[32531]: pgmap v582: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:46:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:56 smithi044 ceph-mon[28604]: pgmap v582: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:46:56.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:56 smithi060 ceph-mon[31721]: pgmap v582: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:46:58.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:46:58 smithi044 ceph-mon[28604]: pgmap v583: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:58.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:46:58 smithi060 ceph-mon[31721]: pgmap v583: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:46:58.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:46:58 smithi160 ceph-mon[32531]: pgmap v583: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:00.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:00 smithi044 ceph-mon[28604]: pgmap v584: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:47:00.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:00 smithi060 ceph-mon[31721]: pgmap v584: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:47:00.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:00 smithi160 ceph-mon[32531]: pgmap v584: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:47:02.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:02 smithi044 ceph-mon[28604]: pgmap v585: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:47:02.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:02 smithi060 ceph-mon[31721]: pgmap v585: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:47:02.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:02 smithi160 ceph-mon[32531]: pgmap v585: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:47:04.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:04 smithi044 ceph-mon[28604]: pgmap v586: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:04.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:04 smithi060 ceph-mon[31721]: pgmap v586: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:04.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:04 smithi160 ceph-mon[32531]: pgmap v586: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:06.555 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:06 smithi044 ceph-mon[28604]: pgmap v587: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:47:06.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:06 smithi060 ceph-mon[31721]: pgmap v587: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:47:06.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:06 smithi160 ceph-mon[32531]: pgmap v587: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:47:08.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:08 smithi044 ceph-mon[28604]: pgmap v588: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:08.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:08 smithi060 ceph-mon[31721]: pgmap v588: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:08.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:08 smithi160 ceph-mon[32531]: pgmap v588: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:10.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:10 smithi044 ceph-mon[28604]: pgmap v589: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:47:10.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:10 smithi060 ceph-mon[31721]: pgmap v589: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:47:10.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:10 smithi160 ceph-mon[32531]: pgmap v589: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:47:12.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:12 smithi044 ceph-mon[28604]: pgmap v590: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:47:12.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:12 smithi060 ceph-mon[31721]: pgmap v590: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:47:12.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:12 smithi160 ceph-mon[32531]: pgmap v590: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:47:14.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:14 smithi044 ceph-mon[28604]: pgmap v591: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:14.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:14 smithi060 ceph-mon[31721]: pgmap v591: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:14.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:14 smithi160 ceph-mon[32531]: pgmap v591: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:16.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:16 smithi044 ceph-mon[28604]: pgmap v592: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:47:16.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:16 smithi060 ceph-mon[31721]: pgmap v592: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:47:16.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:16 smithi160 ceph-mon[32531]: pgmap v592: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:47:18.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:18 smithi044 ceph-mon[28604]: pgmap v593: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:18.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:18 smithi060 ceph-mon[31721]: pgmap v593: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:18.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:18 smithi160 ceph-mon[32531]: pgmap v593: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:20.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:20 smithi044 ceph-mon[28604]: pgmap v594: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:47:20.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:20 smithi060 ceph-mon[31721]: pgmap v594: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:47:20.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:20 smithi160 ceph-mon[32531]: pgmap v594: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:47:22.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:22 smithi044 ceph-mon[28604]: pgmap v595: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:47:22.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:22 smithi060 ceph-mon[31721]: pgmap v595: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:47:22.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:22 smithi160 ceph-mon[32531]: pgmap v595: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:47:24.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:24 smithi044 ceph-mon[28604]: pgmap v596: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:47:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:24 smithi060 ceph-mon[31721]: pgmap v596: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:47:24.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:24 smithi160 ceph-mon[32531]: pgmap v596: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:47:26.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:26 smithi044 ceph-mon[28604]: pgmap v597: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:47:26.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:26 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:47:26.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:26 smithi060 ceph-mon[31721]: pgmap v597: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:47:26.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:26 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:47:26.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:26 smithi160 ceph-mon[32531]: pgmap v597: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:47:26.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:26 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:47:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:28 smithi044 ceph-mon[28604]: pgmap v598: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:47:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:28 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:47:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:28 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:47:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:28 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:47:28.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:28 smithi060 ceph-mon[31721]: pgmap v598: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:47:28.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:28 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:47:28.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:28 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:47:28.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:28 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:47:28.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:28 smithi160 ceph-mon[32531]: pgmap v598: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:47:28.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:28 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:47:28.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:28 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:47:28.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:28 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:47:30.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:30 smithi044 ceph-mon[28604]: pgmap v599: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:47:30.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:30 smithi060 ceph-mon[31721]: pgmap v599: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:47:30.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:30 smithi160 ceph-mon[32531]: pgmap v599: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:47:32.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:32 smithi044 ceph-mon[28604]: pgmap v600: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:47:32.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:32 smithi060 ceph-mon[31721]: pgmap v600: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:47:32.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:32 smithi160 ceph-mon[32531]: pgmap v600: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:47:34.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:34 smithi044 ceph-mon[28604]: pgmap v601: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:47:34.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:34 smithi060 ceph-mon[31721]: pgmap v601: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:47:34.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:34 smithi160 ceph-mon[32531]: pgmap v601: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:47:36.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:36 smithi044 ceph-mon[28604]: pgmap v602: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:47:36.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:36 smithi060 ceph-mon[31721]: pgmap v602: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:47:36.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:36 smithi160 ceph-mon[32531]: pgmap v602: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:47:38.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:38 smithi044 ceph-mon[28604]: pgmap v603: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:38.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:38 smithi060 ceph-mon[31721]: pgmap v603: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:38.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:38 smithi160 ceph-mon[32531]: pgmap v603: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:40.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:40 smithi044 ceph-mon[28604]: pgmap v604: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:47:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:40 smithi060 ceph-mon[31721]: pgmap v604: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:47:40.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:40 smithi160 ceph-mon[32531]: pgmap v604: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:47:41.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:41 smithi044 ceph-mon[28604]: pgmap v605: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:47:41.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:41 smithi060 ceph-mon[31721]: pgmap v605: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:47:41.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:41 smithi160 ceph-mon[32531]: pgmap v605: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:47:44.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:44 smithi044 ceph-mon[28604]: pgmap v606: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:44.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:44 smithi060 ceph-mon[31721]: pgmap v606: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:44.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:44 smithi160 ceph-mon[32531]: pgmap v606: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:46.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:46 smithi160 ceph-mon[32531]: pgmap v607: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:47:46.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:46 smithi044 ceph-mon[28604]: pgmap v607: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:47:46.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:46 smithi060 ceph-mon[31721]: pgmap v607: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:47:48.518 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:48 smithi160 ceph-mon[32531]: pgmap v608: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:48.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:48 smithi044 ceph-mon[28604]: pgmap v608: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:48 smithi060 ceph-mon[31721]: pgmap v608: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:50.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:50 smithi044 ceph-mon[28604]: pgmap v609: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:47:50.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:50 smithi060 ceph-mon[31721]: pgmap v609: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:47:50.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:50 smithi160 ceph-mon[32531]: pgmap v609: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:47:52.568 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:52 smithi160 ceph-mon[32531]: pgmap v610: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:47:52.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:52 smithi044 ceph-mon[28604]: pgmap v610: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:47:52.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:52 smithi060 ceph-mon[31721]: pgmap v610: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:47:54.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:54 smithi044 ceph-mon[28604]: pgmap v611: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:54.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:54 smithi060 ceph-mon[31721]: pgmap v611: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:54.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:54 smithi160 ceph-mon[32531]: pgmap v611: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:47:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:56 smithi044 ceph-mon[28604]: pgmap v612: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:47:56.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:56 smithi060 ceph-mon[31721]: pgmap v612: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:47:56.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:56 smithi160 ceph-mon[32531]: pgmap v612: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:47:58.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:47:58 smithi044 ceph-mon[28604]: pgmap v613: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:47:58.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:47:58 smithi060 ceph-mon[31721]: pgmap v613: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:47:58.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:47:58 smithi160 ceph-mon[32531]: pgmap v613: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:48:00.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:00 smithi044 ceph-mon[28604]: pgmap v614: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-03T22:48:00.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:00 smithi060 ceph-mon[31721]: pgmap v614: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-03T22:48:00.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:00 smithi160 ceph-mon[32531]: pgmap v614: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-03T22:48:02.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:02 smithi044 ceph-mon[28604]: pgmap v615: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-05-03T22:48:02.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:02 smithi060 ceph-mon[31721]: pgmap v615: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-05-03T22:48:02.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:02 smithi160 ceph-mon[32531]: pgmap v615: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-05-03T22:48:04.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:04 smithi044 ceph-mon[28604]: pgmap v616: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-05-03T22:48:04.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:04 smithi060 ceph-mon[31721]: pgmap v616: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-05-03T22:48:04.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:04 smithi160 ceph-mon[32531]: pgmap v616: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-05-03T22:48:06.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:06 smithi044 ceph-mon[28604]: pgmap v617: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-03T22:48:06.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:06 smithi060 ceph-mon[31721]: pgmap v617: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-03T22:48:06.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:06 smithi160 ceph-mon[32531]: pgmap v617: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-03T22:48:08.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:08 smithi044 ceph-mon[28604]: pgmap v618: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:48:08.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:08 smithi060 ceph-mon[31721]: pgmap v618: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:48:08.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:08 smithi160 ceph-mon[32531]: pgmap v618: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:48:10.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:10 smithi044 ceph-mon[28604]: pgmap v619: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:48:10.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:10 smithi060 ceph-mon[31721]: pgmap v619: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:48:10.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:10 smithi160 ceph-mon[32531]: pgmap v619: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:48:12.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:12 smithi044 ceph-mon[28604]: pgmap v620: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:48:12.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:12 smithi060 ceph-mon[31721]: pgmap v620: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:48:12.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:12 smithi160 ceph-mon[32531]: pgmap v620: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:48:14.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:14 smithi044 ceph-mon[28604]: pgmap v621: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:14.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:14 smithi060 ceph-mon[31721]: pgmap v621: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:14.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:14 smithi160 ceph-mon[32531]: pgmap v621: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:16.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:16 smithi044 ceph-mon[28604]: pgmap v622: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:48:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:16 smithi060 ceph-mon[31721]: pgmap v622: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:48:16.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:16 smithi160 ceph-mon[32531]: pgmap v622: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:48:18.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:18 smithi044 ceph-mon[28604]: pgmap v623: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:18.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:18 smithi060 ceph-mon[31721]: pgmap v623: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:18.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:18 smithi160 ceph-mon[32531]: pgmap v623: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:20.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:20 smithi044 ceph-mon[28604]: pgmap v624: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:48:20.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:20 smithi060 ceph-mon[31721]: pgmap v624: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:48:20.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:20 smithi160 ceph-mon[32531]: pgmap v624: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:48:22.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:22 smithi044 ceph-mon[28604]: pgmap v625: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:48:22.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:22 smithi060 ceph-mon[31721]: pgmap v625: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:48:22.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:22 smithi160 ceph-mon[32531]: pgmap v625: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:48:24.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:24 smithi044 ceph-mon[28604]: pgmap v626: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:24 smithi060 ceph-mon[31721]: pgmap v626: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:24.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:24 smithi160 ceph-mon[32531]: pgmap v626: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:26.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:26 smithi044 ceph-mon[28604]: pgmap v627: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:48:26.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:26 smithi060 ceph-mon[31721]: pgmap v627: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:48:26.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:26 smithi160 ceph-mon[32531]: pgmap v627: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:48:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:28 smithi044 ceph-mon[28604]: pgmap v628: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:28 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:48:28.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:28 smithi060 ceph-mon[31721]: pgmap v628: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:28.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:28 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:48:28.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:28 smithi160 ceph-mon[32531]: pgmap v628: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:28.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:28 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:48:30.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:30 smithi044 ceph-mon[28604]: pgmap v629: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:48:30.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:48:30.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:48:30.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:48:30.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:30 smithi060 ceph-mon[31721]: pgmap v629: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:48:30.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:48:30.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:48:30.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:48:30.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:30 smithi160 ceph-mon[32531]: pgmap v629: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:48:30.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:48:30.767 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:48:30.767 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:48:30.767 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:48:31.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:31 smithi044 ceph-mon[28604]: Adjusting osd_memory_target on smithi044 to 177.5M 2024-05-03T22:48:31.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:31 smithi044 ceph-mon[28604]: Adjusting osd_memory_target on smithi060 to 177.5M 2024-05-03T22:48:31.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:31 smithi044 ceph-mon[28604]: Unable to set osd_memory_target on smithi044 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-05-03T22:48:31.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:31 smithi044 ceph-mon[28604]: Unable to set osd_memory_target on smithi060 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-05-03T22:48:31.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:31 smithi060 ceph-mon[31721]: Adjusting osd_memory_target on smithi044 to 177.5M 2024-05-03T22:48:31.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:31 smithi060 ceph-mon[31721]: Adjusting osd_memory_target on smithi060 to 177.5M 2024-05-03T22:48:31.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:31 smithi060 ceph-mon[31721]: Unable to set osd_memory_target on smithi044 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-05-03T22:48:31.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:31 smithi060 ceph-mon[31721]: Unable to set osd_memory_target on smithi060 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-05-03T22:48:31.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:31 smithi160 ceph-mon[32531]: Adjusting osd_memory_target on smithi044 to 177.5M 2024-05-03T22:48:31.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:31 smithi160 ceph-mon[32531]: Adjusting osd_memory_target on smithi060 to 177.5M 2024-05-03T22:48:31.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:31 smithi160 ceph-mon[32531]: Unable to set osd_memory_target on smithi044 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-05-03T22:48:31.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:31 smithi160 ceph-mon[32531]: Unable to set osd_memory_target on smithi060 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-05-03T22:48:32.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:32 smithi044 ceph-mon[28604]: pgmap v630: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:48:32.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:32 smithi060 ceph-mon[31721]: pgmap v630: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:48:32.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:32 smithi160 ceph-mon[32531]: pgmap v630: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:48:33.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:33 smithi044 ceph-mon[28604]: pgmap v631: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:33.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:33 smithi060 ceph-mon[31721]: pgmap v631: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:33.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:33 smithi160 ceph-mon[32531]: pgmap v631: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:36.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:36 smithi044 ceph-mon[28604]: pgmap v632: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:48:36.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:36 smithi060 ceph-mon[31721]: pgmap v632: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:48:36.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:36 smithi160 ceph-mon[32531]: pgmap v632: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:48:38.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:38 smithi044 ceph-mon[28604]: pgmap v633: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:38.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:38 smithi060 ceph-mon[31721]: pgmap v633: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:38.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:38 smithi160 ceph-mon[32531]: pgmap v633: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:40.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:40 smithi044 ceph-mon[28604]: pgmap v634: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:48:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:40 smithi060 ceph-mon[31721]: pgmap v634: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:48:40.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:40 smithi160 ceph-mon[32531]: pgmap v634: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:48:41.464 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:48:41.462+0000 7fc45e000640 1 -- 172.21.15.44:0/3783513548 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7fc4400034c0 con 0x7fc468108e60 2024-05-03T22:48:41.465 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:48:41.464+0000 7fc45f400640 1 -- 172.21.15.44:0/3783513548 <== mon.0 v2:172.21.15.44:3300/0 7 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7fc4400034c0 con 0x7fc468108e60 2024-05-03T22:48:42.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:42 smithi044 ceph-mon[28604]: pgmap v635: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:48:42.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:42 smithi060 ceph-mon[31721]: pgmap v635: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:48:42.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:42 smithi160 ceph-mon[32531]: pgmap v635: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:48:44.558 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:44 smithi060 ceph-mon[31721]: pgmap v636: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:44.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:44 smithi044 ceph-mon[28604]: pgmap v636: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:44.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:44 smithi160 ceph-mon[32531]: pgmap v636: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:46.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:46 smithi044 ceph-mon[28604]: pgmap v637: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:48:46.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:46 smithi060 ceph-mon[31721]: pgmap v637: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:48:46.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:46 smithi160 ceph-mon[32531]: pgmap v637: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:48:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:48 smithi044 ceph-mon[28604]: pgmap v638: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:48 smithi060 ceph-mon[31721]: pgmap v638: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:48 smithi160 ceph-mon[32531]: pgmap v638: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:50.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:50 smithi044 ceph-mon[28604]: pgmap v639: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:48:50.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:50 smithi060 ceph-mon[31721]: pgmap v639: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:48:50.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:50 smithi160 ceph-mon[32531]: pgmap v639: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:48:52.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:52 smithi044 ceph-mon[28604]: pgmap v640: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:48:52.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:52 smithi060 ceph-mon[31721]: pgmap v640: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:48:52.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:52 smithi160 ceph-mon[32531]: pgmap v640: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:48:54.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:54 smithi044 ceph-mon[28604]: pgmap v641: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:54.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:54 smithi060 ceph-mon[31721]: pgmap v641: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:54.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:54 smithi160 ceph-mon[32531]: pgmap v641: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:56.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:56 smithi044 ceph-mon[28604]: pgmap v642: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:48:56.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:56 smithi060 ceph-mon[31721]: pgmap v642: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:48:56.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:56 smithi160 ceph-mon[32531]: pgmap v642: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:48:58.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:48:58 smithi044 ceph-mon[28604]: pgmap v643: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:58.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:48:58 smithi060 ceph-mon[31721]: pgmap v643: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:48:58.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:48:58 smithi160 ceph-mon[32531]: pgmap v643: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:00.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:00 smithi044 ceph-mon[28604]: pgmap v644: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:49:00.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:00 smithi060 ceph-mon[31721]: pgmap v644: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:49:00.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:00 smithi160 ceph-mon[32531]: pgmap v644: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:49:02.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:02 smithi044 ceph-mon[28604]: pgmap v645: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:49:02.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:02 smithi060 ceph-mon[31721]: pgmap v645: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:49:02.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:02 smithi160 ceph-mon[32531]: pgmap v645: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:49:04.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:04 smithi044 ceph-mon[28604]: pgmap v646: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:04.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:04 smithi060 ceph-mon[31721]: pgmap v646: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:04.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:04 smithi160 ceph-mon[32531]: pgmap v646: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:06.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:06 smithi044 ceph-mon[28604]: pgmap v647: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:49:06.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:06 smithi060 ceph-mon[31721]: pgmap v647: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:49:06.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:06 smithi160 ceph-mon[32531]: pgmap v647: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:49:08.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:08 smithi044 ceph-mon[28604]: pgmap v648: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:08.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:08 smithi060 ceph-mon[31721]: pgmap v648: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:08.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:08 smithi160 ceph-mon[32531]: pgmap v648: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:10.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:10 smithi044 ceph-mon[28604]: pgmap v649: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:49:10.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:10 smithi060 ceph-mon[31721]: pgmap v649: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:49:10.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:10 smithi160 ceph-mon[32531]: pgmap v649: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:49:12.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:12 smithi044 ceph-mon[28604]: pgmap v650: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:49:12.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:12 smithi060 ceph-mon[31721]: pgmap v650: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:49:12.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:12 smithi160 ceph-mon[32531]: pgmap v650: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:49:14.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:14 smithi044 ceph-mon[28604]: pgmap v651: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:14.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:14 smithi060 ceph-mon[31721]: pgmap v651: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:14.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:14 smithi160 ceph-mon[32531]: pgmap v651: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:16.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:16 smithi044 ceph-mon[28604]: pgmap v652: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:49:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:16 smithi060 ceph-mon[31721]: pgmap v652: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:49:16.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:16 smithi160 ceph-mon[32531]: pgmap v652: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:49:18.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:18 smithi044 ceph-mon[28604]: pgmap v653: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:18.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:18 smithi060 ceph-mon[31721]: pgmap v653: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:18.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:18 smithi160 ceph-mon[32531]: pgmap v653: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:20.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:20 smithi044 ceph-mon[28604]: pgmap v654: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:49:20.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:20 smithi060 ceph-mon[31721]: pgmap v654: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:49:20.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:20 smithi160 ceph-mon[32531]: pgmap v654: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:49:22.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:22 smithi044 ceph-mon[28604]: pgmap v655: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:49:22.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:22 smithi060 ceph-mon[31721]: pgmap v655: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:49:22.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:22 smithi160 ceph-mon[32531]: pgmap v655: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:49:23.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:23 smithi044 ceph-mon[28604]: pgmap v656: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:23.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:23 smithi060 ceph-mon[31721]: pgmap v656: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:23.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:23 smithi160 ceph-mon[32531]: pgmap v656: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:26.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:26 smithi044 ceph-mon[28604]: pgmap v657: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:49:26.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:26 smithi060 ceph-mon[31721]: pgmap v657: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:49:26.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:26 smithi160 ceph-mon[32531]: pgmap v657: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:49:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:28 smithi044 ceph-mon[28604]: pgmap v658: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:28.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:28 smithi060 ceph-mon[31721]: pgmap v658: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:28.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:28 smithi160 ceph-mon[32531]: pgmap v658: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:30.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:30 smithi044 ceph-mon[28604]: pgmap v659: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:49:30.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:30 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:49:30.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:30 smithi060 ceph-mon[31721]: pgmap v659: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:49:30.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:30 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:49:30.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:30 smithi160 ceph-mon[32531]: pgmap v659: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:49:30.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:30 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:49:32.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:32 smithi044 ceph-mon[28604]: pgmap v660: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:49:32.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:32 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:49:32.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:32 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:49:32.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:32 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:49:32.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:32 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:49:32.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:32 smithi044 ceph-mon[28604]: Adjusting osd_memory_target on smithi160 to 176.4M 2024-05-03T22:49:32.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:32 smithi044 ceph-mon[28604]: Unable to set osd_memory_target on smithi160 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-03T22:49:32.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:32 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:49:32.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:32 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:49:32.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:32 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:49:32.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:32 smithi060 ceph-mon[31721]: pgmap v660: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:49:32.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:32 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:49:32.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:32 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:49:32.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:32 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:49:32.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:32 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:49:32.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:32 smithi060 ceph-mon[31721]: Adjusting osd_memory_target on smithi160 to 176.4M 2024-05-03T22:49:32.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:32 smithi060 ceph-mon[31721]: Unable to set osd_memory_target on smithi160 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-03T22:49:32.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:32 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:49:32.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:32 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:49:32.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:32 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:49:32.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:32 smithi160 ceph-mon[32531]: pgmap v660: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:49:32.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:32 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:49:32.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:32 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:49:32.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:32 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:49:32.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:32 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:49:32.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:32 smithi160 ceph-mon[32531]: Adjusting osd_memory_target on smithi160 to 176.4M 2024-05-03T22:49:32.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:32 smithi160 ceph-mon[32531]: Unable to set osd_memory_target on smithi160 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-03T22:49:32.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:32 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:49:32.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:32 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:49:32.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:32 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:49:34.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:34 smithi044 ceph-mon[28604]: pgmap v661: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:34.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:34 smithi060 ceph-mon[31721]: pgmap v661: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:34.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:34 smithi160 ceph-mon[32531]: pgmap v661: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:36.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:36 smithi044 ceph-mon[28604]: pgmap v662: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:49:36.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:36 smithi060 ceph-mon[31721]: pgmap v662: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:49:36.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:36 smithi160 ceph-mon[32531]: pgmap v662: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:49:38.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:38 smithi044 ceph-mon[28604]: pgmap v663: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:38.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:38 smithi060 ceph-mon[31721]: pgmap v663: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:38.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:38 smithi160 ceph-mon[32531]: pgmap v663: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:40.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:40 smithi044 ceph-mon[28604]: pgmap v664: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:49:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:40 smithi060 ceph-mon[31721]: pgmap v664: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:49:40.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:40 smithi160 ceph-mon[32531]: pgmap v664: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:49:42.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:42 smithi044 ceph-mon[28604]: pgmap v665: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:49:42.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:42 smithi060 ceph-mon[31721]: pgmap v665: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:49:42.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:42 smithi160 ceph-mon[32531]: pgmap v665: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:49:44.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:44 smithi044 ceph-mon[28604]: pgmap v666: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:44.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:44 smithi060 ceph-mon[31721]: pgmap v666: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:44.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:44 smithi160 ceph-mon[32531]: pgmap v666: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:46.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:46 smithi044 ceph-mon[28604]: pgmap v667: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:49:46.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:46 smithi060 ceph-mon[31721]: pgmap v667: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:49:46.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:46 smithi160 ceph-mon[32531]: pgmap v667: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:49:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:48 smithi044 ceph-mon[28604]: pgmap v668: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:48 smithi060 ceph-mon[31721]: pgmap v668: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:48 smithi160 ceph-mon[32531]: pgmap v668: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:50.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:50 smithi044 ceph-mon[28604]: pgmap v669: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:49:50.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:50 smithi060 ceph-mon[31721]: pgmap v669: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:49:50.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:50 smithi160 ceph-mon[32531]: pgmap v669: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:49:52.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:52 smithi044 ceph-mon[28604]: pgmap v670: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:52.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:52 smithi060 ceph-mon[31721]: pgmap v670: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:52.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:52 smithi160 ceph-mon[32531]: pgmap v670: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:54.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:54 smithi044 ceph-mon[28604]: pgmap v671: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:54.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:54 smithi060 ceph-mon[31721]: pgmap v671: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:54.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:54 smithi160 ceph-mon[32531]: pgmap v671: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:56.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:56 smithi044 ceph-mon[28604]: pgmap v672: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:49:56.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:56 smithi060 ceph-mon[31721]: pgmap v672: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:49:56.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:56 smithi160 ceph-mon[32531]: pgmap v672: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:49:58.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:49:58 smithi044 ceph-mon[28604]: pgmap v673: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:58.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:49:58 smithi060 ceph-mon[31721]: pgmap v673: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:49:58.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:49:58 smithi160 ceph-mon[32531]: pgmap v673: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:00.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:00 smithi044 ceph-mon[28604]: pgmap v674: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:50:00.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:00 smithi044 ceph-mon[28604]: overall HEALTH_OK 2024-05-03T22:50:00.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:00 smithi060 ceph-mon[31721]: pgmap v674: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:50:00.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:00 smithi060 ceph-mon[31721]: overall HEALTH_OK 2024-05-03T22:50:00.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:00 smithi160 ceph-mon[32531]: pgmap v674: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:50:00.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:00 smithi160 ceph-mon[32531]: overall HEALTH_OK 2024-05-03T22:50:02.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:02 smithi044 ceph-mon[28604]: pgmap v675: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:02.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:02 smithi060 ceph-mon[31721]: pgmap v675: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:02.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:02 smithi160 ceph-mon[32531]: pgmap v675: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:04.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:04 smithi044 ceph-mon[28604]: pgmap v676: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:50:04.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:04 smithi060 ceph-mon[31721]: pgmap v676: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:50:04.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:04 smithi160 ceph-mon[32531]: pgmap v676: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:50:06.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:06 smithi044 ceph-mon[28604]: pgmap v677: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:50:06.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:06 smithi060 ceph-mon[31721]: pgmap v677: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:50:06.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:06 smithi160 ceph-mon[32531]: pgmap v677: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:50:08.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:08 smithi044 ceph-mon[28604]: pgmap v678: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:08.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:08 smithi060 ceph-mon[31721]: pgmap v678: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:08.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:08 smithi160 ceph-mon[32531]: pgmap v678: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:09.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:09 smithi044 ceph-mon[28604]: pgmap v679: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:50:09.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:09 smithi060 ceph-mon[31721]: pgmap v679: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:50:09.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:09 smithi160 ceph-mon[32531]: pgmap v679: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:50:12.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:12 smithi044 ceph-mon[28604]: pgmap v680: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:50:12.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:12 smithi060 ceph-mon[31721]: pgmap v680: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:50:12.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:12 smithi160 ceph-mon[32531]: pgmap v680: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:50:14.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:14 smithi044 ceph-mon[28604]: pgmap v681: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-03T22:50:14.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:14 smithi060 ceph-mon[31721]: pgmap v681: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-03T22:50:14.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:14 smithi160 ceph-mon[32531]: pgmap v681: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-03T22:50:16.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:16 smithi044 ceph-mon[28604]: pgmap v682: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:50:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:16 smithi060 ceph-mon[31721]: pgmap v682: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:50:16.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:16 smithi160 ceph-mon[32531]: pgmap v682: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:50:18.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:18 smithi044 ceph-mon[28604]: pgmap v683: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:50:18.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:18 smithi060 ceph-mon[31721]: pgmap v683: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:50:18.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:18 smithi160 ceph-mon[32531]: pgmap v683: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:50:20.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:20 smithi044 ceph-mon[28604]: pgmap v684: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:50:20.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:20 smithi060 ceph-mon[31721]: pgmap v684: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:50:20.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:20 smithi160 ceph-mon[32531]: pgmap v684: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:50:22.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:22 smithi044 ceph-mon[28604]: pgmap v685: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:22.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:22 smithi060 ceph-mon[31721]: pgmap v685: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:22.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:22 smithi160 ceph-mon[32531]: pgmap v685: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:24.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:24 smithi044 ceph-mon[28604]: pgmap v686: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:50:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:24 smithi060 ceph-mon[31721]: pgmap v686: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:50:24.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:24 smithi160 ceph-mon[32531]: pgmap v686: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:50:26.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:26 smithi044 ceph-mon[28604]: pgmap v687: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:50:26.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:26 smithi060 ceph-mon[31721]: pgmap v687: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:50:26.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:26 smithi160 ceph-mon[32531]: pgmap v687: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:50:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:28 smithi044 ceph-mon[28604]: pgmap v688: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:28.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:28 smithi060 ceph-mon[31721]: pgmap v688: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:28.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:28 smithi160 ceph-mon[32531]: pgmap v688: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:30.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:30 smithi044 ceph-mon[28604]: pgmap v689: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:50:30.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:30 smithi060 ceph-mon[31721]: pgmap v689: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:50:30.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:30 smithi160 ceph-mon[32531]: pgmap v689: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:50:32.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:32 smithi044 ceph-mon[28604]: pgmap v690: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:32.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:32 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:50:32.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:32 smithi060 ceph-mon[31721]: pgmap v690: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:32.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:32 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:50:32.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:32 smithi160 ceph-mon[32531]: pgmap v690: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:32.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:32 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:50:34.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:33 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:50:34.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:33 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:50:34.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:33 smithi044 ceph-mon[28604]: pgmap v691: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:50:34.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:33 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:50:34.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:33 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:50:34.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:33 smithi060 ceph-mon[31721]: pgmap v691: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:50:34.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:33 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:50:34.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:33 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:50:34.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:33 smithi160 ceph-mon[32531]: pgmap v691: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:50:35.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:50:35.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:50:35.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:34 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:50:35.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:50:35.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:50:35.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:34 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:50:35.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:50:35.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:50:35.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:34 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:50:36.153 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:35 smithi044 ceph-mon[28604]: pgmap v692: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:50:36.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:35 smithi060 ceph-mon[31721]: pgmap v692: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:50:36.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:35 smithi160 ceph-mon[32531]: pgmap v692: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:50:38.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:38 smithi044 ceph-mon[28604]: pgmap v693: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:38.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:38 smithi060 ceph-mon[31721]: pgmap v693: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:38.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:38 smithi160 ceph-mon[32531]: pgmap v693: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:40.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:40 smithi044 ceph-mon[28604]: pgmap v694: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:50:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:40 smithi060 ceph-mon[31721]: pgmap v694: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:50:40.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:40 smithi160 ceph-mon[32531]: pgmap v694: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:50:42.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:42 smithi044 ceph-mon[28604]: pgmap v695: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:42.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:42 smithi060 ceph-mon[31721]: pgmap v695: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:42.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:42 smithi160 ceph-mon[32531]: pgmap v695: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:44.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:44 smithi044 ceph-mon[28604]: pgmap v696: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:50:44.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:44 smithi060 ceph-mon[31721]: pgmap v696: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:50:44.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:44 smithi160 ceph-mon[32531]: pgmap v696: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:50:46.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:46 smithi044 ceph-mon[28604]: pgmap v697: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:50:46.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:46 smithi060 ceph-mon[31721]: pgmap v697: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:50:46.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:46 smithi160 ceph-mon[32531]: pgmap v697: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:50:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:48 smithi044 ceph-mon[28604]: pgmap v698: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:48 smithi060 ceph-mon[31721]: pgmap v698: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:48 smithi160 ceph-mon[32531]: pgmap v698: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:50.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:50 smithi044 ceph-mon[28604]: pgmap v699: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:50:50.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:50 smithi060 ceph-mon[31721]: pgmap v699: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:50:50.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:50 smithi160 ceph-mon[32531]: pgmap v699: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:50:52.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:52 smithi044 ceph-mon[28604]: pgmap v700: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:52.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:52 smithi060 ceph-mon[31721]: pgmap v700: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:52.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:52 smithi160 ceph-mon[32531]: pgmap v700: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:54.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:54 smithi044 ceph-mon[28604]: pgmap v701: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:50:54.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:54 smithi060 ceph-mon[31721]: pgmap v701: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:50:54.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:54 smithi160 ceph-mon[32531]: pgmap v701: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:50:56.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:56 smithi044 ceph-mon[28604]: pgmap v702: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:50:56.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:56 smithi060 ceph-mon[31721]: pgmap v702: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:50:56.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:56 smithi160 ceph-mon[32531]: pgmap v702: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:50:58.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:50:58 smithi044 ceph-mon[28604]: pgmap v703: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:58.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:50:58 smithi060 ceph-mon[31721]: pgmap v703: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:50:58.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:50:58 smithi160 ceph-mon[32531]: pgmap v703: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:00.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:00 smithi044 ceph-mon[28604]: pgmap v704: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:51:00.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:00 smithi060 ceph-mon[31721]: pgmap v704: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:51:00.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:00 smithi160 ceph-mon[32531]: pgmap v704: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:51:02.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:02 smithi044 ceph-mon[28604]: pgmap v705: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:02.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:02 smithi060 ceph-mon[31721]: pgmap v705: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:02.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:02 smithi160 ceph-mon[32531]: pgmap v705: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:04.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:04 smithi044 ceph-mon[28604]: pgmap v706: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:51:04.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:04 smithi060 ceph-mon[31721]: pgmap v706: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:51:04.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:04 smithi160 ceph-mon[32531]: pgmap v706: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:51:06.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:06 smithi044 ceph-mon[28604]: pgmap v707: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:06.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:06 smithi060 ceph-mon[31721]: pgmap v707: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:06.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:06 smithi160 ceph-mon[32531]: pgmap v707: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:08.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:08 smithi044 ceph-mon[28604]: pgmap v708: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:08.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:08 smithi060 ceph-mon[31721]: pgmap v708: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:08.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:08 smithi160 ceph-mon[32531]: pgmap v708: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:10.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:10 smithi044 ceph-mon[28604]: pgmap v709: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:51:10.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:10 smithi060 ceph-mon[31721]: pgmap v709: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:51:10.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:10 smithi160 ceph-mon[32531]: pgmap v709: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:51:11.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:11 smithi160 ceph-mon[32531]: pgmap v710: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:12.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:11 smithi044 ceph-mon[28604]: pgmap v710: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:12.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:11 smithi060 ceph-mon[31721]: pgmap v710: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:14.709 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:14 smithi060 ceph-mon[31721]: pgmap v711: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:51:14.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:14 smithi044 ceph-mon[28604]: pgmap v711: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:51:14.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:14 smithi160 ceph-mon[32531]: pgmap v711: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:51:16.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:16 smithi044 ceph-mon[28604]: pgmap v712: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:16 smithi060 ceph-mon[31721]: pgmap v712: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:16.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:16 smithi160 ceph-mon[32531]: pgmap v712: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:18.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:18 smithi044 ceph-mon[28604]: pgmap v713: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:18.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:18 smithi060 ceph-mon[31721]: pgmap v713: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:18.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:18 smithi160 ceph-mon[32531]: pgmap v713: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:20.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:20 smithi044 ceph-mon[28604]: pgmap v714: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:51:20.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:20 smithi060 ceph-mon[31721]: pgmap v714: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:51:20.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:20 smithi160 ceph-mon[32531]: pgmap v714: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-03T22:51:22.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:22 smithi044 ceph-mon[28604]: pgmap v715: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:22.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:22 smithi060 ceph-mon[31721]: pgmap v715: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:22.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:22 smithi160 ceph-mon[32531]: pgmap v715: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:24.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:24 smithi044 ceph-mon[28604]: pgmap v716: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:51:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:24 smithi060 ceph-mon[31721]: pgmap v716: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:51:24.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:24 smithi160 ceph-mon[32531]: pgmap v716: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:51:26.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:26 smithi044 ceph-mon[28604]: pgmap v717: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:26.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:26 smithi060 ceph-mon[31721]: pgmap v717: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:26.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:26 smithi160 ceph-mon[32531]: pgmap v717: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:28.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:28 smithi044 ceph-mon[28604]: pgmap v718: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:28.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:28 smithi060 ceph-mon[31721]: pgmap v718: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:28.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:28 smithi160 ceph-mon[32531]: pgmap v718: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:30.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:30 smithi044 ceph-mon[28604]: pgmap v719: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:30.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:30 smithi060 ceph-mon[31721]: pgmap v719: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:30.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:30 smithi160 ceph-mon[32531]: pgmap v719: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:32.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:32 smithi044 ceph-mon[28604]: pgmap v720: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:32.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:32 smithi060 ceph-mon[31721]: pgmap v720: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:32.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:32 smithi160 ceph-mon[32531]: pgmap v720: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:34.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:34 smithi044 ceph-mon[28604]: pgmap v721: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:51:34.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:34 smithi060 ceph-mon[31721]: pgmap v721: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:51:34.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:34 smithi160 ceph-mon[32531]: pgmap v721: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:51:35.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:35 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:51:35.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:35 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:51:35.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:35 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:51:36.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:36 smithi044 ceph-mon[28604]: pgmap v722: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:36.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:36 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:51:36.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:36 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:51:36.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:36 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:51:36.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:36 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:51:36.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:36 smithi060 ceph-mon[31721]: pgmap v722: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:36.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:36 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:51:36.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:36 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:51:36.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:36 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:51:36.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:36 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:51:36.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:36 smithi160 ceph-mon[32531]: pgmap v722: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:36.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:36 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:51:36.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:36 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:51:36.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:36 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:51:36.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:36 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:51:37.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:37 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:51:37.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:37 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:51:37.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:37 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:51:37.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:37 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:51:37.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:37 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:51:37.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:37 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:51:37.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:37 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:51:37.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:37 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:51:37.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:37 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:51:38.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:38 smithi044 ceph-mon[28604]: pgmap v723: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:38.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:38 smithi060 ceph-mon[31721]: pgmap v723: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:38.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:38 smithi160 ceph-mon[32531]: pgmap v723: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:40.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:40 smithi044 ceph-mon[28604]: pgmap v724: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:40 smithi060 ceph-mon[31721]: pgmap v724: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:40.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:40 smithi160 ceph-mon[32531]: pgmap v724: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:41.494 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:51:41.493+0000 7fc45e000640 1 -- 172.21.15.44:0/3783513548 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7fc440005850 con 0x7fc468108e60 2024-05-03T22:51:41.495 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:51:41.493+0000 7fc45f400640 1 -- 172.21.15.44:0/3783513548 <== mon.0 v2:172.21.15.44:3300/0 8 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7fc440005850 con 0x7fc468108e60 2024-05-03T22:51:41.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:41 smithi160 ceph-mon[32531]: pgmap v725: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:42.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:41 smithi044 ceph-mon[28604]: pgmap v725: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:42.004 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:41 smithi060 ceph-mon[31721]: pgmap v725: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:44.709 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:44 smithi060 ceph-mon[31721]: pgmap v726: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:51:44.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:44 smithi044 ceph-mon[28604]: pgmap v726: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:51:44.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:44 smithi160 ceph-mon[32531]: pgmap v726: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:51:46.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:46 smithi044 ceph-mon[28604]: pgmap v727: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:46.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:46 smithi060 ceph-mon[31721]: pgmap v727: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:46.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:46 smithi160 ceph-mon[32531]: pgmap v727: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:48.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:48 smithi044 ceph-mon[28604]: pgmap v728: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:48 smithi060 ceph-mon[31721]: pgmap v728: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:48 smithi160 ceph-mon[32531]: pgmap v728: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:50.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:50 smithi044 ceph-mon[28604]: pgmap v729: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:50.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:50 smithi060 ceph-mon[31721]: pgmap v729: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:50.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:50 smithi160 ceph-mon[32531]: pgmap v729: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:52.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:52 smithi044 ceph-mon[28604]: pgmap v730: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:52.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:52 smithi060 ceph-mon[31721]: pgmap v730: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:52.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:52 smithi160 ceph-mon[32531]: pgmap v730: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:54.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:54 smithi044 ceph-mon[28604]: pgmap v731: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:51:54.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:54 smithi060 ceph-mon[31721]: pgmap v731: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:51:54.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:54 smithi160 ceph-mon[32531]: pgmap v731: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:51:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:56 smithi044 ceph-mon[28604]: pgmap v732: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:56.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:56 smithi060 ceph-mon[31721]: pgmap v732: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:56.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:56 smithi160 ceph-mon[32531]: pgmap v732: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:51:58.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:51:58 smithi044 ceph-mon[28604]: pgmap v733: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:58.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:51:58 smithi060 ceph-mon[31721]: pgmap v733: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:51:58.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:51:58 smithi160 ceph-mon[32531]: pgmap v733: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:00.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:00 smithi044 ceph-mon[28604]: pgmap v734: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:00.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:00 smithi060 ceph-mon[31721]: pgmap v734: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:00.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:00 smithi160 ceph-mon[32531]: pgmap v734: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:02.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:02 smithi044 ceph-mon[28604]: pgmap v735: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:02.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:02 smithi060 ceph-mon[31721]: pgmap v735: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:02.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:02 smithi160 ceph-mon[32531]: pgmap v735: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:04.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:04 smithi044 ceph-mon[28604]: pgmap v736: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:52:04.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:04 smithi060 ceph-mon[31721]: pgmap v736: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:52:04.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:04 smithi160 ceph-mon[32531]: pgmap v736: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:52:06.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:06 smithi044 ceph-mon[28604]: pgmap v737: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:06.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:06 smithi060 ceph-mon[31721]: pgmap v737: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:06.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:06 smithi160 ceph-mon[32531]: pgmap v737: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:08.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:08 smithi044 ceph-mon[28604]: pgmap v738: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:08.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:08 smithi060 ceph-mon[31721]: pgmap v738: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:08.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:08 smithi160 ceph-mon[32531]: pgmap v738: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:10.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:10 smithi044 ceph-mon[28604]: pgmap v739: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:10.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:10 smithi060 ceph-mon[31721]: pgmap v739: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:10.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:10 smithi160 ceph-mon[32531]: pgmap v739: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:12.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:11 smithi044 ceph-mon[28604]: pgmap v740: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:12.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:11 smithi060 ceph-mon[31721]: pgmap v740: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:12.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:11 smithi160 ceph-mon[32531]: pgmap v740: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:14.709 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:14 smithi060 ceph-mon[31721]: pgmap v741: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:52:14.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:14 smithi044 ceph-mon[28604]: pgmap v741: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:52:14.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:14 smithi160 ceph-mon[32531]: pgmap v741: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:52:16.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:16 smithi044 ceph-mon[28604]: pgmap v742: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:16 smithi060 ceph-mon[31721]: pgmap v742: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:16.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:16 smithi160 ceph-mon[32531]: pgmap v742: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:18.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:18 smithi044 ceph-mon[28604]: pgmap v743: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:18.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:18 smithi060 ceph-mon[31721]: pgmap v743: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:18.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:18 smithi160 ceph-mon[32531]: pgmap v743: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:20.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:20 smithi044 ceph-mon[28604]: pgmap v744: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:20.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:20 smithi060 ceph-mon[31721]: pgmap v744: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:20.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:20 smithi160 ceph-mon[32531]: pgmap v744: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:22.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:22 smithi044 ceph-mon[28604]: pgmap v745: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:22.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:22 smithi060 ceph-mon[31721]: pgmap v745: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:22.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:22 smithi160 ceph-mon[32531]: pgmap v745: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:24.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:24 smithi044 ceph-mon[28604]: pgmap v746: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:52:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:24 smithi060 ceph-mon[31721]: pgmap v746: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:52:24.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:24 smithi160 ceph-mon[32531]: pgmap v746: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:52:26.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:26 smithi044 ceph-mon[28604]: pgmap v747: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:26.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:26 smithi060 ceph-mon[31721]: pgmap v747: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:26.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:26 smithi160 ceph-mon[32531]: pgmap v747: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:28 smithi044 ceph-mon[28604]: pgmap v748: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:28.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:28 smithi060 ceph-mon[31721]: pgmap v748: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:28.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:28 smithi160 ceph-mon[32531]: pgmap v748: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:30.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:30 smithi044 ceph-mon[28604]: pgmap v749: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:30.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:30 smithi060 ceph-mon[31721]: pgmap v749: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:30.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:30 smithi160 ceph-mon[32531]: pgmap v749: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:32.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:32 smithi044 ceph-mon[28604]: pgmap v750: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:32.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:32 smithi060 ceph-mon[31721]: pgmap v750: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:32.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:32 smithi160 ceph-mon[32531]: pgmap v750: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:34.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:34 smithi044 ceph-mon[28604]: pgmap v751: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:52:34.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:34 smithi060 ceph-mon[31721]: pgmap v751: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:52:34.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:34 smithi160 ceph-mon[32531]: pgmap v751: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:52:35.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:35 smithi044 ceph-mon[28604]: pgmap v752: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:35.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:35 smithi060 ceph-mon[31721]: pgmap v752: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:35.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:35 smithi160 ceph-mon[32531]: pgmap v752: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:38.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:38 smithi044 ceph-mon[28604]: pgmap v753: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:38.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:38 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:52:38.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:38 smithi060 ceph-mon[31721]: pgmap v753: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:38.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:38 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:52:38.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:38 smithi160 ceph-mon[32531]: pgmap v753: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:38.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:38 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:52:40.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:40 smithi044 ceph-mon[28604]: pgmap v754: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:40.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:40 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:40.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:40 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:40.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:40 smithi060 ceph-mon[31721]: pgmap v754: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:40 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:40 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:40.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:40 smithi160 ceph-mon[32531]: pgmap v754: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:40.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:40 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:40.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:40 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:42.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:42.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:42.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:42.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:41 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:42.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:41 smithi044 ceph-mon[28604]: pgmap v755: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:42.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:42.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:42.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:42.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:41 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:42.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:41 smithi060 ceph-mon[31721]: pgmap v755: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:42.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:42.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:42.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:42.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:41 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:42.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:41 smithi160 ceph-mon[32531]: pgmap v755: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:43.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:42 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:52:43.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:42 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:52:43.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:42 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:43.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:42 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:52:43.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:42 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:52:43.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:42 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:43.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:42 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:52:43.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:42 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:52:43.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:42 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:52:44.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:43 smithi044 ceph-mon[28604]: pgmap v756: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:52:44.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:43 smithi060 ceph-mon[31721]: pgmap v756: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:52:44.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:43 smithi160 ceph-mon[32531]: pgmap v756: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-03T22:52:46.709 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:46 smithi060 ceph-mon[31721]: pgmap v757: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:46.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:46 smithi044 ceph-mon[28604]: pgmap v757: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:46.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:46 smithi160 ceph-mon[32531]: pgmap v757: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:48.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:48 smithi044 ceph-mon[28604]: pgmap v758: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:48.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:48 smithi060 ceph-mon[31721]: pgmap v758: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:48.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:48 smithi160 ceph-mon[32531]: pgmap v758: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:50.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:50 smithi044 ceph-mon[28604]: pgmap v759: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:50.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:50 smithi060 ceph-mon[31721]: pgmap v759: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:50.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:50 smithi160 ceph-mon[32531]: pgmap v759: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:52.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:52 smithi044 ceph-mon[28604]: pgmap v760: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:52.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:52 smithi060 ceph-mon[31721]: pgmap v760: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:52.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:52 smithi160 ceph-mon[32531]: pgmap v760: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:54.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:54 smithi044 ceph-mon[28604]: pgmap v761: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:52:54.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:54 smithi060 ceph-mon[31721]: pgmap v761: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:52:54.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:54 smithi160 ceph-mon[32531]: pgmap v761: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:52:56.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:56 smithi044 ceph-mon[28604]: pgmap v762: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:56.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:56 smithi060 ceph-mon[31721]: pgmap v762: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:56.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:56 smithi160 ceph-mon[32531]: pgmap v762: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:52:58.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:52:58 smithi044 ceph-mon[28604]: pgmap v763: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:58.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:52:58 smithi060 ceph-mon[31721]: pgmap v763: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:52:58.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:52:58 smithi160 ceph-mon[32531]: pgmap v763: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:53:00.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:00 smithi044 ceph-mon[28604]: pgmap v764: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:53:00.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:00 smithi060 ceph-mon[31721]: pgmap v764: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:53:00.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:00 smithi160 ceph-mon[32531]: pgmap v764: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:53:02.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:02 smithi044 ceph-mon[28604]: pgmap v765: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:53:02.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:02 smithi060 ceph-mon[31721]: pgmap v765: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:53:02.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:02 smithi160 ceph-mon[32531]: pgmap v765: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:53:04.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:04 smithi044 ceph-mon[28604]: pgmap v766: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:53:04.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:04 smithi060 ceph-mon[31721]: pgmap v766: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:53:04.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:04 smithi160 ceph-mon[32531]: pgmap v766: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:53:06.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:06 smithi044 ceph-mon[28604]: pgmap v767: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:53:06.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:06 smithi060 ceph-mon[31721]: pgmap v767: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:53:06.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:06 smithi160 ceph-mon[32531]: pgmap v767: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:53:07.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:07 smithi044 ceph-mon[28604]: pgmap v768: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:53:07.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:07 smithi060 ceph-mon[31721]: pgmap v768: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:53:07.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:07 smithi160 ceph-mon[32531]: pgmap v768: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:53:10.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:10 smithi044 ceph-mon[28604]: pgmap v769: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:53:10.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:10 smithi060 ceph-mon[31721]: pgmap v769: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:53:10.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:10 smithi160 ceph-mon[32531]: pgmap v769: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:53:12.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:12 smithi044 ceph-mon[28604]: pgmap v770: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:53:12.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:12 smithi060 ceph-mon[31721]: pgmap v770: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:53:12.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:12 smithi160 ceph-mon[32531]: pgmap v770: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:53:14.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:14 smithi044 ceph-mon[28604]: pgmap v771: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:53:14.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:14 smithi060 ceph-mon[31721]: pgmap v771: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:53:14.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:14 smithi160 ceph-mon[32531]: pgmap v771: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:53:16.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:16 smithi044 ceph-mon[28604]: pgmap v772: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:53:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:16 smithi060 ceph-mon[31721]: pgmap v772: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:53:16.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:16 smithi160 ceph-mon[32531]: pgmap v772: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:53:18.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:18 smithi044 ceph-mon[28604]: pgmap v773: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:53:18.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:18 smithi060 ceph-mon[31721]: pgmap v773: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:53:18.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:18 smithi160 ceph-mon[32531]: pgmap v773: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:53:20.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:20 smithi044 ceph-mon[28604]: pgmap v774: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:53:20.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:20 smithi060 ceph-mon[31721]: pgmap v774: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:53:20.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:20 smithi160 ceph-mon[32531]: pgmap v774: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:53:22.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:22 smithi044 ceph-mon[28604]: pgmap v775: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:53:22.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:22 smithi060 ceph-mon[31721]: pgmap v775: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:53:22.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:22 smithi160 ceph-mon[32531]: pgmap v775: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:53:24.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:24 smithi044 ceph-mon[28604]: pgmap v776: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-05-03T22:53:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:24 smithi060 ceph-mon[31721]: pgmap v776: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-05-03T22:53:24.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:24 smithi160 ceph-mon[32531]: pgmap v776: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 8 op/s 2024-05-03T22:53:26.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:26 smithi044 ceph-mon[28604]: pgmap v777: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:53:26.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:26 smithi060 ceph-mon[31721]: pgmap v777: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:53:26.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:26 smithi160 ceph-mon[32531]: pgmap v777: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:53:28.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:27 smithi044 ceph-mon[28604]: pgmap v778: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:53:28.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:27 smithi060 ceph-mon[31721]: pgmap v778: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:53:28.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:27 smithi160 ceph-mon[32531]: pgmap v778: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-03T22:53:30.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:30 smithi044 ceph-mon[28604]: pgmap v779: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:53:30.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:30 smithi060 ceph-mon[31721]: pgmap v779: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:53:30.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:30 smithi160 ceph-mon[32531]: pgmap v779: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-03T22:53:32.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:32 smithi044 ceph-mon[28604]: pgmap v780: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:53:32.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:32 smithi060 ceph-mon[31721]: pgmap v780: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:53:32.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:32 smithi160 ceph-mon[32531]: pgmap v780: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:53:34.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:34 smithi044 ceph-mon[28604]: pgmap v781: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:53:34.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:34 smithi060 ceph-mon[31721]: pgmap v781: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:53:34.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:34 smithi160 ceph-mon[32531]: pgmap v781: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:53:36.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:36 smithi044 ceph-mon[28604]: pgmap v782: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:53:36.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:36 smithi060 ceph-mon[31721]: pgmap v782: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:53:36.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:36 smithi160 ceph-mon[32531]: pgmap v782: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:53:38.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:38 smithi044 ceph-mon[28604]: pgmap v783: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:53:38.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:38 smithi060 ceph-mon[31721]: pgmap v783: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:53:38.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:38 smithi160 ceph-mon[32531]: pgmap v783: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:53:40.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:40 smithi044 ceph-mon[28604]: pgmap v784: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:53:40.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:40 smithi060 ceph-mon[31721]: pgmap v784: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:53:40.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:40 smithi160 ceph-mon[32531]: pgmap v784: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:53:42.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:42 smithi044 ceph-mon[28604]: pgmap v785: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:53:42.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:42 smithi060 ceph-mon[31721]: pgmap v785: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:53:42.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:42 smithi160 ceph-mon[32531]: pgmap v785: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:53:43.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:43 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:53:43.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:43 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:53:43.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:43 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:53:44.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:44 smithi044 ceph-mon[28604]: pgmap v786: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:53:44.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:44 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:53:44.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:44 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:53:44.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:44 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:53:44.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:44 smithi060 ceph-mon[31721]: pgmap v786: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:53:44.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:44 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:53:44.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:44 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:53:44.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:44 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:53:44.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:44 smithi160 ceph-mon[32531]: pgmap v786: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:53:44.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:44 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:53:44.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:44 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:53:44.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:44 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:53:45.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:45 smithi060 ceph-mon[31721]: pgmap v787: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:53:45.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:45 smithi160 ceph-mon[32531]: pgmap v787: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:53:46.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:45 smithi044 ceph-mon[28604]: pgmap v787: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:53:48.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:48 smithi044 ceph-mon[28604]: pgmap v788: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:53:48.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:48 smithi060 ceph-mon[31721]: pgmap v788: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:53:48.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:48 smithi160 ceph-mon[32531]: pgmap v788: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:53:50.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:50 smithi044 ceph-mon[28604]: pgmap v789: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:53:50.796 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:50 smithi160 ceph-mon[32531]: pgmap v789: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:53:50.796 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:50 smithi060 ceph-mon[31721]: pgmap v789: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:53:52.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:52 smithi044 ceph-mon[28604]: pgmap v790: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:53:52.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:52 smithi060 ceph-mon[31721]: pgmap v790: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:53:52.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:52 smithi160 ceph-mon[32531]: pgmap v790: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:53:54.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:54 smithi044 ceph-mon[28604]: pgmap v791: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:53:54.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:54 smithi060 ceph-mon[31721]: pgmap v791: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:53:54.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:54 smithi160 ceph-mon[32531]: pgmap v791: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:53:56.517 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:53:56.516+0000 7fc45e000640 1 -- 172.21.15.44:0/3783513548 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- auth(proto 2 132 bytes epoch 0) -- 0x7fc440005b70 con 0x7fc468108e60 2024-05-03T22:53:56.518 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:53:56.517+0000 7fc45f400640 1 -- 172.21.15.44:0/3783513548 <== mon.0 v2:172.21.15.44:3300/0 9 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (secure 0 0 0) 0x7fc440005b70 con 0x7fc468108e60 2024-05-03T22:53:56.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:56 smithi044 ceph-mon[28604]: pgmap v792: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:53:56.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:56 smithi060 ceph-mon[31721]: pgmap v792: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:53:56.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:56 smithi160 ceph-mon[32531]: pgmap v792: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:53:58.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:53:58 smithi044 ceph-mon[28604]: pgmap v793: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:53:58.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:53:58 smithi060 ceph-mon[31721]: pgmap v793: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:53:58.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:53:58 smithi160 ceph-mon[32531]: pgmap v793: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:54:00.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:00 smithi044 ceph-mon[28604]: pgmap v794: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:54:00.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:00 smithi060 ceph-mon[31721]: pgmap v794: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:54:00.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:00 smithi160 ceph-mon[32531]: pgmap v794: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:54:02.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:01 smithi044 ceph-mon[28604]: pgmap v795: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:02.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:01 smithi060 ceph-mon[31721]: pgmap v795: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:02.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:01 smithi160 ceph-mon[32531]: pgmap v795: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:04.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:04 smithi044 ceph-mon[28604]: pgmap v796: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:54:04.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:04 smithi060 ceph-mon[31721]: pgmap v796: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:54:04.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:04 smithi160 ceph-mon[32531]: pgmap v796: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:54:06.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:06 smithi044 ceph-mon[28604]: pgmap v797: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:06.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:06 smithi060 ceph-mon[31721]: pgmap v797: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:06.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:06 smithi160 ceph-mon[32531]: pgmap v797: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:08.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:08 smithi044 ceph-mon[28604]: pgmap v798: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:08.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:08 smithi060 ceph-mon[31721]: pgmap v798: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:08.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:08 smithi160 ceph-mon[32531]: pgmap v798: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:10.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:10 smithi044 ceph-mon[28604]: pgmap v799: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:10.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:10 smithi060 ceph-mon[31721]: pgmap v799: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:10.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:10 smithi160 ceph-mon[32531]: pgmap v799: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:12.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:12 smithi044 ceph-mon[28604]: pgmap v800: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:12.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:12 smithi060 ceph-mon[31721]: pgmap v800: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:12.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:12 smithi160 ceph-mon[32531]: pgmap v800: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:14.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:14 smithi044 ceph-mon[28604]: pgmap v801: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:54:14.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:14 smithi060 ceph-mon[31721]: pgmap v801: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:54:14.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:14 smithi160 ceph-mon[32531]: pgmap v801: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:54:16.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:15 smithi044 ceph-mon[28604]: pgmap v802: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:16.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:15 smithi060 ceph-mon[31721]: pgmap v802: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:16.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:15 smithi160 ceph-mon[32531]: pgmap v802: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:18.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:18 smithi044 ceph-mon[28604]: pgmap v803: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:18.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:18 smithi060 ceph-mon[31721]: pgmap v803: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:18.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:18 smithi160 ceph-mon[32531]: pgmap v803: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:20.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:20 smithi044 ceph-mon[28604]: pgmap v804: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:20.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:20 smithi060 ceph-mon[31721]: pgmap v804: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:20.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:20 smithi160 ceph-mon[32531]: pgmap v804: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:22.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:22 smithi044 ceph-mon[28604]: pgmap v805: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:22.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:22 smithi060 ceph-mon[31721]: pgmap v805: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:22.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:22 smithi160 ceph-mon[32531]: pgmap v805: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:24.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:24 smithi044 ceph-mon[28604]: pgmap v806: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:54:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:24 smithi060 ceph-mon[31721]: pgmap v806: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:54:24.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:24 smithi160 ceph-mon[32531]: pgmap v806: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:54:26.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:26 smithi044 ceph-mon[28604]: pgmap v807: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:26.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:26 smithi060 ceph-mon[31721]: pgmap v807: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:26.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:26 smithi160 ceph-mon[32531]: pgmap v807: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:28.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:27 smithi044 ceph-mon[28604]: pgmap v808: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:28.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:27 smithi060 ceph-mon[31721]: pgmap v808: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:28.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:27 smithi160 ceph-mon[32531]: pgmap v808: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:30.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:30 smithi044 ceph-mon[28604]: pgmap v809: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:30.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:30 smithi060 ceph-mon[31721]: pgmap v809: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:30.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:30 smithi160 ceph-mon[32531]: pgmap v809: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:32.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:32 smithi044 ceph-mon[28604]: pgmap v810: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:32.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:32 smithi060 ceph-mon[31721]: pgmap v810: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:32.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:32 smithi160 ceph-mon[32531]: pgmap v810: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:34.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:34 smithi044 ceph-mon[28604]: pgmap v811: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:54:34.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:34 smithi060 ceph-mon[31721]: pgmap v811: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:54:34.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:34 smithi160 ceph-mon[32531]: pgmap v811: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:54:36.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:36 smithi044 ceph-mon[28604]: pgmap v812: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:36.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:36 smithi060 ceph-mon[31721]: pgmap v812: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:36.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:36 smithi160 ceph-mon[32531]: pgmap v812: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:38.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:38 smithi044 ceph-mon[28604]: pgmap v813: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:38.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:38 smithi060 ceph-mon[31721]: pgmap v813: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:38.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:38 smithi160 ceph-mon[32531]: pgmap v813: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:39.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:39 smithi160 ceph-mon[32531]: pgmap v814: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:40.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:39 smithi044 ceph-mon[28604]: pgmap v814: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:40.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:39 smithi060 ceph-mon[31721]: pgmap v814: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:41.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:54:41.524+0000 7fc45e000640 1 -- 172.21.15.44:0/3783513548 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7fc440005ed0 con 0x7fc468108e60 2024-05-03T22:54:41.525 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:54:41.524+0000 7fc45f400640 1 -- 172.21.15.44:0/3783513548 <== mon.0 v2:172.21.15.44:3300/0 10 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7fc440005ed0 con 0x7fc468108e60 2024-05-03T22:54:42.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:42 smithi044 ceph-mon[28604]: pgmap v815: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:42.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:42 smithi060 ceph-mon[31721]: pgmap v815: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:42.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:42 smithi160 ceph-mon[32531]: pgmap v815: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:44.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:44 smithi044 ceph-mon[28604]: pgmap v816: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:54:44.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:44 smithi060 ceph-mon[31721]: pgmap v816: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:54:44.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:44 smithi160 ceph-mon[32531]: pgmap v816: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:54:45.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:45 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:54:45.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:45 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:54:45.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:45 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:54:46.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:46 smithi044 ceph-mon[28604]: pgmap v817: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:46.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:54:46.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:54:46.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:46 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:54:46.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:46 smithi060 ceph-mon[31721]: pgmap v817: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:46.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:54:46.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:54:46.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:46 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:54:46.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:46 smithi160 ceph-mon[32531]: pgmap v817: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:46.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:54:46.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:54:46.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:46 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:54:47.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:47 smithi160 ceph-mon[32531]: pgmap v818: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:48.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:47 smithi044 ceph-mon[28604]: pgmap v818: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:48.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:47 smithi060 ceph-mon[31721]: pgmap v818: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:50.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:50 smithi044 ceph-mon[28604]: pgmap v819: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:50.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:50 smithi060 ceph-mon[31721]: pgmap v819: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:50.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:50 smithi160 ceph-mon[32531]: pgmap v819: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:52.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:52 smithi044 ceph-mon[28604]: pgmap v820: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:52.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:52 smithi060 ceph-mon[31721]: pgmap v820: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:52.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:52 smithi160 ceph-mon[32531]: pgmap v820: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:54.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:54 smithi044 ceph-mon[28604]: pgmap v821: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:54:54.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:54 smithi060 ceph-mon[31721]: pgmap v821: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:54:54.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:54 smithi160 ceph-mon[32531]: pgmap v821: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:54:56.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:56 smithi044 ceph-mon[28604]: pgmap v822: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:56.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:56 smithi060 ceph-mon[31721]: pgmap v822: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:56.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:56 smithi160 ceph-mon[32531]: pgmap v822: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:54:57.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:54:57 smithi160 ceph-mon[32531]: pgmap v823: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:58.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:54:57 smithi044 ceph-mon[28604]: pgmap v823: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:54:58.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:54:57 smithi060 ceph-mon[31721]: pgmap v823: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:00.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:00 smithi044 ceph-mon[28604]: pgmap v824: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:00.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:00 smithi060 ceph-mon[31721]: pgmap v824: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:00.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:00 smithi160 ceph-mon[32531]: pgmap v824: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:02.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:02 smithi044 ceph-mon[28604]: pgmap v825: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:02.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:02 smithi060 ceph-mon[31721]: pgmap v825: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:02.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:02 smithi160 ceph-mon[32531]: pgmap v825: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:04.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:04 smithi044 ceph-mon[28604]: pgmap v826: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:55:04.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:04 smithi060 ceph-mon[31721]: pgmap v826: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:55:04.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:04 smithi160 ceph-mon[32531]: pgmap v826: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:55:06.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:05 smithi044 ceph-mon[28604]: pgmap v827: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:06.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:05 smithi060 ceph-mon[31721]: pgmap v827: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:06.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:05 smithi160 ceph-mon[32531]: pgmap v827: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:08.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:08 smithi044 ceph-mon[28604]: pgmap v828: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:08.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:08 smithi060 ceph-mon[31721]: pgmap v828: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:08.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:08 smithi160 ceph-mon[32531]: pgmap v828: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:10.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:10 smithi044 ceph-mon[28604]: pgmap v829: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:10.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:10 smithi060 ceph-mon[31721]: pgmap v829: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:10.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:10 smithi160 ceph-mon[32531]: pgmap v829: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:12.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:12 smithi060 ceph-mon[31721]: pgmap v830: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:12.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:12 smithi160 ceph-mon[32531]: pgmap v830: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:13.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:12 smithi044 ceph-mon[28604]: pgmap v830: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:14.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:13 smithi044 ceph-mon[28604]: pgmap v831: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:55:14.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:13 smithi060 ceph-mon[31721]: pgmap v831: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:55:14.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:13 smithi160 ceph-mon[32531]: pgmap v831: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:55:16.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:16 smithi044 ceph-mon[28604]: pgmap v832: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:16 smithi060 ceph-mon[31721]: pgmap v832: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:16.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:16 smithi160 ceph-mon[32531]: pgmap v832: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:18.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:18 smithi044 ceph-mon[28604]: pgmap v833: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:18.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:18 smithi060 ceph-mon[31721]: pgmap v833: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:18.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:18 smithi160 ceph-mon[32531]: pgmap v833: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:20.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:19 smithi044 ceph-mon[28604]: pgmap v834: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:20.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:19 smithi060 ceph-mon[31721]: pgmap v834: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:20.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:19 smithi160 ceph-mon[32531]: pgmap v834: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:22.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:22 smithi044 ceph-mon[28604]: pgmap v835: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:22.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:22 smithi060 ceph-mon[31721]: pgmap v835: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:22.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:22 smithi160 ceph-mon[32531]: pgmap v835: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:24.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:24 smithi060 ceph-mon[31721]: pgmap v836: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:55:24.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:24 smithi160 ceph-mon[32531]: pgmap v836: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:55:25.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:24 smithi044 ceph-mon[28604]: pgmap v836: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:55:26.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:25 smithi044 ceph-mon[28604]: pgmap v837: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:26.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:25 smithi060 ceph-mon[31721]: pgmap v837: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:26.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:25 smithi160 ceph-mon[32531]: pgmap v837: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:28 smithi044 ceph-mon[28604]: pgmap v838: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:28.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:28 smithi060 ceph-mon[31721]: pgmap v838: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:28.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:28 smithi160 ceph-mon[32531]: pgmap v838: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:30.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:30 smithi160 ceph-mon[32531]: pgmap v839: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:31.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:30 smithi044 ceph-mon[28604]: pgmap v839: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:31.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:30 smithi060 ceph-mon[31721]: pgmap v839: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:32.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:31 smithi044 ceph-mon[28604]: pgmap v840: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:32.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:31 smithi060 ceph-mon[31721]: pgmap v840: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:32.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:31 smithi160 ceph-mon[32531]: pgmap v840: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:34.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:34 smithi060 ceph-mon[31721]: pgmap v841: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:55:34.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:34 smithi160 ceph-mon[32531]: pgmap v841: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:55:35.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:34 smithi044 ceph-mon[28604]: pgmap v841: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:55:36.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:35 smithi044 ceph-mon[28604]: pgmap v842: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:36.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:35 smithi060 ceph-mon[31721]: pgmap v842: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:36.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:35 smithi160 ceph-mon[32531]: pgmap v842: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:38.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:38 smithi160 ceph-mon[32531]: pgmap v843: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:39.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:38 smithi044 ceph-mon[28604]: pgmap v843: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:39.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:38 smithi060 ceph-mon[31721]: pgmap v843: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:40.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:39 smithi044 ceph-mon[28604]: pgmap v844: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:55:40.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:39 smithi060 ceph-mon[31721]: pgmap v844: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:55:40.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:39 smithi160 ceph-mon[32531]: pgmap v844: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:55:42.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:42 smithi160 ceph-mon[32531]: pgmap v845: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:55:43.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:42 smithi044 ceph-mon[28604]: pgmap v845: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:55:43.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:42 smithi060 ceph-mon[31721]: pgmap v845: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:55:43.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:43 smithi160 ceph-mon[32531]: pgmap v846: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:55:44.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:43 smithi044 ceph-mon[28604]: pgmap v846: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:55:44.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:43 smithi060 ceph-mon[31721]: pgmap v846: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T22:55:46.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:46 smithi160 ceph-mon[32531]: pgmap v847: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:55:47.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:46 smithi044 ceph-mon[28604]: pgmap v847: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:55:47.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:46 smithi060 ceph-mon[31721]: pgmap v847: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:55:47.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:47 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:55:47.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:47 smithi160 ceph-mon[32531]: pgmap v848: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:55:48.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:47 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:55:48.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:47 smithi044 ceph-mon[28604]: pgmap v848: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:55:48.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:47 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:55:48.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:47 smithi060 ceph-mon[31721]: pgmap v848: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:55:49.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:48 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:55:49.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:48 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:55:49.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:48 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:55:49.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:48 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:55:49.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:48 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:55:49.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:48 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:55:49.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:48 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:55:49.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:48 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:55:49.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:48 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:55:50.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:49 smithi044 ceph-mon[28604]: pgmap v849: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:55:50.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:49 smithi060 ceph-mon[31721]: pgmap v849: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:55:50.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:49 smithi160 ceph-mon[32531]: pgmap v849: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:55:52.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:51 smithi044 ceph-mon[28604]: pgmap v850: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:52.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:51 smithi060 ceph-mon[31721]: pgmap v850: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:52.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:51 smithi160 ceph-mon[32531]: pgmap v850: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:53.818 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:53 smithi160 ceph-mon[32531]: pgmap v851: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:55:54.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:53 smithi044 ceph-mon[28604]: pgmap v851: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:55:54.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:53 smithi060 ceph-mon[31721]: pgmap v851: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:55:56.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:55 smithi044 ceph-mon[28604]: pgmap v852: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:56.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:55 smithi060 ceph-mon[31721]: pgmap v852: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:56.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:55 smithi160 ceph-mon[32531]: pgmap v852: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:55:58.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:57 smithi044 ceph-mon[28604]: pgmap v853: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:58.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:57 smithi060 ceph-mon[31721]: pgmap v853: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:55:58.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:57 smithi160 ceph-mon[32531]: pgmap v853: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:00.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:55:59 smithi044 ceph-mon[28604]: pgmap v854: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:00.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:55:59 smithi060 ceph-mon[31721]: pgmap v854: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:00.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:55:59 smithi160 ceph-mon[32531]: pgmap v854: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:02.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:01 smithi044 ceph-mon[28604]: pgmap v855: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:02.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:01 smithi060 ceph-mon[31721]: pgmap v855: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:02.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:01 smithi160 ceph-mon[32531]: pgmap v855: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:04.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:03 smithi044 ceph-mon[28604]: pgmap v856: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:56:04.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:03 smithi060 ceph-mon[31721]: pgmap v856: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:56:04.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:03 smithi160 ceph-mon[32531]: pgmap v856: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:56:06.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:05 smithi044 ceph-mon[28604]: pgmap v857: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:06.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:05 smithi060 ceph-mon[31721]: pgmap v857: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:06.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:05 smithi160 ceph-mon[32531]: pgmap v857: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:08.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:07 smithi044 ceph-mon[28604]: pgmap v858: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:08.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:07 smithi060 ceph-mon[31721]: pgmap v858: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:08.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:07 smithi160 ceph-mon[32531]: pgmap v858: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:10.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:09 smithi044 ceph-mon[28604]: pgmap v859: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:10.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:09 smithi060 ceph-mon[31721]: pgmap v859: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:10.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:09 smithi160 ceph-mon[32531]: pgmap v859: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:12.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:11 smithi044 ceph-mon[28604]: pgmap v860: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:12.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:11 smithi060 ceph-mon[31721]: pgmap v860: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:12.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:11 smithi160 ceph-mon[32531]: pgmap v860: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:14.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:13 smithi044 ceph-mon[28604]: pgmap v861: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:56:14.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:13 smithi060 ceph-mon[31721]: pgmap v861: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:56:14.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:13 smithi160 ceph-mon[32531]: pgmap v861: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:56:16.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:15 smithi044 ceph-mon[28604]: pgmap v862: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:16.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:15 smithi060 ceph-mon[31721]: pgmap v862: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:16.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:15 smithi160 ceph-mon[32531]: pgmap v862: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:17 smithi044 ceph-mon[28604]: pgmap v863: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:18.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:17 smithi060 ceph-mon[31721]: pgmap v863: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:18.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:17 smithi160 ceph-mon[32531]: pgmap v863: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:20.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:19 smithi044 ceph-mon[28604]: pgmap v864: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:20.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:19 smithi060 ceph-mon[31721]: pgmap v864: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:20.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:19 smithi160 ceph-mon[32531]: pgmap v864: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:22.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:21 smithi044 ceph-mon[28604]: pgmap v865: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:22.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:21 smithi060 ceph-mon[31721]: pgmap v865: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:22.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:21 smithi160 ceph-mon[32531]: pgmap v865: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:23.820 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:23 smithi160 ceph-mon[32531]: pgmap v866: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:56:24.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:23 smithi044 ceph-mon[28604]: pgmap v866: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:56:24.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:23 smithi060 ceph-mon[31721]: pgmap v866: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-03T22:56:26.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:25 smithi044 ceph-mon[28604]: pgmap v867: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:26.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:25 smithi060 ceph-mon[31721]: pgmap v867: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:26.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:25 smithi160 ceph-mon[32531]: pgmap v867: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:28.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:27 smithi044 ceph-mon[28604]: pgmap v868: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:28.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:27 smithi060 ceph-mon[31721]: pgmap v868: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:28.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:27 smithi160 ceph-mon[32531]: pgmap v868: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:30.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:29 smithi044 ceph-mon[28604]: pgmap v869: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:30.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:29 smithi060 ceph-mon[31721]: pgmap v869: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:30.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:29 smithi160 ceph-mon[32531]: pgmap v869: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:32.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:31 smithi044 ceph-mon[28604]: pgmap v870: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:32.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:31 smithi060 ceph-mon[31721]: pgmap v870: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:32.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:31 smithi160 ceph-mon[32531]: pgmap v870: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:34.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:33 smithi044 ceph-mon[28604]: pgmap v871: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:56:34.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:33 smithi060 ceph-mon[31721]: pgmap v871: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:56:34.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:33 smithi160 ceph-mon[32531]: pgmap v871: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:56:36.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:35 smithi044 ceph-mon[28604]: pgmap v872: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:36.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:35 smithi060 ceph-mon[31721]: pgmap v872: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:36.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:35 smithi160 ceph-mon[32531]: pgmap v872: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:38.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:37 smithi044 ceph-mon[28604]: pgmap v873: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:38.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:37 smithi060 ceph-mon[31721]: pgmap v873: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:38.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:37 smithi160 ceph-mon[32531]: pgmap v873: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:40.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:39 smithi044 ceph-mon[28604]: pgmap v874: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:40.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:39 smithi060 ceph-mon[31721]: pgmap v874: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:40.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:39 smithi160 ceph-mon[32531]: pgmap v874: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:42.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:41 smithi044 ceph-mon[28604]: pgmap v875: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:42.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:41 smithi060 ceph-mon[31721]: pgmap v875: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:42.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:41 smithi160 ceph-mon[32531]: pgmap v875: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:44.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:43 smithi044 ceph-mon[28604]: pgmap v876: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:56:44.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:43 smithi060 ceph-mon[31721]: pgmap v876: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:56:44.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:43 smithi160 ceph-mon[32531]: pgmap v876: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:56:46.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:45 smithi044 ceph-mon[28604]: pgmap v877: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:46.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:45 smithi060 ceph-mon[31721]: pgmap v877: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:46.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:45 smithi160 ceph-mon[32531]: pgmap v877: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:48.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:48 smithi044 ceph-mon[28604]: pgmap v878: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:48.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:48 smithi060 ceph-mon[31721]: pgmap v878: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:48.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:48 smithi160 ceph-mon[32531]: pgmap v878: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:49.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:49 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:56:49.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:49 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:56:49.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:49 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:56:50.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:50 smithi044 ceph-mon[28604]: pgmap v879: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:50.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:50 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:56:50.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:50 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:56:50.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:50 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:56:50.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:50 smithi060 ceph-mon[31721]: pgmap v879: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:50.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:50 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:56:50.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:50 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:56:50.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:50 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:56:50.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:50 smithi160 ceph-mon[32531]: pgmap v879: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:56:50.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:50 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:56:50.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:50 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:56:50.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:50 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:56:52.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:51 smithi044 ceph-mon[28604]: pgmap v880: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:52.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:51 smithi060 ceph-mon[31721]: pgmap v880: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:52.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:51 smithi160 ceph-mon[32531]: pgmap v880: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:54.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:53 smithi044 ceph-mon[28604]: pgmap v881: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:56:54.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:53 smithi060 ceph-mon[31721]: pgmap v881: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:56:54.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:53 smithi160 ceph-mon[32531]: pgmap v881: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:56:56.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:55 smithi044 ceph-mon[28604]: pgmap v882: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:56.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:55 smithi060 ceph-mon[31721]: pgmap v882: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:56.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:55 smithi160 ceph-mon[32531]: pgmap v882: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:58.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:57 smithi044 ceph-mon[28604]: pgmap v883: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:58.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:57 smithi060 ceph-mon[31721]: pgmap v883: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:56:58.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:57 smithi160 ceph-mon[32531]: pgmap v883: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:00.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:56:59 smithi044 ceph-mon[28604]: pgmap v884: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:57:00.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:56:59 smithi060 ceph-mon[31721]: pgmap v884: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:57:00.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:56:59 smithi160 ceph-mon[32531]: pgmap v884: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:57:02.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:01 smithi044 ceph-mon[28604]: pgmap v885: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:02.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:01 smithi060 ceph-mon[31721]: pgmap v885: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:02.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:01 smithi160 ceph-mon[32531]: pgmap v885: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:04.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:03 smithi044 ceph-mon[28604]: pgmap v886: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:57:04.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:03 smithi060 ceph-mon[31721]: pgmap v886: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:57:04.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:03 smithi160 ceph-mon[32531]: pgmap v886: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:57:06.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:05 smithi044 ceph-mon[28604]: pgmap v887: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:06.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:05 smithi060 ceph-mon[31721]: pgmap v887: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:06.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:05 smithi160 ceph-mon[32531]: pgmap v887: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:08.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:07 smithi044 ceph-mon[28604]: pgmap v888: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:08.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:07 smithi060 ceph-mon[31721]: pgmap v888: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:08.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:07 smithi160 ceph-mon[32531]: pgmap v888: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:10.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:09 smithi044 ceph-mon[28604]: pgmap v889: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:57:10.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:09 smithi060 ceph-mon[31721]: pgmap v889: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:57:10.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:09 smithi160 ceph-mon[32531]: pgmap v889: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:57:12.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:11 smithi044 ceph-mon[28604]: pgmap v890: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:12.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:11 smithi060 ceph-mon[31721]: pgmap v890: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:12.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:11 smithi160 ceph-mon[32531]: pgmap v890: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:14.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:13 smithi044 ceph-mon[28604]: pgmap v891: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:57:14.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:13 smithi060 ceph-mon[31721]: pgmap v891: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:57:14.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:13 smithi160 ceph-mon[32531]: pgmap v891: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:57:16.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:15 smithi044 ceph-mon[28604]: pgmap v892: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:16.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:15 smithi060 ceph-mon[31721]: pgmap v892: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:16.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:15 smithi160 ceph-mon[32531]: pgmap v892: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:18.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:17 smithi044 ceph-mon[28604]: pgmap v893: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:18.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:17 smithi060 ceph-mon[31721]: pgmap v893: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:18.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:17 smithi160 ceph-mon[32531]: pgmap v893: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:20.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:19 smithi044 ceph-mon[28604]: pgmap v894: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:57:20.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:19 smithi060 ceph-mon[31721]: pgmap v894: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:57:20.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:19 smithi160 ceph-mon[32531]: pgmap v894: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:57:22.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:21 smithi044 ceph-mon[28604]: pgmap v895: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:22.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:21 smithi060 ceph-mon[31721]: pgmap v895: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:22.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:21 smithi160 ceph-mon[32531]: pgmap v895: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:24.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:23 smithi044 ceph-mon[28604]: pgmap v896: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:57:24.004 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:23 smithi060 ceph-mon[31721]: pgmap v896: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:57:24.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:23 smithi160 ceph-mon[32531]: pgmap v896: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:57:26.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:25 smithi044 ceph-mon[28604]: pgmap v897: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:26.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:25 smithi060 ceph-mon[31721]: pgmap v897: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:26.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:25 smithi160 ceph-mon[32531]: pgmap v897: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:28.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:27 smithi044 ceph-mon[28604]: pgmap v898: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:28.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:27 smithi060 ceph-mon[31721]: pgmap v898: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:28.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:27 smithi160 ceph-mon[32531]: pgmap v898: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:30.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:29 smithi044 ceph-mon[28604]: pgmap v899: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:57:30.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:29 smithi060 ceph-mon[31721]: pgmap v899: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:57:30.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:29 smithi160 ceph-mon[32531]: pgmap v899: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:57:32.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:31 smithi044 ceph-mon[28604]: pgmap v900: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:32.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:31 smithi060 ceph-mon[31721]: pgmap v900: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:32.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:31 smithi160 ceph-mon[32531]: pgmap v900: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:34.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:33 smithi044 ceph-mon[28604]: pgmap v901: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:57:34.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:33 smithi060 ceph-mon[31721]: pgmap v901: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:57:34.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:33 smithi160 ceph-mon[32531]: pgmap v901: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:57:36.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:35 smithi044 ceph-mon[28604]: pgmap v902: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:36.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:35 smithi060 ceph-mon[31721]: pgmap v902: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:36.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:35 smithi160 ceph-mon[32531]: pgmap v902: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:38.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:37 smithi044 ceph-mon[28604]: pgmap v903: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:38.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:37 smithi060 ceph-mon[31721]: pgmap v903: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:38.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:37 smithi160 ceph-mon[32531]: pgmap v903: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:40.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:39 smithi044 ceph-mon[28604]: pgmap v904: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:57:40.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:39 smithi060 ceph-mon[31721]: pgmap v904: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:57:40.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:39 smithi160 ceph-mon[32531]: pgmap v904: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:57:41.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:57:41.552+0000 7fc45e000640 1 -- 172.21.15.44:0/3783513548 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7fc440006150 con 0x7fc468108e60 2024-05-03T22:57:41.554 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T22:57:41.553+0000 7fc45f400640 1 -- 172.21.15.44:0/3783513548 <== mon.0 v2:172.21.15.44:3300/0 11 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7fc4580b5070 con 0x7fc468108e60 2024-05-03T22:57:42.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:41 smithi044 ceph-mon[28604]: pgmap v905: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:42.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:41 smithi060 ceph-mon[31721]: pgmap v905: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:42.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:41 smithi160 ceph-mon[32531]: pgmap v905: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:44.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:43 smithi044 ceph-mon[28604]: pgmap v906: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:57:44.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:43 smithi060 ceph-mon[31721]: pgmap v906: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:57:44.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:43 smithi160 ceph-mon[32531]: pgmap v906: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:57:46.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:45 smithi044 ceph-mon[28604]: pgmap v907: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:46.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:45 smithi060 ceph-mon[31721]: pgmap v907: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:46.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:45 smithi160 ceph-mon[32531]: pgmap v907: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:48.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:47 smithi044 ceph-mon[28604]: pgmap v908: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:48.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:47 smithi060 ceph-mon[31721]: pgmap v908: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:48.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:47 smithi160 ceph-mon[32531]: pgmap v908: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:50.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:49 smithi044 ceph-mon[28604]: pgmap v909: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:57:50.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:49 smithi060 ceph-mon[31721]: pgmap v909: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:57:50.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:49 smithi160 ceph-mon[32531]: pgmap v909: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:57:51.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:50 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:57:51.004 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:50 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:57:51.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:50 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:57:52.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:51 smithi044 ceph-mon[28604]: pgmap v910: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:52.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:51 smithi060 ceph-mon[31721]: pgmap v910: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:52.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:51 smithi160 ceph-mon[32531]: pgmap v910: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:53.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:52 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:57:53.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:52 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:57:53.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:52 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:57:53.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:52 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:57:53.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:52 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:57:53.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:52 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:57:53.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:52 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:57:53.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:52 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:57:53.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:52 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:57:53.907 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:53 smithi060 ceph-mon[31721]: pgmap v911: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:57:53.917 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:53 smithi160 ceph-mon[32531]: pgmap v911: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:57:54.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:53 smithi044 ceph-mon[28604]: pgmap v911: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:57:56.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:55 smithi044 ceph-mon[28604]: pgmap v912: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:56.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:55 smithi060 ceph-mon[31721]: pgmap v912: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:56.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:55 smithi160 ceph-mon[32531]: pgmap v912: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:58.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:57 smithi044 ceph-mon[28604]: pgmap v913: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:58.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:57 smithi060 ceph-mon[31721]: pgmap v913: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:57:58.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:57 smithi160 ceph-mon[32531]: pgmap v913: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:00.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:57:59 smithi044 ceph-mon[28604]: pgmap v914: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:58:00.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:57:59 smithi060 ceph-mon[31721]: pgmap v914: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:58:00.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:57:59 smithi160 ceph-mon[32531]: pgmap v914: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:58:02.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:01 smithi044 ceph-mon[28604]: pgmap v915: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:02.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:01 smithi060 ceph-mon[31721]: pgmap v915: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:02.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:01 smithi160 ceph-mon[32531]: pgmap v915: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:04.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:03 smithi044 ceph-mon[28604]: pgmap v916: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:58:04.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:03 smithi060 ceph-mon[31721]: pgmap v916: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:58:04.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:03 smithi160 ceph-mon[32531]: pgmap v916: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:58:06.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:05 smithi044 ceph-mon[28604]: pgmap v917: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:06.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:05 smithi060 ceph-mon[31721]: pgmap v917: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:06.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:05 smithi160 ceph-mon[32531]: pgmap v917: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:08.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:07 smithi044 ceph-mon[28604]: pgmap v918: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:08.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:07 smithi060 ceph-mon[31721]: pgmap v918: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:08.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:07 smithi160 ceph-mon[32531]: pgmap v918: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:10.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:09 smithi044 ceph-mon[28604]: pgmap v919: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:58:10.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:09 smithi060 ceph-mon[31721]: pgmap v919: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:58:10.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:09 smithi160 ceph-mon[32531]: pgmap v919: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:58:12.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:11 smithi044 ceph-mon[28604]: pgmap v920: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:12.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:11 smithi060 ceph-mon[31721]: pgmap v920: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:12.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:11 smithi160 ceph-mon[32531]: pgmap v920: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:14.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:13 smithi044 ceph-mon[28604]: pgmap v921: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:58:14.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:13 smithi060 ceph-mon[31721]: pgmap v921: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:58:14.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:13 smithi160 ceph-mon[32531]: pgmap v921: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:58:16.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:15 smithi044 ceph-mon[28604]: pgmap v922: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:16.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:15 smithi060 ceph-mon[31721]: pgmap v922: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:16.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:15 smithi160 ceph-mon[32531]: pgmap v922: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:18.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:17 smithi044 ceph-mon[28604]: pgmap v923: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:58:18.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:17 smithi060 ceph-mon[31721]: pgmap v923: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:58:18.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:17 smithi160 ceph-mon[32531]: pgmap v923: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:58:20.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:19 smithi044 ceph-mon[28604]: pgmap v924: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:58:20.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:19 smithi060 ceph-mon[31721]: pgmap v924: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:58:20.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:19 smithi160 ceph-mon[32531]: pgmap v924: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:58:22.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:21 smithi044 ceph-mon[28604]: pgmap v925: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:58:22.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:21 smithi060 ceph-mon[31721]: pgmap v925: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:58:22.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:21 smithi160 ceph-mon[32531]: pgmap v925: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-03T22:58:24.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:23 smithi044 ceph-mon[28604]: pgmap v926: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:58:24.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:23 smithi060 ceph-mon[31721]: pgmap v926: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:58:24.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:23 smithi160 ceph-mon[32531]: pgmap v926: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:58:27.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:26 smithi044 ceph-mon[28604]: pgmap v927: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:27.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:26 smithi060 ceph-mon[31721]: pgmap v927: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:27.017 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:26 smithi160 ceph-mon[32531]: pgmap v927: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:29.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:28 smithi044 ceph-mon[28604]: pgmap v928: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:29.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:28 smithi060 ceph-mon[31721]: pgmap v928: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:29.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:28 smithi160 ceph-mon[32531]: pgmap v928: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:31.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:30 smithi044 ceph-mon[28604]: pgmap v929: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:58:31.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:30 smithi060 ceph-mon[31721]: pgmap v929: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:58:31.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:30 smithi160 ceph-mon[32531]: pgmap v929: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:58:33.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:32 smithi044 ceph-mon[28604]: pgmap v930: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:33.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:32 smithi060 ceph-mon[31721]: pgmap v930: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:33.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:32 smithi160 ceph-mon[32531]: pgmap v930: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:35.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:34 smithi044 ceph-mon[28604]: pgmap v931: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:58:35.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:34 smithi060 ceph-mon[31721]: pgmap v931: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:58:35.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:34 smithi160 ceph-mon[32531]: pgmap v931: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:58:37.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:36 smithi044 ceph-mon[28604]: pgmap v932: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:37.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:36 smithi060 ceph-mon[31721]: pgmap v932: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:37.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:36 smithi160 ceph-mon[32531]: pgmap v932: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:39.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:38 smithi044 ceph-mon[28604]: pgmap v933: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:39.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:38 smithi060 ceph-mon[31721]: pgmap v933: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:39.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:38 smithi160 ceph-mon[32531]: pgmap v933: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:41.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:40 smithi044 ceph-mon[28604]: pgmap v934: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:58:41.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:40 smithi060 ceph-mon[31721]: pgmap v934: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:58:41.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:40 smithi160 ceph-mon[32531]: pgmap v934: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:58:43.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:42 smithi044 ceph-mon[28604]: pgmap v935: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:43.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:42 smithi060 ceph-mon[31721]: pgmap v935: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:43.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:42 smithi160 ceph-mon[32531]: pgmap v935: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:58:45.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:44 smithi044 ceph-mon[28604]: pgmap v936: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-03T22:58:45.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:44 smithi060 ceph-mon[31721]: pgmap v936: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-03T22:58:45.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:44 smithi160 ceph-mon[32531]: pgmap v936: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-03T22:58:47.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:46 smithi044 ceph-mon[28604]: pgmap v937: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:58:47.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:46 smithi060 ceph-mon[31721]: pgmap v937: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:58:47.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:46 smithi160 ceph-mon[32531]: pgmap v937: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T22:58:49.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:48 smithi044 ceph-mon[28604]: pgmap v938: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-05-03T22:58:49.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:48 smithi060 ceph-mon[31721]: pgmap v938: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-05-03T22:58:49.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:48 smithi160 ceph-mon[32531]: pgmap v938: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-05-03T22:58:51.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:50 smithi044 ceph-mon[28604]: pgmap v939: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-05-03T22:58:51.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:50 smithi060 ceph-mon[31721]: pgmap v939: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-05-03T22:58:51.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:50 smithi160 ceph-mon[32531]: pgmap v939: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s 2024-05-03T22:58:53.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:52 smithi044 ceph-mon[28604]: pgmap v940: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-05-03T22:58:53.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:52 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:58:53.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:52 smithi060 ceph-mon[31721]: pgmap v940: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-05-03T22:58:53.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:52 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:58:53.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:52 smithi160 ceph-mon[32531]: pgmap v940: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s 2024-05-03T22:58:53.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:52 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:58:55.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:54 smithi044 ceph-mon[28604]: pgmap v941: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-03T22:58:55.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:54 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:54 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:54 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:54 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:54 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:54 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:54 smithi044 ceph-mon[28604]: Adjusting osd_memory_target on smithi060 to 177.5M 2024-05-03T22:58:55.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:54 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:54 smithi044 ceph-mon[28604]: Unable to set osd_memory_target on smithi060 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-05-03T22:58:55.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:54 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:54 smithi044 ceph-mon[28604]: Adjusting osd_memory_target on smithi044 to 177.5M 2024-05-03T22:58:55.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:54 smithi044 ceph-mon[28604]: Unable to set osd_memory_target on smithi044 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-05-03T22:58:55.003 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:54 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:58:55.004 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:54 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:58:55.004 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:54 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:58:55.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:54 smithi060 ceph-mon[31721]: pgmap v941: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-03T22:58:55.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:54 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:54 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:54 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:54 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:54 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:54 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:54 smithi060 ceph-mon[31721]: Adjusting osd_memory_target on smithi060 to 177.5M 2024-05-03T22:58:55.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:54 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:54 smithi060 ceph-mon[31721]: Unable to set osd_memory_target on smithi060 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-05-03T22:58:55.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:54 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:54 smithi060 ceph-mon[31721]: Adjusting osd_memory_target on smithi044 to 177.5M 2024-05-03T22:58:55.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:54 smithi060 ceph-mon[31721]: Unable to set osd_memory_target on smithi044 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-05-03T22:58:55.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:54 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:58:55.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:54 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:58:55.006 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:54 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:58:55.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:54 smithi160 ceph-mon[32531]: pgmap v941: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-03T22:58:55.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:54 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:54 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:54 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:54 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:54 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:54 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:54 smithi160 ceph-mon[32531]: Adjusting osd_memory_target on smithi060 to 177.5M 2024-05-03T22:58:55.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:54 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:54 smithi160 ceph-mon[32531]: Unable to set osd_memory_target on smithi060 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-05-03T22:58:55.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:54 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:58:55.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:54 smithi160 ceph-mon[32531]: Adjusting osd_memory_target on smithi044 to 177.5M 2024-05-03T22:58:55.017 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:54 smithi160 ceph-mon[32531]: Unable to set osd_memory_target on smithi044 to 186173030: error parsing value: Value '186173030' is below minimum 939524096 2024-05-03T22:58:55.017 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:54 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:58:55.017 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:54 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:58:55.017 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:54 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:58:57.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:56 smithi044 ceph-mon[28604]: pgmap v942: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:58:57.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:56 smithi060 ceph-mon[31721]: pgmap v942: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:58:57.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:56 smithi160 ceph-mon[32531]: pgmap v942: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:58:59.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:58:58 smithi044 ceph-mon[28604]: pgmap v943: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:58:59.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:58:58 smithi060 ceph-mon[31721]: pgmap v943: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:58:59.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:58:58 smithi160 ceph-mon[32531]: pgmap v943: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:59:01.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:00 smithi044 ceph-mon[28604]: pgmap v944: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:59:01.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:00 smithi060 ceph-mon[31721]: pgmap v944: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:59:01.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:00 smithi160 ceph-mon[32531]: pgmap v944: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:59:03.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:02 smithi044 ceph-mon[28604]: pgmap v945: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:03.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:02 smithi060 ceph-mon[31721]: pgmap v945: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:03.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:02 smithi160 ceph-mon[32531]: pgmap v945: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:05.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:04 smithi044 ceph-mon[28604]: pgmap v946: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:59:05.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:04 smithi060 ceph-mon[31721]: pgmap v946: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:59:05.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:04 smithi160 ceph-mon[32531]: pgmap v946: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:59:07.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:06 smithi044 ceph-mon[28604]: pgmap v947: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:07.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:06 smithi060 ceph-mon[31721]: pgmap v947: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:07.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:06 smithi160 ceph-mon[32531]: pgmap v947: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:09.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:08 smithi044 ceph-mon[28604]: pgmap v948: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:09.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:08 smithi060 ceph-mon[31721]: pgmap v948: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:09.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:08 smithi160 ceph-mon[32531]: pgmap v948: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:11.001 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:10 smithi044 ceph-mon[28604]: pgmap v949: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:59:11.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:10 smithi060 ceph-mon[31721]: pgmap v949: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:59:11.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:10 smithi160 ceph-mon[32531]: pgmap v949: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:59:13.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:12 smithi060 ceph-mon[31721]: pgmap v950: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:13.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:12 smithi160 ceph-mon[32531]: pgmap v950: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:13.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:12 smithi044 ceph-mon[28604]: pgmap v950: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:15.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:14 smithi160 ceph-mon[32531]: pgmap v951: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:59:15.056 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:14 smithi044 ceph-mon[28604]: pgmap v951: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:59:15.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:14 smithi060 ceph-mon[31721]: pgmap v951: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:59:17.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:16 smithi044 ceph-mon[28604]: pgmap v952: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:17.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:16 smithi060 ceph-mon[31721]: pgmap v952: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:17.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:16 smithi160 ceph-mon[32531]: pgmap v952: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:19.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:18 smithi044 ceph-mon[28604]: pgmap v953: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:19.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:18 smithi060 ceph-mon[31721]: pgmap v953: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:19.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:18 smithi160 ceph-mon[32531]: pgmap v953: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:21.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:20 smithi044 ceph-mon[28604]: pgmap v954: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:59:21.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:20 smithi060 ceph-mon[31721]: pgmap v954: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:59:21.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:20 smithi160 ceph-mon[32531]: pgmap v954: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:59:23.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:22 smithi044 ceph-mon[28604]: pgmap v955: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:23.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:22 smithi060 ceph-mon[31721]: pgmap v955: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:23.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:22 smithi160 ceph-mon[32531]: pgmap v955: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:25.058 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:24 smithi060 ceph-mon[31721]: pgmap v956: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:59:25.068 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:24 smithi160 ceph-mon[32531]: pgmap v956: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:59:25.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:24 smithi044 ceph-mon[28604]: pgmap v956: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:59:27.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:26 smithi044 ceph-mon[28604]: pgmap v957: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:27.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:26 smithi060 ceph-mon[31721]: pgmap v957: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:27.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:26 smithi160 ceph-mon[32531]: pgmap v957: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:29.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:28 smithi044 ceph-mon[28604]: pgmap v958: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:29.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:28 smithi060 ceph-mon[31721]: pgmap v958: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:29.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:28 smithi160 ceph-mon[32531]: pgmap v958: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:31.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:30 smithi044 ceph-mon[28604]: pgmap v959: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:59:31.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:30 smithi060 ceph-mon[31721]: pgmap v959: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:59:31.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:30 smithi160 ceph-mon[32531]: pgmap v959: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T22:59:33.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:32 smithi044 ceph-mon[28604]: pgmap v960: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:33.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:32 smithi060 ceph-mon[31721]: pgmap v960: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:33.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:32 smithi160 ceph-mon[32531]: pgmap v960: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:35.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:34 smithi044 ceph-mon[28604]: pgmap v961: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:59:35.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:34 smithi060 ceph-mon[31721]: pgmap v961: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:59:35.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:34 smithi160 ceph-mon[32531]: pgmap v961: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:59:37.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:36 smithi044 ceph-mon[28604]: pgmap v962: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:37.258 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:36 smithi060 ceph-mon[31721]: pgmap v962: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:37.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:36 smithi160 ceph-mon[32531]: pgmap v962: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:39.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:38 smithi044 ceph-mon[28604]: pgmap v963: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:39.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:38 smithi060 ceph-mon[31721]: pgmap v963: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:39.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:38 smithi160 ceph-mon[32531]: pgmap v963: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:41.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:40 smithi044 ceph-mon[28604]: pgmap v964: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:59:41.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:40 smithi060 ceph-mon[31721]: pgmap v964: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:59:41.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:40 smithi160 ceph-mon[32531]: pgmap v964: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:59:43.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:42 smithi044 ceph-mon[28604]: pgmap v965: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:59:43.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:42 smithi060 ceph-mon[31721]: pgmap v965: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:59:43.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:42 smithi160 ceph-mon[32531]: pgmap v965: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-03T22:59:45.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:44 smithi044 ceph-mon[28604]: pgmap v966: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T22:59:45.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:44 smithi060 ceph-mon[31721]: pgmap v966: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T22:59:45.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:44 smithi160 ceph-mon[32531]: pgmap v966: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-03T22:59:47.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:46 smithi044 ceph-mon[28604]: pgmap v967: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:59:47.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:46 smithi060 ceph-mon[31721]: pgmap v967: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:59:47.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:46 smithi160 ceph-mon[32531]: pgmap v967: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:59:49.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:48 smithi044 ceph-mon[28604]: pgmap v968: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:59:49.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:48 smithi060 ceph-mon[31721]: pgmap v968: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:59:49.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:48 smithi160 ceph-mon[32531]: pgmap v968: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-03T22:59:51.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:50 smithi044 ceph-mon[28604]: pgmap v969: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:59:51.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:50 smithi060 ceph-mon[31721]: pgmap v969: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:59:51.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:50 smithi160 ceph-mon[32531]: pgmap v969: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-05-03T22:59:53.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:52 smithi044 ceph-mon[28604]: pgmap v970: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:53.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:52 smithi060 ceph-mon[31721]: pgmap v970: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:53.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:52 smithi160 ceph-mon[32531]: pgmap v970: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:55.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:54 smithi044 ceph-mon[28604]: pgmap v971: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:59:55.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:54 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:59:55.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:54 smithi060 ceph-mon[31721]: pgmap v971: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:59:55.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:54 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:59:55.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:54 smithi160 ceph-mon[32531]: pgmap v971: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T22:59:55.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:54 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T22:59:56.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:55 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:59:56.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:55 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:59:56.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:55 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:59:56.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:55 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:59:56.253 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:55 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:59:56.253 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:55 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:59:56.253 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:55 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:59:56.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:55 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:59:56.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:55 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:59:56.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:55 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:59:56.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:55 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:59:56.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:55 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:59:56.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:55 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:59:56.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:55 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:59:56.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:55 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:59:56.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:55 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:59:56.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:55 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:59:56.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:55 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-03T22:59:56.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:55 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T22:59:56.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:55 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T22:59:56.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:55 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T22:59:57.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:56 smithi044 ceph-mon[28604]: pgmap v972: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:57.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:56 smithi044 ceph-mon[28604]: Adjusting osd_memory_target on smithi160 to 176.4M 2024-05-03T22:59:57.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:56 smithi044 ceph-mon[28604]: Unable to set osd_memory_target on smithi160 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-03T22:59:57.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:56 smithi060 ceph-mon[31721]: pgmap v972: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:57.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:56 smithi060 ceph-mon[31721]: Adjusting osd_memory_target on smithi160 to 176.4M 2024-05-03T22:59:57.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:56 smithi060 ceph-mon[31721]: Unable to set osd_memory_target on smithi160 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-03T22:59:57.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:56 smithi160 ceph-mon[32531]: pgmap v972: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:57.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:56 smithi160 ceph-mon[32531]: Adjusting osd_memory_target on smithi160 to 176.4M 2024-05-03T22:59:57.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:56 smithi160 ceph-mon[32531]: Unable to set osd_memory_target on smithi160 to 185064857: error parsing value: Value '185064857' is below minimum 939524096 2024-05-03T22:59:59.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 22:59:58 smithi044 ceph-mon[28604]: pgmap v973: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:59.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 22:59:58 smithi060 ceph-mon[31721]: pgmap v973: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T22:59:59.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 22:59:58 smithi160 ceph-mon[32531]: pgmap v973: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:01.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:00 smithi044 ceph-mon[28604]: pgmap v974: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:00:01.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:00 smithi044 ceph-mon[28604]: overall HEALTH_OK 2024-05-03T23:00:01.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:00 smithi060 ceph-mon[31721]: pgmap v974: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:00:01.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:00 smithi060 ceph-mon[31721]: overall HEALTH_OK 2024-05-03T23:00:01.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:00 smithi160 ceph-mon[32531]: pgmap v974: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:00:01.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:00 smithi160 ceph-mon[32531]: overall HEALTH_OK 2024-05-03T23:00:03.254 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:02 smithi044 ceph-mon[28604]: pgmap v975: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:03.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:02 smithi060 ceph-mon[31721]: pgmap v975: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:03.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:02 smithi160 ceph-mon[32531]: pgmap v975: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:05.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:04 smithi044 ceph-mon[28604]: pgmap v976: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T23:00:05.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:04 smithi060 ceph-mon[31721]: pgmap v976: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T23:00:05.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:04 smithi160 ceph-mon[32531]: pgmap v976: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T23:00:07.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:06 smithi044 ceph-mon[28604]: pgmap v977: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:07.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:06 smithi060 ceph-mon[31721]: pgmap v977: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:07.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:06 smithi160 ceph-mon[32531]: pgmap v977: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:09.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:08 smithi044 ceph-mon[28604]: pgmap v978: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:09.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:08 smithi060 ceph-mon[31721]: pgmap v978: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:09.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:08 smithi160 ceph-mon[32531]: pgmap v978: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:11.251 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:10 smithi044 ceph-mon[28604]: pgmap v979: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:00:11.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:10 smithi060 ceph-mon[31721]: pgmap v979: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:00:11.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:10 smithi160 ceph-mon[32531]: pgmap v979: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:00:13.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:12 smithi044 ceph-mon[28604]: pgmap v980: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:13.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:12 smithi060 ceph-mon[31721]: pgmap v980: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:13.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:12 smithi160 ceph-mon[32531]: pgmap v980: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:15.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:14 smithi044 ceph-mon[28604]: pgmap v981: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T23:00:15.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:14 smithi060 ceph-mon[31721]: pgmap v981: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T23:00:15.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:14 smithi160 ceph-mon[32531]: pgmap v981: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T23:00:17.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:16 smithi044 ceph-mon[28604]: pgmap v982: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:17.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:16 smithi060 ceph-mon[31721]: pgmap v982: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:17.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:16 smithi160 ceph-mon[32531]: pgmap v982: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:19.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:18 smithi044 ceph-mon[28604]: pgmap v983: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:19.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:18 smithi060 ceph-mon[31721]: pgmap v983: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:19.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:18 smithi160 ceph-mon[32531]: pgmap v983: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:21.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:20 smithi044 ceph-mon[28604]: pgmap v984: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:00:21.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:20 smithi060 ceph-mon[31721]: pgmap v984: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:00:21.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:20 smithi160 ceph-mon[32531]: pgmap v984: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:00:23.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:23 smithi044 ceph-mon[28604]: pgmap v985: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:23.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:23 smithi160 ceph-mon[32531]: pgmap v985: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:23.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:23 smithi060 ceph-mon[31721]: pgmap v985: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:25.308 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:25 smithi060 ceph-mon[31721]: pgmap v986: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T23:00:25.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:25 smithi044 ceph-mon[28604]: pgmap v986: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T23:00:25.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:25 smithi160 ceph-mon[32531]: pgmap v986: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T23:00:27.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:27 smithi044 ceph-mon[28604]: pgmap v987: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:27.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:27 smithi060 ceph-mon[31721]: pgmap v987: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:27.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:27 smithi160 ceph-mon[32531]: pgmap v987: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:29.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:29 smithi044 ceph-mon[28604]: pgmap v988: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:29.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:29 smithi060 ceph-mon[31721]: pgmap v988: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:29.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:29 smithi160 ceph-mon[32531]: pgmap v988: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:31.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:31 smithi044 ceph-mon[28604]: pgmap v989: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:00:31.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:31 smithi060 ceph-mon[31721]: pgmap v989: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:00:31.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:31 smithi160 ceph-mon[32531]: pgmap v989: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:00:33.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:33 smithi044 ceph-mon[28604]: pgmap v990: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:33.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:33 smithi060 ceph-mon[31721]: pgmap v990: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:33.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:33 smithi160 ceph-mon[32531]: pgmap v990: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:35.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:35 smithi044 ceph-mon[28604]: pgmap v991: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T23:00:35.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:35 smithi060 ceph-mon[31721]: pgmap v991: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T23:00:35.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:35 smithi160 ceph-mon[32531]: pgmap v991: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T23:00:37.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:37 smithi044 ceph-mon[28604]: pgmap v992: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:37.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:37 smithi060 ceph-mon[31721]: pgmap v992: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:37.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:37 smithi160 ceph-mon[32531]: pgmap v992: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:39.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:39 smithi044 ceph-mon[28604]: pgmap v993: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:39.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:39 smithi060 ceph-mon[31721]: pgmap v993: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:39.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:39 smithi160 ceph-mon[32531]: pgmap v993: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:41.458 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:41.457+0000 7fc45d400640 1 -- 172.21.15.44:0/3783513548 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc44c0b2870 msgr2=0x7fc44c0b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).tick idle (900015997) for more than 900000000 us, fault. 2024-05-03T23:00:41.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:41.457+0000 7fc45d400640 1 --2- 172.21.15.44:0/3783513548 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc44c0b2870 0x7fc44c0b4d30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc45000a300 tx=0x7fc45000a290 comp rx=0 tx=0).stop 2024-05-03T23:00:41.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:41.457+0000 7fc45f400640 1 -- 172.21.15.44:0/3783513548 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc44c0b2870 msgr2=0x7fc44c0b4d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-05-03T23:00:41.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:41.457+0000 7fc45f400640 1 --2- 172.21.15.44:0/3783513548 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc44c0b2870 0x7fc44c0b4d30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:41.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:41.457+0000 7fc45f400640 1 --2- 172.21.15.44:0/3783513548 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc44c0be120 0x7fc44c0c0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:00:41.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:41.457+0000 7fc45f400640 1 -- 172.21.15.44:0/3783513548 --> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7fc45803be50 con 0x7fc44c0be120 2024-05-03T23:00:41.459 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:41.458+0000 7fc45d400640 1 --2- 172.21.15.44:0/3783513548 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc44c0be120 0x7fc44c0c0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:00:41.461 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:41.459+0000 7fc45d400640 1 --2- 172.21.15.44:0/3783513548 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc44c0be120 0x7fc44c0c0510 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc44c0b5330 tx=0x7fc450014000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:00:41.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:41 smithi044 ceph-mon[28604]: pgmap v994: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:00:41.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:41 smithi060 ceph-mon[31721]: pgmap v994: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:00:41.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:41 smithi160 ceph-mon[32531]: pgmap v994: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:00:41.584 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:41.582+0000 7fc45e000640 1 -- 172.21.15.44:0/3783513548 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- auth(proto 2 165 bytes epoch 0) -- 0x7fc4400060e0 con 0x7fc468108e60 2024-05-03T23:00:41.585 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:41.583+0000 7fc45f400640 1 -- 172.21.15.44:0/3783513548 <== mon.0 v2:172.21.15.44:3300/0 12 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (secure 0 0 0) 0x7fc4400060e0 con 0x7fc468108e60 2024-05-03T23:00:41.690 INFO:teuthology.orchestra.run.smithi044.stderr:Error ETIMEDOUT: Connection timed out. Please check the client's permission and connection. 2024-05-03T23:00:41.707 DEBUG:teuthology.orchestra.run:got remote process result: 110 2024-05-03T23:00:41.708 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/exec.py", line 66, in task remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 110: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10'" 2024-05-03T23:00:41.950 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=1d9f0eb034594bc096272b8509e3618f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/exec.py", line 66, in task remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi044 with status 110: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10'" 2024-05-03T23:00:41.952 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-03T23:00:41.963 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-03T23:00:41.963 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T23:00:41.963 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-03T23:00:42.027 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T23:00:42.027 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-03T23:00:42.082 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-03T23:00:42.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:42 smithi044 ceph-mon[28604]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T23:00:42.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:42 smithi060 ceph-mon[31721]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T23:00:42.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:42 smithi160 ceph-mon[32531]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-03T23:00:42.535 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T23:00:43.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:43 smithi044 ceph-mon[28604]: pgmap v995: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:43.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:43 smithi060 ceph-mon[31721]: pgmap v995: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:43.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:43 smithi160 ceph-mon[32531]: pgmap v995: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:45.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.040+0000 7fc205200700 1 -- 172.21.15.44:0/2253557431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc200109ad0 msgr2=0x7fc200109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:00:45.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.040+0000 7fc205200700 1 --2- 172.21.15.44:0/2253557431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc200109ad0 0x7fc200109f50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009990 tx=0x7fc1ec009ca0 comp rx=0 tx=0).stop 2024-05-03T23:00:45.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.040+0000 7fc205200700 1 -- 172.21.15.44:0/2253557431 shutdown_connections 2024-05-03T23:00:45.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.040+0000 7fc205200700 1 --2- 172.21.15.44:0/2253557431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc20010a490 0x7fc2001169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:45.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.040+0000 7fc205200700 1 --2- 172.21.15.44:0/2253557431 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc20010fb60 0x7fc20010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:45.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.040+0000 7fc205200700 1 --2- 172.21.15.44:0/2253557431 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc200109ad0 0x7fc200109f50 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:45.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.040+0000 7fc205200700 1 -- 172.21.15.44:0/2253557431 >> 172.21.15.44:0/2253557431 conn(0x7fc200076c70 msgr2=0x7fc2001082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:00:45.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.041+0000 7fc205200700 1 -- 172.21.15.44:0/2253557431 shutdown_connections 2024-05-03T23:00:45.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.041+0000 7fc205200700 1 -- 172.21.15.44:0/2253557431 wait complete. 2024-05-03T23:00:45.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.042+0000 7fc205200700 1 Processor -- start 2024-05-03T23:00:45.046 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.042+0000 7fc205200700 1 -- start start 2024-05-03T23:00:45.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.042+0000 7fc205200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc200109ad0 0x7fc2001a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:00:45.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.042+0000 7fc205200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc20010a490 0x7fc2001a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:00:45.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.042+0000 7fc205200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc20010fb60 0x7fc2001a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:00:45.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.042+0000 7fc205200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc200119e80 con 0x7fc200109ad0 2024-05-03T23:00:45.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.042+0000 7fc205200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc200119d00 con 0x7fc20010a490 2024-05-03T23:00:45.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.042+0000 7fc205200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc20011a000 con 0x7fc20010fb60 2024-05-03T23:00:45.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.042+0000 7fc1fde00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc200109ad0 0x7fc2001a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:00:45.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.043+0000 7fc1fde00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc200109ad0 0x7fc2001a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47230/0 (socket says 172.21.15.44:47230) 2024-05-03T23:00:45.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.043+0000 7fc1fde00700 1 -- 172.21.15.44:0/910764615 learned_addr learned my addr 172.21.15.44:0/910764615 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T23:00:45.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.043+0000 7fc1fd400700 1 --2- 172.21.15.44:0/910764615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc20010a490 0x7fc2001a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:00:45.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.043+0000 7fc1fe800700 1 --2- 172.21.15.44:0/910764615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc20010fb60 0x7fc2001a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:00:45.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.043+0000 7fc1fde00700 1 -- 172.21.15.44:0/910764615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc20010fb60 msgr2=0x7fc2001a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:00:45.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.043+0000 7fc1fde00700 1 --2- 172.21.15.44:0/910764615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc20010fb60 0x7fc2001a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:45.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.043+0000 7fc1fde00700 1 -- 172.21.15.44:0/910764615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc20010a490 msgr2=0x7fc2001a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:00:45.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.043+0000 7fc1fde00700 1 --2- 172.21.15.44:0/910764615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc20010a490 0x7fc2001a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:45.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.043+0000 7fc1fde00700 1 -- 172.21.15.44:0/910764615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2001a5320 con 0x7fc200109ad0 2024-05-03T23:00:45.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.044+0000 7fc1fde00700 1 --2- 172.21.15.44:0/910764615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc200109ad0 0x7fc2001a0310 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc1f000b530 tx=0x7fc1f000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:00:45.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.044+0000 7fc1f6a00700 1 -- 172.21.15.44:0/910764615 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0015020 con 0x7fc200109ad0 2024-05-03T23:00:45.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.044+0000 7fc205200700 1 -- 172.21.15.44:0/910764615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2001a5610 con 0x7fc200109ad0 2024-05-03T23:00:45.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.044+0000 7fc1f6a00700 1 -- 172.21.15.44:0/910764615 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fc1f0011d00 con 0x7fc200109ad0 2024-05-03T23:00:45.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.044+0000 7fc1f6a00700 1 -- 172.21.15.44:0/910764615 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0010dd0 con 0x7fc200109ad0 2024-05-03T23:00:45.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.044+0000 7fc205200700 1 -- 172.21.15.44:0/910764615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2001ace90 con 0x7fc200109ad0 2024-05-03T23:00:45.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.045+0000 7fc205200700 1 -- 172.21.15.44:0/910764615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc20006a190 con 0x7fc200109ad0 2024-05-03T23:00:45.050 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.048+0000 7fc1f6a00700 1 -- 172.21.15.44:0/910764615 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc1f0018020 con 0x7fc200109ad0 2024-05-03T23:00:45.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.050+0000 7fc1f6a00700 1 --2- 172.21.15.44:0/910764615 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc1e40b2990 0x7fc1e40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:00:45.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.050+0000 7fc1f6a00700 1 -- 172.21.15.44:0/910764615 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fc1f00e1f00 con 0x7fc200109ad0 2024-05-03T23:00:45.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.050+0000 7fc1fd400700 1 --2- 172.21.15.44:0/910764615 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc1e40b2990 0x7fc1e40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:00:45.052 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.051+0000 7fc1fd400700 1 --2- 172.21.15.44:0/910764615 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc1e40b2990 0x7fc1e40b4e50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00b5c0 tx=0x7fc1ec005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:00:45.057 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.055+0000 7fc1f6a00700 1 -- 172.21.15.44:0/910764615 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc1f001f020 con 0x7fc200109ad0 2024-05-03T23:00:45.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:45 smithi044 ceph-mon[28604]: pgmap v996: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T23:00:45.316 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.314+0000 7fc205200700 1 -- 172.21.15.44:0/910764615 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc20002e510 con 0x7fc200109ad0 2024-05-03T23:00:45.317 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.315+0000 7fc1f6a00700 1 -- 172.21.15.44:0/910764615 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+590 (secure 0 0 0) 0x7fc1f00a9760 con 0x7fc200109ad0 2024-05-03T23:00:45.317 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6800/1309719283 2024-05-04T22:30:08.766919+0000 2024-05-03T23:00:45.317 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/2661810503 2024-05-04T22:30:08.766919+0000 2024-05-03T23:00:45.318 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/3426728285 2024-05-04T22:29:32.846592+0000 2024-05-03T23:00:45.318 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/4246410673 2024-05-04T22:29:32.846592+0000 2024-05-03T23:00:45.318 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6801/1309719283 2024-05-04T22:30:08.766919+0000 2024-05-03T23:00:45.318 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/2328074241 2024-05-04T22:29:32.846592+0000 2024-05-03T23:00:45.318 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/1738155460 2024-05-04T22:30:08.766919+0000 2024-05-03T23:00:45.318 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/3461866265 2024-05-04T22:30:08.766919+0000 2024-05-03T23:00:45.318 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6800/950841500 2024-05-04T22:29:32.846592+0000 2024-05-03T23:00:45.318 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6801/950841500 2024-05-04T22:29:32.846592+0000 2024-05-03T23:00:45.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.318+0000 7fc205200700 1 -- 172.21.15.44:0/910764615 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc1e40b2990 msgr2=0x7fc1e40b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:00:45.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.318+0000 7fc205200700 1 --2- 172.21.15.44:0/910764615 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc1e40b2990 0x7fc1e40b4e50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec00b5c0 tx=0x7fc1ec005fd0 comp rx=0 tx=0).stop 2024-05-03T23:00:45.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.318+0000 7fc205200700 1 -- 172.21.15.44:0/910764615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc200109ad0 msgr2=0x7fc2001a0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:00:45.320 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.318+0000 7fc205200700 1 --2- 172.21.15.44:0/910764615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc200109ad0 0x7fc2001a0310 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc1f000b530 tx=0x7fc1f000b8f0 comp rx=0 tx=0).stop 2024-05-03T23:00:45.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.318+0000 7fc205200700 1 -- 172.21.15.44:0/910764615 shutdown_connections 2024-05-03T23:00:45.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.318+0000 7fc205200700 1 --2- 172.21.15.44:0/910764615 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc1e40b2990 0x7fc1e40b4e50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:45.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.318+0000 7fc205200700 1 --2- 172.21.15.44:0/910764615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc20010fb60 0x7fc2001a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:45.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.318+0000 7fc205200700 1 --2- 172.21.15.44:0/910764615 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc200109ad0 0x7fc2001a0310 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:45.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.318+0000 7fc205200700 1 --2- 172.21.15.44:0/910764615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc20010a490 0x7fc2001a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:45.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.318+0000 7fc205200700 1 -- 172.21.15.44:0/910764615 >> 172.21.15.44:0/910764615 conn(0x7fc200076c70 msgr2=0x7fc200077190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:00:45.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.319+0000 7fc205200700 1 -- 172.21.15.44:0/910764615 shutdown_connections 2024-05-03T23:00:45.321 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:45.319+0000 7fc205200700 1 -- 172.21.15.44:0/910764615 wait complete. 2024-05-03T23:00:45.322 INFO:teuthology.orchestra.run.smithi044.stderr:listed 10 entries 2024-05-03T23:00:45.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:45 smithi060 ceph-mon[31721]: pgmap v996: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T23:00:45.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:45 smithi160 ceph-mon[32531]: pgmap v996: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-03T23:00:46.081 DEBUG:teuthology.orchestra.run.smithi044:> set -ex 2024-05-03T23:00:46.082 DEBUG:teuthology.orchestra.run.smithi044:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-03T23:00:46.134 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-03T23:00:46.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:46 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/910764615' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T23:00:46.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:46 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/910764615' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T23:00:46.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:46 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/910764615' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T23:00:46.615 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T23:00:47.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:47 smithi044 ceph-mon[28604]: pgmap v997: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:47.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:47 smithi060 ceph-mon[31721]: pgmap v997: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:47.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:47 smithi160 ceph-mon[32531]: pgmap v997: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.027+0000 7f37cee00700 1 -- 172.21.15.44:0/1144657753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37c8106080 msgr2=0x7f37c8112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:00:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.027+0000 7f37cee00700 1 --2- 172.21.15.44:0/1144657753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37c8106080 0x7f37c8112590 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f37c000b0a0 tx=0x7f37c000b3b0 comp rx=0 tx=0).stop 2024-05-03T23:00:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.028+0000 7f37cee00700 1 -- 172.21.15.44:0/1144657753 shutdown_connections 2024-05-03T23:00:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.028+0000 7f37cee00700 1 --2- 172.21.15.44:0/1144657753 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37c8106080 0x7f37c8112590 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:49.030 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.028+0000 7f37cee00700 1 --2- 172.21.15.44:0/1144657753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37c810b6c0 0x7f37c810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:49.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.028+0000 7f37cee00700 1 --2- 172.21.15.44:0/1144657753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37c81056c0 0x7f37c8105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:49.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.028+0000 7f37cee00700 1 -- 172.21.15.44:0/1144657753 >> 172.21.15.44:0/1144657753 conn(0x7f37c8101170 msgr2=0x7f37c8103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:00:49.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.028+0000 7f37cee00700 1 -- 172.21.15.44:0/1144657753 shutdown_connections 2024-05-03T23:00:49.031 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.028+0000 7f37cee00700 1 -- 172.21.15.44:0/1144657753 wait complete. 2024-05-03T23:00:49.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.029+0000 7f37cee00700 1 Processor -- start 2024-05-03T23:00:49.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.029+0000 7f37cee00700 1 -- start start 2024-05-03T23:00:49.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.030+0000 7f37cee00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37c81056c0 0x7f37c819be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:00:49.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.030+0000 7f37cee00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37c8106080 0x7f37c819c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:00:49.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.030+0000 7f37cee00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37c810b6c0 0x7f37c81a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:00:49.033 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.030+0000 7f37cee00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f37c8115a10 con 0x7f37c81056c0 2024-05-03T23:00:49.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.030+0000 7f37cee00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f37c8115890 con 0x7f37c810b6c0 2024-05-03T23:00:49.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.030+0000 7f37cee00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f37c8115b90 con 0x7f37c8106080 2024-05-03T23:00:49.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.030+0000 7f37c7e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37c81056c0 0x7f37c819be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:00:49.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.030+0000 7f37c7e00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37c81056c0 0x7f37c819be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:47238/0 (socket says 172.21.15.44:47238) 2024-05-03T23:00:49.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.030+0000 7f37c7e00700 1 -- 172.21.15.44:0/4132892265 learned_addr learned my addr 172.21.15.44:0/4132892265 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T23:00:49.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.030+0000 7f37bfe00700 1 --2- 172.21.15.44:0/4132892265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37c8106080 0x7f37c819c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:00:49.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.030+0000 7f37cce00700 1 --2- 172.21.15.44:0/4132892265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37c810b6c0 0x7f37c81a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:00:49.034 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.031+0000 7f37c7e00700 1 -- 172.21.15.44:0/4132892265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37c8106080 msgr2=0x7f37c819c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:00:49.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.031+0000 7f37c7e00700 1 --2- 172.21.15.44:0/4132892265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37c8106080 0x7f37c819c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:49.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.031+0000 7f37c7e00700 1 -- 172.21.15.44:0/4132892265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37c810b6c0 msgr2=0x7f37c81a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:00:49.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.031+0000 7f37c7e00700 1 --2- 172.21.15.44:0/4132892265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37c810b6c0 0x7f37c81a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:49.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.031+0000 7f37c7e00700 1 -- 172.21.15.44:0/4132892265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c81a0e30 con 0x7f37c81056c0 2024-05-03T23:00:49.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.031+0000 7f37c7e00700 1 --2- 172.21.15.44:0/4132892265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37c81056c0 0x7f37c819be20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f37b800d950 tx=0x7f37b800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:00:49.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.031+0000 7f37c5600700 1 -- 172.21.15.44:0/4132892265 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b8016070 con 0x7f37c81056c0 2024-05-03T23:00:49.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.031+0000 7f37c5600700 1 -- 172.21.15.44:0/4132892265 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f37b8009b40 con 0x7f37c81056c0 2024-05-03T23:00:49.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.031+0000 7f37cee00700 1 -- 172.21.15.44:0/4132892265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37c81a1120 con 0x7f37c81056c0 2024-05-03T23:00:49.035 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.032+0000 7f37c5600700 1 -- 172.21.15.44:0/4132892265 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b800f620 con 0x7f37c81056c0 2024-05-03T23:00:49.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.032+0000 7f37cee00700 1 -- 172.21.15.44:0/4132892265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37c81a89a0 con 0x7f37c81056c0 2024-05-03T23:00:49.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.033+0000 7f37cee00700 1 -- 172.21.15.44:0/4132892265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37c806a190 con 0x7f37c81056c0 2024-05-03T23:00:49.036 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.035+0000 7f37c5600700 1 -- 172.21.15.44:0/4132892265 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f37b8019070 con 0x7f37c81056c0 2024-05-03T23:00:49.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.037+0000 7f37c5600700 1 --2- 172.21.15.44:0/4132892265 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f37ac0b2910 0x7f37ac0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:00:49.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.037+0000 7f37c5600700 1 -- 172.21.15.44:0/4132892265 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f37b80e2780 con 0x7f37c81056c0 2024-05-03T23:00:49.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.037+0000 7f37bfe00700 1 --2- 172.21.15.44:0/4132892265 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f37ac0b2910 0x7f37ac0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:00:49.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.038+0000 7f37bfe00700 1 --2- 172.21.15.44:0/4132892265 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f37ac0b2910 0x7f37ac0b4dd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f37b0005950 tx=0x7f37b00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:00:49.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.041+0000 7f37c5600700 1 -- 172.21.15.44:0/4132892265 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f37b80a9ed0 con 0x7f37c81056c0 2024-05-03T23:00:49.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.306+0000 7f37cee00700 1 -- 172.21.15.44:0/4132892265 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f37c802e510 con 0x7f37c81056c0 2024-05-03T23:00:49.308 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.307+0000 7f37c5600700 1 -- 172.21.15.44:0/4132892265 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+590 (secure 0 0 0) 0x7f37b80a97d0 con 0x7f37c81056c0 2024-05-03T23:00:49.309 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6800/1309719283 2024-05-04T22:30:08.766919+0000 2024-05-03T23:00:49.309 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/2661810503 2024-05-04T22:30:08.766919+0000 2024-05-03T23:00:49.309 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/3426728285 2024-05-04T22:29:32.846592+0000 2024-05-03T23:00:49.309 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/4246410673 2024-05-04T22:29:32.846592+0000 2024-05-03T23:00:49.309 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6801/1309719283 2024-05-04T22:30:08.766919+0000 2024-05-03T23:00:49.309 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/2328074241 2024-05-04T22:29:32.846592+0000 2024-05-03T23:00:49.309 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/1738155460 2024-05-04T22:30:08.766919+0000 2024-05-03T23:00:49.310 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:0/3461866265 2024-05-04T22:30:08.766919+0000 2024-05-03T23:00:49.310 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6800/950841500 2024-05-04T22:29:32.846592+0000 2024-05-03T23:00:49.310 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44:6801/950841500 2024-05-04T22:29:32.846592+0000 2024-05-03T23:00:49.311 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.310+0000 7f37cee00700 1 -- 172.21.15.44:0/4132892265 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f37ac0b2910 msgr2=0x7f37ac0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:00:49.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.310+0000 7f37cee00700 1 --2- 172.21.15.44:0/4132892265 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f37ac0b2910 0x7f37ac0b4dd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f37b0005950 tx=0x7f37b00058e0 comp rx=0 tx=0).stop 2024-05-03T23:00:49.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.310+0000 7f37cee00700 1 -- 172.21.15.44:0/4132892265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37c81056c0 msgr2=0x7f37c819be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:00:49.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.310+0000 7f37cee00700 1 --2- 172.21.15.44:0/4132892265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37c81056c0 0x7f37c819be20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f37b800d950 tx=0x7f37b800dd10 comp rx=0 tx=0).stop 2024-05-03T23:00:49.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.310+0000 7f37cee00700 1 -- 172.21.15.44:0/4132892265 shutdown_connections 2024-05-03T23:00:49.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.310+0000 7f37cee00700 1 --2- 172.21.15.44:0/4132892265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37c810b6c0 0x7f37c81a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:49.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.310+0000 7f37cee00700 1 --2- 172.21.15.44:0/4132892265 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f37c81056c0 0x7f37c819be20 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:49.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.310+0000 7f37cee00700 1 --2- 172.21.15.44:0/4132892265 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f37ac0b2910 0x7f37ac0b4dd0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:49.312 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.310+0000 7f37cee00700 1 --2- 172.21.15.44:0/4132892265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37c8106080 0x7f37c819c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:49.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.310+0000 7f37cee00700 1 -- 172.21.15.44:0/4132892265 >> 172.21.15.44:0/4132892265 conn(0x7f37c8101170 msgr2=0x7f37c8101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:00:49.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.310+0000 7f37cee00700 1 -- 172.21.15.44:0/4132892265 shutdown_connections 2024-05-03T23:00:49.313 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:49.310+0000 7f37cee00700 1 -- 172.21.15.44:0/4132892265 wait complete. 2024-05-03T23:00:49.313 INFO:teuthology.orchestra.run.smithi044.stderr:listed 10 entries 2024-05-03T23:00:49.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:49 smithi044 ceph-mon[28604]: pgmap v998: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:49.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:49 smithi060 ceph-mon[31721]: pgmap v998: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:49.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:49 smithi160 ceph-mon[32531]: pgmap v998: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:00:50.123 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi044.front.sepia.ceph.com... 2024-05-03T23:00:50.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T23:00:50.123 DEBUG:teuthology.orchestra.run.smithi044:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-03T23:00:50.215 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi044.stderr:ceph-fuse[89181]: fuse finished with error 0 and tester_r 0 2024-05-03T23:00:50.223 INFO:teuthology.orchestra.run:waiting for 300 2024-05-03T23:00:50.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:50 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/4132892265' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T23:00:50.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:50 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/4132892265' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T23:00:50.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:50 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/4132892265' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-03T23:00:51.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:51 smithi044 ceph-mon[28604]: pgmap v999: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:00:51.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:51 smithi060 ceph-mon[31721]: pgmap v999: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:00:51.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:51 smithi160 ceph-mon[32531]: pgmap v999: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:00:53.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:53 smithi044 ceph-mon[28604]: pgmap v1000: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-03T23:00:53.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:53 smithi060 ceph-mon[31721]: pgmap v1000: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-03T23:00:53.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:53 smithi160 ceph-mon[32531]: pgmap v1000: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 9 op/s 2024-05-03T23:00:55.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:55 smithi044 ceph-mon[28604]: pgmap v1001: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-03T23:00:55.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:55 smithi060 ceph-mon[31721]: pgmap v1001: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-03T23:00:55.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:55 smithi160 ceph-mon[32531]: pgmap v1001: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-03T23:00:56.326 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi044.front.sepia.ceph.com 2024-05-03T23:00:56.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T23:00:56.327 DEBUG:teuthology.orchestra.run.smithi044:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-03T23:00:56.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T23:00:56.390 DEBUG:teuthology.orchestra.run.smithi044:> ip netns list 2024-05-03T23:00:56.433 INFO:teuthology.orchestra.run.smithi044.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-03T23:00:56.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T23:00:56.434 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-03T23:00:56.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-03T23:00:56.543 DEBUG:teuthology.orchestra.run.smithi044:> sudo ip link delete ceph-brx 2024-05-03T23:00:56.652 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-03T23:00:56.661 INFO:tasks.cephadm:Teardown begin 2024-05-03T23:00:56.662 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-03T23:00:56.662 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T23:00:57.087 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T23:00:57.465 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:57 smithi044 ceph-mon[28604]: pgmap v1002: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-03T23:00:57.466 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T23:00:57.466 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:57.466 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:57 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:57.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:57 smithi060 ceph-mon[31721]: pgmap v1002: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-03T23:00:57.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T23:00:57.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:57.505 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:57 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:57.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:57 smithi160 ceph-mon[32531]: pgmap v1002: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-03T23:00:57.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-03T23:00:57.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:57.515 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:57 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:59.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.336+0000 7fa86b200700 1 -- 172.21.15.44:0/4016754897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa86c076190 msgr2=0x7fa86c10f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:00:59.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.336+0000 7fa86b200700 1 --2- 172.21.15.44:0/4016754897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa86c076190 0x7fa86c10f730 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa858009990 tx=0x7fa858009ca0 comp rx=0 tx=0).stop 2024-05-03T23:00:59.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.336+0000 7fa86b200700 1 -- 172.21.15.44:0/4016754897 shutdown_connections 2024-05-03T23:00:59.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.336+0000 7fa86b200700 1 --2- 172.21.15.44:0/4016754897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa86c10fc70 0x7fa86c112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:59.338 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.336+0000 7fa86b200700 1 --2- 172.21.15.44:0/4016754897 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa86c075870 0x7fa86c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:59.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.336+0000 7fa86b200700 1 --2- 172.21.15.44:0/4016754897 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa86c076190 0x7fa86c10f730 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:59.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.336+0000 7fa86b200700 1 -- 172.21.15.44:0/4016754897 >> 172.21.15.44:0/4016754897 conn(0x7fa86c0fef20 msgr2=0x7fa86c101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:00:59.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.336+0000 7fa86b200700 1 -- 172.21.15.44:0/4016754897 shutdown_connections 2024-05-03T23:00:59.339 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.336+0000 7fa86b200700 1 -- 172.21.15.44:0/4016754897 wait complete. 2024-05-03T23:00:59.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.338+0000 7fa86b200700 1 Processor -- start 2024-05-03T23:00:59.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.338+0000 7fa86b200700 1 -- start start 2024-05-03T23:00:59.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.338+0000 7fa86b200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa86c075870 0x7fa86c1a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:00:59.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.338+0000 7fa86b200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa86c076190 0x7fa86c1a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:00:59.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.338+0000 7fa86b200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa86c10fc70 0x7fa86c19baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:00:59.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.338+0000 7fa86b200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa86c115930 con 0x7fa86c076190 2024-05-03T23:00:59.340 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.338+0000 7fa86b200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa86c1157b0 con 0x7fa86c075870 2024-05-03T23:00:59.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.338+0000 7fa86b200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa86c115ab0 con 0x7fa86c10fc70 2024-05-03T23:00:59.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.339+0000 7fa869400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa86c076190 0x7fa86c1a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:00:59.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.339+0000 7fa869400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa86c076190 0x7fa86c1a1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:51166/0 (socket says 172.21.15.44:51166) 2024-05-03T23:00:59.341 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.339+0000 7fa869400700 1 -- 172.21.15.44:0/2322116871 learned_addr learned my addr 172.21.15.44:0/2322116871 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T23:00:59.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.339+0000 7fa869e00700 1 --2- 172.21.15.44:0/2322116871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa86c075870 0x7fa86c1a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:00:59.345 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.339+0000 7fa86a800700 1 --2- 172.21.15.44:0/2322116871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa86c10fc70 0x7fa86c19baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:00:59.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.339+0000 7fa869400700 1 -- 172.21.15.44:0/2322116871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa86c10fc70 msgr2=0x7fa86c19baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:00:59.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.339+0000 7fa869400700 1 --2- 172.21.15.44:0/2322116871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa86c10fc70 0x7fa86c19baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:59.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.339+0000 7fa869400700 1 -- 172.21.15.44:0/2322116871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa86c075870 msgr2=0x7fa86c1a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:00:59.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.339+0000 7fa869400700 1 --2- 172.21.15.44:0/2322116871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa86c075870 0x7fa86c1a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:59.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.339+0000 7fa869400700 1 -- 172.21.15.44:0/2322116871 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa86c19c250 con 0x7fa86c076190 2024-05-03T23:00:59.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.340+0000 7fa869400700 1 --2- 172.21.15.44:0/2322116871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa86c076190 0x7fa86c1a1e70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa8580057c0 tx=0x7fa8580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:00:59.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.340+0000 7fa862a00700 1 -- 172.21.15.44:0/2322116871 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858027070 con 0x7fa86c076190 2024-05-03T23:00:59.346 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.340+0000 7fa862a00700 1 -- 172.21.15.44:0/2322116871 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fa858004070 con 0x7fa86c076190 2024-05-03T23:00:59.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.340+0000 7fa862a00700 1 -- 172.21.15.44:0/2322116871 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858022dd0 con 0x7fa86c076190 2024-05-03T23:00:59.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.340+0000 7fa86b200700 1 -- 172.21.15.44:0/2322116871 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa86c19c4e0 con 0x7fa86c076190 2024-05-03T23:00:59.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.340+0000 7fa86b200700 1 -- 172.21.15.44:0/2322116871 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa86c1a8800 con 0x7fa86c076190 2024-05-03T23:00:59.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.341+0000 7fa86b200700 1 -- 172.21.15.44:0/2322116871 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa86c06a190 con 0x7fa86c076190 2024-05-03T23:00:59.347 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.344+0000 7fa862a00700 1 -- 172.21.15.44:0/2322116871 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa85802a070 con 0x7fa86c076190 2024-05-03T23:00:59.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.347+0000 7fa862a00700 1 --2- 172.21.15.44:0/2322116871 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa8500b2910 0x7fa8500b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:00:59.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.347+0000 7fa862a00700 1 -- 172.21.15.44:0/2322116871 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fa8580e3b70 con 0x7fa86c076190 2024-05-03T23:00:59.348 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.347+0000 7fa869e00700 1 --2- 172.21.15.44:0/2322116871 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa8500b2910 0x7fa8500b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:00:59.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.348+0000 7fa869e00700 1 --2- 172.21.15.44:0/2322116871 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa8500b2910 0x7fa8500b4dd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa85c005ea0 tx=0x7fa85c005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:00:59.351 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.350+0000 7fa862a00700 1 -- 172.21.15.44:0/2322116871 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa858031020 con 0x7fa86c076190 2024-05-03T23:00:59.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:59 smithi044 ceph-mon[28604]: pgmap v1003: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-03T23:00:59.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:59 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:59.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:59 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:59.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:59 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:59.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:59 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:59.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:59 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T23:00:59.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:59 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T23:00:59.503 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:00:59 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:59.643 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.641+0000 7fa86b200700 1 -- 172.21.15.44:0/2322116871 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa86c1a89d0 con 0x7fa86c076190 2024-05-03T23:00:59.644 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.643+0000 7fa862a00700 1 -- 172.21.15.44:0/2322116871 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11932 (secure 0 0 0) 0x7fa858013070 con 0x7fa86c076190 2024-05-03T23:00:59.645 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T23:00:59.645 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2550955759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2550955759},{"type":"v1","addr":"172.21.15.44:6835","nonce":2550955759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3118490782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3118490782},{"type":"v1","addr":"172.21.15.44:6837","nonce":3118490782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T22:40:14.758857+0000","modified":"2024-05-03T22:45:40.553496+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34463,"mds_1":34427,"mds_2":34409,"mds_3":34391,"mds_4":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/1408147232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1408147232},{"type":"v1","addr":"172.21.15.44:6839","nonce":1408147232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14607":{"gid":14607,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/4262223160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":4262223160},{"type":"v1","addr":"172.21.15.44:6841","nonce":4262223160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/1332937382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1332937382},{"type":"v1","addr":"172.21.15.160:6835","nonce":1332937382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/3735287805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3735287805},{"type":"v1","addr":"172.21.15.160:6837","nonce":3735287805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.160:6839/861756806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":861756806},{"type":"v1","addr":"172.21.15.160:6839","nonce":861756806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34391":{"gid":34391,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":41,"addr":"172.21.15.60:6833/153110190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":153110190},{"type":"v1","addr":"172.21.15.60:6833","nonce":153110190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.60:6835/3390425489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3390425489},{"type":"v1","addr":"172.21.15.60:6835","nonce":3390425489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.60:6837/3568217572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3568217572},{"type":"v1","addr":"172.21.15.60:6837","nonce":3568217572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.60:6839/2420093605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2420093605},{"type":"v1","addr":"172.21.15.60:6839","nonce":2420093605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34463,"qdb_cluster":[34391,24493,34409,34463,34427]},"id":1}]} 2024-05-03T23:00:59.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.645+0000 7fa86b200700 1 -- 172.21.15.44:0/2322116871 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa8500b2910 msgr2=0x7fa8500b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:00:59.647 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.645+0000 7fa86b200700 1 --2- 172.21.15.44:0/2322116871 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa8500b2910 0x7fa8500b4dd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa85c005ea0 tx=0x7fa85c005e30 comp rx=0 tx=0).stop 2024-05-03T23:00:59.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.645+0000 7fa86b200700 1 -- 172.21.15.44:0/2322116871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa86c076190 msgr2=0x7fa86c1a1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:00:59.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.645+0000 7fa86b200700 1 --2- 172.21.15.44:0/2322116871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa86c076190 0x7fa86c1a1e70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa8580057c0 tx=0x7fa8580057f0 comp rx=0 tx=0).stop 2024-05-03T23:00:59.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.646+0000 7fa86b200700 1 -- 172.21.15.44:0/2322116871 shutdown_connections 2024-05-03T23:00:59.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.646+0000 7fa86b200700 1 --2- 172.21.15.44:0/2322116871 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa8500b2910 0x7fa8500b4dd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:59.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.646+0000 7fa86b200700 1 --2- 172.21.15.44:0/2322116871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa86c10fc70 0x7fa86c19baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:59.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.646+0000 7fa86b200700 1 --2- 172.21.15.44:0/2322116871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa86c075870 0x7fa86c1a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:59.648 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.646+0000 7fa86b200700 1 --2- 172.21.15.44:0/2322116871 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa86c076190 0x7fa86c1a1e70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:00:59.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.646+0000 7fa86b200700 1 -- 172.21.15.44:0/2322116871 >> 172.21.15.44:0/2322116871 conn(0x7fa86c0fef20 msgr2=0x7fa86c111e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:00:59.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.646+0000 7fa86b200700 1 -- 172.21.15.44:0/2322116871 shutdown_connections 2024-05-03T23:00:59.649 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:00:59.646+0000 7fa86b200700 1 -- 172.21.15.44:0/2322116871 wait complete. 2024-05-03T23:00:59.649 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 31 2024-05-03T23:00:59.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:59 smithi060 ceph-mon[31721]: pgmap v1003: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-03T23:00:59.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:59 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:59.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:59 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:59.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:59 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:59.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:59 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:59.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:59 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T23:00:59.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:59 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T23:00:59.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:00:59 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:59.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:59 smithi160 ceph-mon[32531]: pgmap v1003: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-03T23:00:59.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:59 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:59.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:59 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:59.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:59 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:59.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:59 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:00:59.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:59 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-03T23:00:59.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:59 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-03T23:00:59.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:00:59 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' 2024-05-03T23:01:00.667 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:00 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2322116871' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T23:01:00.671 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-03T23:01:00.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:00 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2322116871' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T23:01:00.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:00 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2322116871' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T23:01:01.146 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T23:01:01.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:01 smithi160 ceph-mon[32531]: pgmap v1004: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 13 op/s 2024-05-03T23:01:01.565 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:01 smithi044 ceph-mon[28604]: pgmap v1004: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 13 op/s 2024-05-03T23:01:01.676 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:01 smithi060 ceph-mon[31721]: pgmap v1004: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 13 op/s 2024-05-03T23:01:03.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.380+0000 7fa635200700 1 -- 172.21.15.44:0/1312052538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa630106080 msgr2=0x7fa630112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:03.382 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.380+0000 7fa635200700 1 --2- 172.21.15.44:0/1312052538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa630106080 0x7fa630112590 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa62800b0a0 tx=0x7fa62800b3b0 comp rx=0 tx=0).stop 2024-05-03T23:01:03.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.380+0000 7fa635200700 1 -- 172.21.15.44:0/1312052538 shutdown_connections 2024-05-03T23:01:03.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.380+0000 7fa635200700 1 --2- 172.21.15.44:0/1312052538 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa630106080 0x7fa630112590 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:03.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.380+0000 7fa635200700 1 --2- 172.21.15.44:0/1312052538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa63010b6c0 0x7fa63010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:03.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.380+0000 7fa635200700 1 --2- 172.21.15.44:0/1312052538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6301056c0 0x7fa630105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:03.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.380+0000 7fa635200700 1 -- 172.21.15.44:0/1312052538 >> 172.21.15.44:0/1312052538 conn(0x7fa6301011b0 msgr2=0x7fa6301035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:01:03.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.380+0000 7fa635200700 1 -- 172.21.15.44:0/1312052538 shutdown_connections 2024-05-03T23:01:03.383 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.380+0000 7fa635200700 1 -- 172.21.15.44:0/1312052538 wait complete. 2024-05-03T23:01:03.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.381+0000 7fa635200700 1 Processor -- start 2024-05-03T23:01:03.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.382+0000 7fa635200700 1 -- start start 2024-05-03T23:01:03.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.382+0000 7fa635200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6301056c0 0x7fa63019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:03.385 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.382+0000 7fa635200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa630106080 0x7fa63019c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:03.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.382+0000 7fa635200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa63010b6c0 0x7fa6301a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:03.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.382+0000 7fa635200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa6301159e0 con 0x7fa6301056c0 2024-05-03T23:01:03.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.382+0000 7fa635200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa630115860 con 0x7fa63010b6c0 2024-05-03T23:01:03.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.382+0000 7fa635200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa630115b60 con 0x7fa630106080 2024-05-03T23:01:03.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.382+0000 7fa62de00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6301056c0 0x7fa63019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:03.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.382+0000 7fa62de00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6301056c0 0x7fa63019be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43348/0 (socket says 172.21.15.44:43348) 2024-05-03T23:01:03.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.382+0000 7fa62de00700 1 -- 172.21.15.44:0/812223949 learned_addr learned my addr 172.21.15.44:0/812223949 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T23:01:03.386 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.383+0000 7fa62d400700 1 --2- 172.21.15.44:0/812223949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa630106080 0x7fa63019c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:03.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.383+0000 7fa62e800700 1 --2- 172.21.15.44:0/812223949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa63010b6c0 0x7fa6301a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:03.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.383+0000 7fa62de00700 1 -- 172.21.15.44:0/812223949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa630106080 msgr2=0x7fa63019c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:03.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.383+0000 7fa62de00700 1 --2- 172.21.15.44:0/812223949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa630106080 0x7fa63019c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:03.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.383+0000 7fa62de00700 1 -- 172.21.15.44:0/812223949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa63010b6c0 msgr2=0x7fa6301a06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:03.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.383+0000 7fa62de00700 1 --2- 172.21.15.44:0/812223949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa63010b6c0 0x7fa6301a06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:03.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.383+0000 7fa62de00700 1 -- 172.21.15.44:0/812223949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6301a0e20 con 0x7fa6301056c0 2024-05-03T23:01:03.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.383+0000 7fa62de00700 1 --2- 172.21.15.44:0/812223949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6301056c0 0x7fa63019be10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa62000d950 tx=0x7fa62000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:01:03.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.384+0000 7fa626a00700 1 -- 172.21.15.44:0/812223949 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa620016070 con 0x7fa6301056c0 2024-05-03T23:01:03.387 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.384+0000 7fa635200700 1 -- 172.21.15.44:0/812223949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6301a1110 con 0x7fa6301056c0 2024-05-03T23:01:03.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.384+0000 7fa626a00700 1 -- 172.21.15.44:0/812223949 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fa620009b40 con 0x7fa6301056c0 2024-05-03T23:01:03.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.384+0000 7fa626a00700 1 -- 172.21.15.44:0/812223949 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62000f620 con 0x7fa6301056c0 2024-05-03T23:01:03.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.384+0000 7fa635200700 1 -- 172.21.15.44:0/812223949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6301a8990 con 0x7fa6301056c0 2024-05-03T23:01:03.388 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.385+0000 7fa635200700 1 -- 172.21.15.44:0/812223949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa63006a190 con 0x7fa6301056c0 2024-05-03T23:01:03.389 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.387+0000 7fa626a00700 1 -- 172.21.15.44:0/812223949 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa620019070 con 0x7fa6301056c0 2024-05-03T23:01:03.390 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.389+0000 7fa626a00700 1 --2- 172.21.15.44:0/812223949 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa6140b2990 0x7fa6140b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:03.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.389+0000 7fa626a00700 1 -- 172.21.15.44:0/812223949 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fa6200e2730 con 0x7fa6301056c0 2024-05-03T23:01:03.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.389+0000 7fa62d400700 1 --2- 172.21.15.44:0/812223949 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa6140b2990 0x7fa6140b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:03.391 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.390+0000 7fa62d400700 1 --2- 172.21.15.44:0/812223949 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa6140b2990 0x7fa6140b4e50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa61c005950 tx=0x7fa61c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:01:03.393 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.392+0000 7fa626a00700 1 -- 172.21.15.44:0/812223949 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa6200a9e80 con 0x7fa6301056c0 2024-05-03T23:01:03.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:03 smithi044 ceph-mon[28604]: pgmap v1005: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-03T23:01:03.688 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.687+0000 7fa635200700 1 -- 172.21.15.44:0/812223949 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa63019d1a0 con 0x7fa6301056c0 2024-05-03T23:01:03.691 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.689+0000 7fa626a00700 1 -- 172.21.15.44:0/812223949 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11932 (secure 0 0 0) 0x7fa63019d1a0 con 0x7fa6301056c0 2024-05-03T23:01:03.691 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T23:01:03.691 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14532,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6835/2550955759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6834","nonce":2550955759},{"type":"v1","addr":"172.21.15.44:6835","nonce":2550955759}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14544,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.44:6837/3118490782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6836","nonce":3118490782},{"type":"v1","addr":"172.21.15.44:6837","nonce":3118490782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-03T22:40:14.758857+0000","modified":"2024-05-03T22:45:40.553496+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34463,"mds_1":34427,"mds_2":34409,"mds_3":34391,"mds_4":24493},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14595":{"gid":14595,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6839/1408147232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6838","nonce":1408147232},{"type":"v1","addr":"172.21.15.44:6839","nonce":1408147232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14607":{"gid":14607,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.44:6841/4262223160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6840","nonce":4262223160},{"type":"v1","addr":"172.21.15.44:6841","nonce":4262223160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24424":{"gid":24424,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6833/2022701378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":2022701378},{"type":"v1","addr":"172.21.15.160:6833","nonce":2022701378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/1332937382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1332937382},{"type":"v1","addr":"172.21.15.160:6835","nonce":1332937382}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24478":{"gid":24478,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6837/3735287805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":3735287805},{"type":"v1","addr":"172.21.15.160:6837","nonce":3735287805}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24493":{"gid":24493,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":33,"addr":"172.21.15.160:6839/861756806","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":861756806},{"type":"v1","addr":"172.21.15.160:6839","nonce":861756806}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34391":{"gid":34391,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":41,"addr":"172.21.15.60:6833/153110190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":153110190},{"type":"v1","addr":"172.21.15.60:6833","nonce":153110190}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":36,"addr":"172.21.15.60:6835/3390425489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3390425489},{"type":"v1","addr":"172.21.15.60:6835","nonce":3390425489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34427":{"gid":34427,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":33,"addr":"172.21.15.60:6837/3568217572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3568217572},{"type":"v1","addr":"172.21.15.60:6837","nonce":3568217572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.60:6839/2420093605","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":2420093605},{"type":"v1","addr":"172.21.15.60:6839","nonce":2420093605}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34463,"qdb_cluster":[34391,24493,34409,34463,34427]},"id":1}]} 2024-05-03T23:01:03.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.692+0000 7fa635200700 1 -- 172.21.15.44:0/812223949 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa6140b2990 msgr2=0x7fa6140b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:03.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.692+0000 7fa635200700 1 --2- 172.21.15.44:0/812223949 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa6140b2990 0x7fa6140b4e50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa61c005950 tx=0x7fa61c0058e0 comp rx=0 tx=0).stop 2024-05-03T23:01:03.693 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.692+0000 7fa635200700 1 -- 172.21.15.44:0/812223949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6301056c0 msgr2=0x7fa63019be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:03.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.692+0000 7fa635200700 1 --2- 172.21.15.44:0/812223949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6301056c0 0x7fa63019be10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa62000d950 tx=0x7fa62000dd10 comp rx=0 tx=0).stop 2024-05-03T23:01:03.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.692+0000 7fa635200700 1 -- 172.21.15.44:0/812223949 shutdown_connections 2024-05-03T23:01:03.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.692+0000 7fa635200700 1 --2- 172.21.15.44:0/812223949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa63010b6c0 0x7fa6301a06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:03.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.692+0000 7fa635200700 1 --2- 172.21.15.44:0/812223949 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa6301056c0 0x7fa63019be10 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:03.694 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.692+0000 7fa635200700 1 --2- 172.21.15.44:0/812223949 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa6140b2990 0x7fa6140b4e50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:03.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.692+0000 7fa635200700 1 --2- 172.21.15.44:0/812223949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa630106080 0x7fa63019c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:03.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.692+0000 7fa635200700 1 -- 172.21.15.44:0/812223949 >> 172.21.15.44:0/812223949 conn(0x7fa6301011b0 msgr2=0x7fa6301016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:01:03.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.693+0000 7fa635200700 1 -- 172.21.15.44:0/812223949 shutdown_connections 2024-05-03T23:01:03.695 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:03.693+0000 7fa635200700 1 -- 172.21.15.44:0/812223949 wait complete. 2024-05-03T23:01:03.696 INFO:teuthology.orchestra.run.smithi044.stderr:dumped fsmap epoch 31 2024-05-03T23:01:03.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:03 smithi060 ceph-mon[31721]: pgmap v1005: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-03T23:01:03.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:03 smithi160 ceph-mon[32531]: pgmap v1005: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-03T23:01:04.544 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-03T23:01:04.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:04 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/812223949' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T23:01:04.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:04 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/812223949' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T23:01:04.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:04 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/812223949' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-03T23:01:05.033 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T23:01:05.450 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:05 smithi044 ceph-mon[28604]: pgmap v1006: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-03T23:01:05.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:05 smithi060 ceph-mon[31721]: pgmap v1006: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-03T23:01:05.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:05 smithi160 ceph-mon[32531]: pgmap v1006: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 682 B/s wr, 11 op/s 2024-05-03T23:01:07.349 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.346+0000 7f7c69400700 1 -- 172.21.15.44:0/3138744613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c64105ee0 msgr2=0x7f7c64106370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:07.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.346+0000 7f7c69400700 1 --2- 172.21.15.44:0/3138744613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c64105ee0 0x7f7c64106370 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009990 tx=0x7f7c5c009ca0 comp rx=0 tx=0).stop 2024-05-03T23:01:07.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.346+0000 7f7c69400700 1 -- 172.21.15.44:0/3138744613 shutdown_connections 2024-05-03T23:01:07.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.346+0000 7f7c69400700 1 --2- 172.21.15.44:0/3138744613 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c64105ee0 0x7f7c64106370 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:07.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.346+0000 7f7c69400700 1 --2- 172.21.15.44:0/3138744613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c641083d0 0x7f7c6406b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:07.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.346+0000 7f7c69400700 1 --2- 172.21.15.44:0/3138744613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c6406b6f0 0x7f7c6406bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:07.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.346+0000 7f7c69400700 1 -- 172.21.15.44:0/3138744613 >> 172.21.15.44:0/3138744613 conn(0x7f7c64079350 msgr2=0x7f7c64079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:01:07.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.346+0000 7f7c69400700 1 -- 172.21.15.44:0/3138744613 shutdown_connections 2024-05-03T23:01:07.350 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.346+0000 7f7c69400700 1 -- 172.21.15.44:0/3138744613 wait complete. 2024-05-03T23:01:07.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.347+0000 7f7c69400700 1 Processor -- start 2024-05-03T23:01:07.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.347+0000 7f7c69400700 1 -- start start 2024-05-03T23:01:07.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.348+0000 7f7c69400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c6406b6f0 0x7f7c641a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:07.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.348+0000 7f7c69400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c64105ee0 0x7f7c641a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:07.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.348+0000 7f7c69400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c641083d0 0x7f7c641a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:07.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.348+0000 7f7c69400700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f7c64119da0 con 0x7f7c641083d0 2024-05-03T23:01:07.352 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.348+0000 7f7c69400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7c64119c20 con 0x7f7c6406b6f0 2024-05-03T23:01:07.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.348+0000 7f7c69400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7c64119f20 con 0x7f7c64105ee0 2024-05-03T23:01:07.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.348+0000 7f7c63200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c641083d0 0x7f7c641a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:07.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.348+0000 7f7c63200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c641083d0 0x7f7c641a4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:43362/0 (socket says 172.21.15.44:43362) 2024-05-03T23:01:07.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.348+0000 7f7c63200700 1 -- 172.21.15.44:0/1178855355 learned_addr learned my addr 172.21.15.44:0/1178855355 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T23:01:07.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.348+0000 7f7c59e00700 1 --2- 172.21.15.44:0/1178855355 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c64105ee0 0x7f7c641a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:07.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.348+0000 7f7c62800700 1 --2- 172.21.15.44:0/1178855355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c6406b6f0 0x7f7c641a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:07.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.349+0000 7f7c63200700 1 -- 172.21.15.44:0/1178855355 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c64105ee0 msgr2=0x7f7c641a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:07.353 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.349+0000 7f7c63200700 1 --2- 172.21.15.44:0/1178855355 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c64105ee0 0x7f7c641a0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:07.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.349+0000 7f7c63200700 1 -- 172.21.15.44:0/1178855355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c6406b6f0 msgr2=0x7f7c641a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:07.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.349+0000 7f7c63200700 1 --2- 172.21.15.44:0/1178855355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c6406b6f0 0x7f7c641a0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:07.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.349+0000 7f7c63200700 1 -- 172.21.15.44:0/1178855355 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c641a51f0 con 0x7f7c641083d0 2024-05-03T23:01:07.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.349+0000 7f7c59e00700 1 --2- 172.21.15.44:0/1178855355 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c64105ee0 0x7f7c641a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-03T23:01:07.354 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.349+0000 7f7c63200700 1 --2- 172.21.15.44:0/1178855355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c641083d0 0x7f7c641a4ab0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00b5c0 tx=0x7f7c5c0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:01:07.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.350+0000 7f7c5be00700 1 -- 172.21.15.44:0/1178855355 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c027070 con 0x7f7c641083d0 2024-05-03T23:01:07.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.350+0000 7f7c5be00700 1 -- 172.21.15.44:0/1178855355 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f7c5c003f70 con 0x7f7c641083d0 2024-05-03T23:01:07.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.350+0000 7f7c69400700 1 -- 172.21.15.44:0/1178855355 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c641a5480 con 0x7f7c641083d0 2024-05-03T23:01:07.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.350+0000 7f7c5be00700 1 -- 172.21.15.44:0/1178855355 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c022d30 con 0x7f7c641083d0 2024-05-03T23:01:07.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.350+0000 7f7c69400700 1 -- 172.21.15.44:0/1178855355 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c641acd60 con 0x7f7c641083d0 2024-05-03T23:01:07.355 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.351+0000 7f7c69400700 1 -- 172.21.15.44:0/1178855355 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c6406a190 con 0x7f7c641083d0 2024-05-03T23:01:07.356 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.354+0000 7f7c5be00700 1 -- 172.21.15.44:0/1178855355 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f7c5c02a070 con 0x7f7c641083d0 2024-05-03T23:01:07.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.355+0000 7f7c5be00700 1 --2- 172.21.15.44:0/1178855355 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7c480b2990 0x7f7c480b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:07.357 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.355+0000 7f7c5be00700 1 -- 172.21.15.44:0/1178855355 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7f7c5c0e3b60 con 0x7f7c641083d0 2024-05-03T23:01:07.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.355+0000 7f7c62800700 1 --2- 172.21.15.44:0/1178855355 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7c480b2990 0x7f7c480b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:07.358 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.356+0000 7f7c62800700 1 --2- 172.21.15.44:0/1178855355 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7c480b2990 0x7f7c480b4e50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009550 tx=0x7f7c540091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:01:07.360 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.357+0000 7f7c5be00700 1 -- 172.21.15.44:0/1178855355 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f7c5c031020 con 0x7f7c641083d0 2024-05-03T23:01:07.600 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.598+0000 7f7c69400700 1 -- 172.21.15.44:0/1178855355 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c641acf30 con 0x7f7c641083d0 2024-05-03T23:01:07.603 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.601+0000 7f7c5be00700 1 -- 172.21.15.44:0/1178855355 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24819 (secure 0 0 0) 0x7f7c5c013070 con 0x7f7c641083d0 2024-05-03T23:01:07.604 INFO:teuthology.orchestra.run.smithi044.stdout: 2024-05-03T23:01:07.604 INFO:teuthology.orchestra.run.smithi044.stdout:{"epoch":89,"fsid":"5b0efdca-099c-11ef-bc97-c7b262605968","created":"2024-05-03T22:28:49.471963+0000","modified":"2024-05-03T22:42:11.407700+0000","last_up_change":"2024-05-03T22:38:41.446244+0000","last_in_change":"2024-05-03T22:38:16.952689+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-03T22:33:24.956832+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-03T22:40:05.501996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-03T22:40:09.732161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-03T22:40:23.052845+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"05869397-bdc9-4c38-b1c6-deb466454dd3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6802","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6803","nonce":4219032560}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6804","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6805","nonce":4219032560}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6808","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6809","nonce":4219032560}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6806","nonce":4219032560},{"type":"v1","addr":"172.21.15.44:6807","nonce":4219032560}]},"public_addr":"172.21.15.44:6803/4219032560","cluster_addr":"172.21.15.44:6805/4219032560","heartbeat_back_addr":"172.21.15.44:6809/4219032560","heartbeat_front_addr":"172.21.15.44:6807/4219032560","state":["exists","up"]},{"osd":1,"uuid":"ff61ca27-e36b-41c9-898f-1cd7af1d9db5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6801","nonce":563003638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6803","nonce":563003638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6807","nonce":563003638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":563003638},{"type":"v1","addr":"172.21.15.60:6805","nonce":563003638}]},"public_addr":"172.21.15.60:6801/563003638","cluster_addr":"172.21.15.60:6803/563003638","heartbeat_back_addr":"172.21.15.60:6807/563003638","heartbeat_front_addr":"172.21.15.60:6805/563003638","state":["exists","up"]},{"osd":2,"uuid":"e58f96dc-3486-452e-85a1-847a0e2c523a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6801","nonce":2524540447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6803","nonce":2524540447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6807","nonce":2524540447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2524540447},{"type":"v1","addr":"172.21.15.160:6805","nonce":2524540447}]},"public_addr":"172.21.15.160:6801/2524540447","cluster_addr":"172.21.15.160:6803/2524540447","heartbeat_back_addr":"172.21.15.160:6807/2524540447","heartbeat_front_addr":"172.21.15.160:6805/2524540447","state":["exists","up"]},{"osd":3,"uuid":"75c56c3b-5807-4646-885c-1ef16541ff72","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6810","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6811","nonce":3298926279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6812","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6813","nonce":3298926279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6816","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6817","nonce":3298926279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6814","nonce":3298926279},{"type":"v1","addr":"172.21.15.44:6815","nonce":3298926279}]},"public_addr":"172.21.15.44:6811/3298926279","cluster_addr":"172.21.15.44:6813/3298926279","heartbeat_back_addr":"172.21.15.44:6817/3298926279","heartbeat_front_addr":"172.21.15.44:6815/3298926279","state":["exists","up"]},{"osd":4,"uuid":"a8a322e4-6ca1-4727-8b41-5ff523acc591","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6809","nonce":3794821539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6811","nonce":3794821539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6815","nonce":3794821539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":3794821539},{"type":"v1","addr":"172.21.15.60:6813","nonce":3794821539}]},"public_addr":"172.21.15.60:6809/3794821539","cluster_addr":"172.21.15.60:6811/3794821539","heartbeat_back_addr":"172.21.15.60:6815/3794821539","heartbeat_front_addr":"172.21.15.60:6813/3794821539","state":["exists","up"]},{"osd":5,"uuid":"bc718527-bacd-4d1b-90c6-758cbd859e86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6809","nonce":429142335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6811","nonce":429142335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6815","nonce":429142335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":429142335},{"type":"v1","addr":"172.21.15.160:6813","nonce":429142335}]},"public_addr":"172.21.15.160:6809/429142335","cluster_addr":"172.21.15.160:6811/429142335","heartbeat_back_addr":"172.21.15.160:6815/429142335","heartbeat_front_addr":"172.21.15.160:6813/429142335","state":["exists","up"]},{"osd":6,"uuid":"f95a1d05-a958-4e5c-a90a-6b0c3d9fad43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6818","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6819","nonce":2805326764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6820","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6821","nonce":2805326764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6824","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6825","nonce":2805326764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6822","nonce":2805326764},{"type":"v1","addr":"172.21.15.44:6823","nonce":2805326764}]},"public_addr":"172.21.15.44:6819/2805326764","cluster_addr":"172.21.15.44:6821/2805326764","heartbeat_back_addr":"172.21.15.44:6825/2805326764","heartbeat_front_addr":"172.21.15.44:6823/2805326764","state":["exists","up"]},{"osd":7,"uuid":"a515e4be-c607-4f4a-96bb-c3d395d7ecfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6817","nonce":693512829}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6819","nonce":693512829}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6823","nonce":693512829}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":693512829},{"type":"v1","addr":"172.21.15.60:6821","nonce":693512829}]},"public_addr":"172.21.15.60:6817/693512829","cluster_addr":"172.21.15.60:6819/693512829","heartbeat_back_addr":"172.21.15.60:6823/693512829","heartbeat_front_addr":"172.21.15.60:6821/693512829","state":["exists","up"]},{"osd":8,"uuid":"717aeffb-6c51-4e4e-8344-fba70ac2c295","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6817","nonce":2920554498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6819","nonce":2920554498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6823","nonce":2920554498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2920554498},{"type":"v1","addr":"172.21.15.160:6821","nonce":2920554498}]},"public_addr":"172.21.15.160:6817/2920554498","cluster_addr":"172.21.15.160:6819/2920554498","heartbeat_back_addr":"172.21.15.160:6823/2920554498","heartbeat_front_addr":"172.21.15.160:6821/2920554498","state":["exists","up"]},{"osd":9,"uuid":"ade31284-1246-42c8-9cee-e60dacc58a8a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6826","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6827","nonce":414763386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6828","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6829","nonce":414763386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6832","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6833","nonce":414763386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.44:6830","nonce":414763386},{"type":"v1","addr":"172.21.15.44:6831","nonce":414763386}]},"public_addr":"172.21.15.44:6827/414763386","cluster_addr":"172.21.15.44:6829/414763386","heartbeat_back_addr":"172.21.15.44:6833/414763386","heartbeat_front_addr":"172.21.15.44:6831/414763386","state":["exists","up"]},{"osd":10,"uuid":"e7e677c6-af9b-4b9a-a0d1-7ecd33805cbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6825","nonce":2396062554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6827","nonce":2396062554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6831","nonce":2396062554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":2396062554},{"type":"v1","addr":"172.21.15.60:6829","nonce":2396062554}]},"public_addr":"172.21.15.60:6825/2396062554","cluster_addr":"172.21.15.60:6827/2396062554","heartbeat_back_addr":"172.21.15.60:6831/2396062554","heartbeat_front_addr":"172.21.15.60:6829/2396062554","state":["exists","up"]},{"osd":11,"uuid":"b6951585-9337-4b5a-a691-e765deb4b825","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6825","nonce":1397967755}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6827","nonce":1397967755}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6831","nonce":1397967755}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":1397967755},{"type":"v1","addr":"172.21.15.160:6829","nonce":1397967755}]},"public_addr":"172.21.15.160:6825/1397967755","cluster_addr":"172.21.15.160:6827/1397967755","heartbeat_back_addr":"172.21.15.160:6831/1397967755","heartbeat_front_addr":"172.21.15.160:6829/1397967755","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:15.012060+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:32:48.390669+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:21.227227+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:33:56.388453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:34:31.079377+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:04.912058+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:35:40.941904+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:16.757849+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:36:51.591794+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:37:29.022917+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:05.506391+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-03T22:38:39.793901+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":8,"to":4}]},{"pgid":"2.2","mappings":[{"from":7,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.e","mappings":[{"from":2,"to":1}]},{"pgid":"3.1","mappings":[{"from":4,"to":9}]},{"pgid":"3.18","mappings":[{"from":3,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"3.3a","mappings":[{"from":4,"to":6}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.13","mappings":[{"from":9,"to":8}]},{"pgid":"4.1a","mappings":[{"from":5,"to":10}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.44:6800/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2661810503":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3426728285":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/4246410673":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/1309719283":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/2328074241":"2024-05-04T22:29:32.846592+0000","172.21.15.44:0/1738155460":"2024-05-04T22:30:08.766919+0000","172.21.15.44:0/3461866265":"2024-05-04T22:30:08.766919+0000","172.21.15.44:6800/950841500":"2024-05-04T22:29:32.846592+0000","172.21.15.44:6801/950841500":"2024-05-04T22:29:32.846592+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-03T23:01:07.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.604+0000 7f7c69400700 1 -- 172.21.15.44:0/1178855355 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7c480b2990 msgr2=0x7f7c480b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:07.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.604+0000 7f7c69400700 1 --2- 172.21.15.44:0/1178855355 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7c480b2990 0x7f7c480b4e50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009550 tx=0x7f7c540091b0 comp rx=0 tx=0).stop 2024-05-03T23:01:07.607 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.604+0000 7f7c69400700 1 -- 172.21.15.44:0/1178855355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c641083d0 msgr2=0x7f7c641a4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.604+0000 7f7c69400700 1 --2- 172.21.15.44:0/1178855355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c641083d0 0x7f7c641a4ab0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c00b5c0 tx=0x7f7c5c0057c0 comp rx=0 tx=0).stop 2024-05-03T23:01:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.605+0000 7f7c69400700 1 -- 172.21.15.44:0/1178855355 shutdown_connections 2024-05-03T23:01:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.605+0000 7f7c69400700 1 --2- 172.21.15.44:0/1178855355 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f7c641083d0 0x7f7c641a4ab0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.605+0000 7f7c69400700 1 --2- 172.21.15.44:0/1178855355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c6406b6f0 0x7f7c641a0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:07.608 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.605+0000 7f7c69400700 1 --2- 172.21.15.44:0/1178855355 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f7c480b2990 0x7f7c480b4e50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:07.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.605+0000 7f7c69400700 1 --2- 172.21.15.44:0/1178855355 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c64105ee0 0x7f7c641a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:07.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.605+0000 7f7c69400700 1 -- 172.21.15.44:0/1178855355 >> 172.21.15.44:0/1178855355 conn(0x7f7c64079350 msgr2=0x7f7c64104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:01:07.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.605+0000 7f7c69400700 1 -- 172.21.15.44:0/1178855355 shutdown_connections 2024-05-03T23:01:07.609 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:07.605+0000 7f7c69400700 1 -- 172.21.15.44:0/1178855355 wait complete. 2024-05-03T23:01:07.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:07 smithi044 ceph-mon[28604]: pgmap v1007: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-03T23:01:07.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:07 smithi060 ceph-mon[31721]: pgmap v1007: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-03T23:01:07.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:07 smithi160 ceph-mon[32531]: pgmap v1007: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-05-03T23:01:08.383 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs fail cephfs 2024-05-03T23:01:08.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:08 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/1178855355' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T23:01:08.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:08 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/1178855355' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T23:01:08.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:08 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/1178855355' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-03T23:01:08.849 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T23:01:09.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:09 smithi044 ceph-mon[28604]: pgmap v1008: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:01:09.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:09 smithi060 ceph-mon[31721]: pgmap v1008: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:01:09.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:09 smithi160 ceph-mon[32531]: pgmap v1008: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-03T23:01:11.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.125+0000 7fa392400700 1 -- 172.21.15.44:0/1926070596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa38c1056e0 msgr2=0x7fa38c105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:11.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.125+0000 7fa392400700 1 --2- 172.21.15.44:0/1926070596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa38c1056e0 0x7fa38c105b60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa378009990 tx=0x7fa378009ca0 comp rx=0 tx=0).stop 2024-05-03T23:01:11.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.126+0000 7fa392400700 1 -- 172.21.15.44:0/1926070596 shutdown_connections 2024-05-03T23:01:11.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.126+0000 7fa392400700 1 --2- 172.21.15.44:0/1926070596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa38c1060a0 0x7fa38c1125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:11.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.126+0000 7fa392400700 1 --2- 172.21.15.44:0/1926070596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa38c10b6e0 0x7fa38c10bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:11.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.126+0000 7fa392400700 1 --2- 172.21.15.44:0/1926070596 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa38c1056e0 0x7fa38c105b60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:11.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.126+0000 7fa392400700 1 -- 172.21.15.44:0/1926070596 >> 172.21.15.44:0/1926070596 conn(0x7fa38c1011d0 msgr2=0x7fa38c1035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:01:11.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.126+0000 7fa392400700 1 -- 172.21.15.44:0/1926070596 shutdown_connections 2024-05-03T23:01:11.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.126+0000 7fa392400700 1 -- 172.21.15.44:0/1926070596 wait complete. 2024-05-03T23:01:11.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.127+0000 7fa392400700 1 Processor -- start 2024-05-03T23:01:11.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.127+0000 7fa392400700 1 -- start start 2024-05-03T23:01:11.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.128+0000 7fa392400700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa38c1056e0 0x7fa38c19bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:11.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.128+0000 7fa392400700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa38c1060a0 0x7fa38c19c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:11.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.128+0000 7fa392400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa38c10b6e0 0x7fa38c1a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:11.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.128+0000 7fa392400700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fa38c115a90 con 0x7fa38c10b6e0 2024-05-03T23:01:11.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.128+0000 7fa392400700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa38c115910 con 0x7fa38c1060a0 2024-05-03T23:01:11.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.128+0000 7fa392400700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa38c115c10 con 0x7fa38c1056e0 2024-05-03T23:01:11.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.128+0000 7fa38be00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa38c10b6e0 0x7fa38c1a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:11.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.128+0000 7fa38be00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa38c10b6e0 0x7fa38c1a0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56684/0 (socket says 172.21.15.44:56684) 2024-05-03T23:01:11.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.128+0000 7fa38be00700 1 -- 172.21.15.44:0/3757557444 learned_addr learned my addr 172.21.15.44:0/3757557444 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T23:01:11.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.128+0000 7fa38b400700 1 --2- 172.21.15.44:0/3757557444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa38c1056e0 0x7fa38c19bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:11.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.128+0000 7fa38aa00700 1 --2- 172.21.15.44:0/3757557444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa38c1060a0 0x7fa38c19c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:11.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.128+0000 7fa38be00700 1 -- 172.21.15.44:0/3757557444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa38c1056e0 msgr2=0x7fa38c19bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:11.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.128+0000 7fa38be00700 1 --2- 172.21.15.44:0/3757557444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa38c1056e0 0x7fa38c19bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:11.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.128+0000 7fa38be00700 1 -- 172.21.15.44:0/3757557444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa38c1060a0 msgr2=0x7fa38c19c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:11.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.128+0000 7fa38be00700 1 --2- 172.21.15.44:0/3757557444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa38c1060a0 0x7fa38c19c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:11.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.128+0000 7fa38be00700 1 -- 172.21.15.44:0/3757557444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38c1a0ed0 con 0x7fa38c10b6e0 2024-05-03T23:01:11.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.129+0000 7fa38be00700 1 --2- 172.21.15.44:0/3757557444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa38c10b6e0 0x7fa38c1a0790 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa384007ee0 tx=0x7fa38400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:01:11.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.129+0000 7fa383e00700 1 -- 172.21.15.44:0/3757557444 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38400dbd0 con 0x7fa38c10b6e0 2024-05-03T23:01:11.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.129+0000 7fa383e00700 1 -- 172.21.15.44:0/3757557444 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fa38400dd70 con 0x7fa38c10b6e0 2024-05-03T23:01:11.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.129+0000 7fa392400700 1 -- 172.21.15.44:0/3757557444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa38c1a11c0 con 0x7fa38c10b6e0 2024-05-03T23:01:11.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.129+0000 7fa383e00700 1 -- 172.21.15.44:0/3757557444 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3840133f0 con 0x7fa38c10b6e0 2024-05-03T23:01:11.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.129+0000 7fa392400700 1 -- 172.21.15.44:0/3757557444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa38c1a8a40 con 0x7fa38c10b6e0 2024-05-03T23:01:11.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.131+0000 7fa392400700 1 -- 172.21.15.44:0/3757557444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa38c06a190 con 0x7fa38c10b6e0 2024-05-03T23:01:11.135 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.133+0000 7fa383e00700 1 -- 172.21.15.44:0/3757557444 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa38401a020 con 0x7fa38c10b6e0 2024-05-03T23:01:11.137 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.135+0000 7fa383e00700 1 --2- 172.21.15.44:0/3757557444 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa3700b2910 0x7fa3700b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:11.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.135+0000 7fa383e00700 1 -- 172.21.15.44:0/3757557444 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9266+0+0 (secure 0 0 0) 0x7fa3840e22a0 con 0x7fa38c10b6e0 2024-05-03T23:01:11.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.135+0000 7fa38b400700 1 --2- 172.21.15.44:0/3757557444 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa3700b2910 0x7fa3700b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:11.138 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.136+0000 7fa38b400700 1 --2- 172.21.15.44:0/3757557444 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa3700b2910 0x7fa3700b4dd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa37c005950 tx=0x7fa37c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:01:11.139 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.137+0000 7fa383e00700 1 -- 172.21.15.44:0/3757557444 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fa384010070 con 0x7fa38c10b6e0 2024-05-03T23:01:11.431 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.428+0000 7fa392400700 1 -- 172.21.15.44:0/3757557444 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa38c02e510 con 0x7fa38c10b6e0 2024-05-03T23:01:11.436 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.432+0000 7fa383e00700 1 -- 172.21.15.44:0/3757557444 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) ==== 161+0+0 (secure 0 0 0) 0x7fa3840a99f0 con 0x7fa38c10b6e0 2024-05-03T23:01:11.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.437+0000 7fa392400700 1 -- 172.21.15.44:0/3757557444 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa3700b2910 msgr2=0x7fa3700b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:11.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.437+0000 7fa392400700 1 --2- 172.21.15.44:0/3757557444 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa3700b2910 0x7fa3700b4dd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa37c005950 tx=0x7fa37c0058e0 comp rx=0 tx=0).stop 2024-05-03T23:01:11.441 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.437+0000 7fa392400700 1 -- 172.21.15.44:0/3757557444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa38c10b6e0 msgr2=0x7fa38c1a0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:11.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.437+0000 7fa392400700 1 --2- 172.21.15.44:0/3757557444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa38c10b6e0 0x7fa38c1a0790 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa384007ee0 tx=0x7fa38400d3b0 comp rx=0 tx=0).stop 2024-05-03T23:01:11.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.438+0000 7fa392400700 1 -- 172.21.15.44:0/3757557444 shutdown_connections 2024-05-03T23:01:11.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.438+0000 7fa392400700 1 --2- 172.21.15.44:0/3757557444 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fa38c10b6e0 0x7fa38c1a0790 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:11.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.438+0000 7fa392400700 1 --2- 172.21.15.44:0/3757557444 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fa3700b2910 0x7fa3700b4dd0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:11.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.438+0000 7fa392400700 1 --2- 172.21.15.44:0/3757557444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa38c1056e0 0x7fa38c19bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:11.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.438+0000 7fa392400700 1 --2- 172.21.15.44:0/3757557444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa38c1060a0 0x7fa38c19c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:11.442 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.438+0000 7fa392400700 1 -- 172.21.15.44:0/3757557444 >> 172.21.15.44:0/3757557444 conn(0x7fa38c1011d0 msgr2=0x7fa38c1018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:01:11.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.439+0000 7fa392400700 1 -- 172.21.15.44:0/3757557444 shutdown_connections 2024-05-03T23:01:11.443 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:11.440+0000 7fa392400700 1 -- 172.21.15.44:0/3757557444 wait complete. 2024-05-03T23:01:11.444 INFO:teuthology.orchestra.run.smithi044.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-03T23:01:11.752 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 23:01:11 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-a[71404]: ignoring --setuser ceph since I am not root 2024-05-03T23:01:11.753 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 23:01:11 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-a[71404]: ignoring --setgroup ceph since I am not root 2024-05-03T23:01:11.753 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 23:01:11 smithi044 ceph-mds[71408]: -- 172.21.15.44:0/2932534592 <== mon.0 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e4f34e5a40 con 0x55e4f34b9000 2024-05-03T23:01:11.753 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 23:01:11 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-a[71404]: starting mds.a at 2024-05-03T23:01:11.753 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 23:01:11 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-g[70961]: ignoring --setuser ceph since I am not root 2024-05-03T23:01:11.753 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 23:01:11 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-g[70961]: ignoring --setgroup ceph since I am not root 2024-05-03T23:01:11.754 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 23:01:11 smithi044 ceph-mds[70965]: -- 172.21.15.44:0/783550169 <== mon.0 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5599306efa40 con 0x5599306c2c00 2024-05-03T23:01:11.754 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 23:01:11 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-g[70961]: starting mds.g at 2024-05-03T23:01:11.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:11 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-a[28600]: 2024-05-03T23:01:11.429+0000 7fcc0f000700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-03T23:01:11.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:11 smithi044 ceph-mon[28604]: pgmap v1009: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:01:11.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:11 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3757557444' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-03T23:01:11.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:11 smithi044 ceph-mon[28604]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-03T23:01:11.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:11 smithi044 ceph-mon[28604]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-03T23:01:11.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:11 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3757557444' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-03T23:01:11.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:11 smithi044 ceph-mon[28604]: osdmap e90: 12 total, 12 up, 12 in 2024-05-03T23:01:11.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:11 smithi044 ceph-mon[28604]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-03T23:01:11.755 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 23:01:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-e[61863]: ignoring --setuser ceph since I am not root 2024-05-03T23:01:11.756 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 23:01:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-e[61863]: ignoring --setgroup ceph since I am not root 2024-05-03T23:01:11.756 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 23:01:11 smithi060 ceph-mds[61867]: -- 172.21.15.60:0/824286991 <== mon.0 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5638308c7a40 con 0x56383089ac00 2024-05-03T23:01:11.756 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 23:01:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-e[61863]: starting mds.e at 2024-05-03T23:01:11.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:11 smithi060 ceph-mon[31721]: pgmap v1009: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:01:11.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:11 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3757557444' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-03T23:01:11.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:11 smithi060 ceph-mon[31721]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-03T23:01:11.757 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:11 smithi060 ceph-mon[31721]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-03T23:01:11.757 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:11 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3757557444' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-03T23:01:11.757 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:11 smithi060 ceph-mon[31721]: osdmap e90: 12 total, 12 up, 12 in 2024-05-03T23:01:11.757 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:11 smithi060 ceph-mon[31721]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-03T23:01:11.757 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 23:01:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-b[62484]: ignoring --setuser ceph since I am not root 2024-05-03T23:01:11.757 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 23:01:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-b[62484]: ignoring --setgroup ceph since I am not root 2024-05-03T23:01:11.758 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 23:01:11 smithi060 ceph-mds[62488]: -- 172.21.15.60:0/1767165997 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56114d825a40 con 0x56114d7f8800 2024-05-03T23:01:11.758 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 23:01:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-b[62484]: starting mds.b at 2024-05-03T23:01:11.758 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 23:01:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-h[62169]: ignoring --setuser ceph since I am not root 2024-05-03T23:01:11.758 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 23:01:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-h[62169]: ignoring --setgroup ceph since I am not root 2024-05-03T23:01:11.758 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 23:01:11 smithi060 ceph-mds[62173]: -- 172.21.15.60:0/87642676 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5582dd7d5a40 con 0x5582dd7a9000 2024-05-03T23:01:11.759 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 23:01:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-h[62169]: starting mds.h at 2024-05-03T23:01:11.759 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 23:01:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-k[61555]: ignoring --setuser ceph since I am not root 2024-05-03T23:01:11.759 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 23:01:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-k[61555]: ignoring --setgroup ceph since I am not root 2024-05-03T23:01:11.759 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 23:01:11 smithi060 ceph-mds[61564]: -- 172.21.15.60:0/1030330623 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559049b79a40 con 0x559049b4d000 2024-05-03T23:01:11.759 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 23:01:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-k[61555]: starting mds.k at 2024-05-03T23:01:11.766 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 23:01:11 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-c[63274]: ignoring --setuser ceph since I am not root 2024-05-03T23:01:11.766 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 23:01:11 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-c[63274]: ignoring --setgroup ceph since I am not root 2024-05-03T23:01:11.766 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 23:01:11 smithi160 ceph-mds[63278]: -- 172.21.15.160:0/3092725949 <== mon.0 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5644bad4da40 con 0x5644bad21000 2024-05-03T23:01:11.766 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 23:01:11 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-c[63274]: starting mds.c at 2024-05-03T23:01:11.767 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 23:01:11 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-l[62651]: ignoring --setuser ceph since I am not root 2024-05-03T23:01:11.767 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 23:01:11 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-l[62651]: ignoring --setgroup ceph since I am not root 2024-05-03T23:01:11.767 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 23:01:11 smithi160 ceph-mds[62655]: -- 172.21.15.160:0/3764365870 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f9c2239a40 con 0x55f9c220cc00 2024-05-03T23:01:11.767 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 23:01:11 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-l[62651]: starting mds.l at 2024-05-03T23:01:11.767 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:11 smithi160 ceph-mon[32531]: pgmap v1009: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-05-03T23:01:11.767 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:11 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3757557444' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-03T23:01:11.768 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:11 smithi160 ceph-mon[32531]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-03T23:01:11.768 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:11 smithi160 ceph-mon[32531]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-03T23:01:11.768 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:11 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3757557444' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-03T23:01:11.768 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:11 smithi160 ceph-mon[32531]: osdmap e90: 12 total, 12 up, 12 in 2024-05-03T23:01:11.768 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:11 smithi160 ceph-mon[32531]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-03T23:01:11.768 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 23:01:11 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-f[62971]: ignoring --setuser ceph since I am not root 2024-05-03T23:01:11.768 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 23:01:11 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-f[62971]: ignoring --setgroup ceph since I am not root 2024-05-03T23:01:11.769 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 23:01:11 smithi160 ceph-mds[62975]: -- 172.21.15.160:0/1122150066 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559a211a9a40 con 0x559a2117d000 2024-05-03T23:01:11.769 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 23:01:11 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-f[62971]: starting mds.f at 2024-05-03T23:01:11.769 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 23:01:11 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-i[63578]: ignoring --setuser ceph since I am not root 2024-05-03T23:01:11.769 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 23:01:11 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-i[63578]: ignoring --setgroup ceph since I am not root 2024-05-03T23:01:11.769 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 23:01:11 smithi160 ceph-mds[63582]: -- 172.21.15.160:0/2228766567 <== mon.0 v2:172.21.15.44:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a0cc799a40 con 0x55a0cc76c800 2024-05-03T23:01:11.770 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 23:01:11 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-i[63578]: starting mds.i at 2024-05-03T23:01:12.328 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-05-03T23:01:12.820 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T23:01:13.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: pgmap v1011: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-03T23:01:13.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.44:6838/1254765992,v1:172.21.15.44:6839/1254765992] up:boot 2024-05-03T23:01:13.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.44:6840/2081822938,v1:172.21.15.44:6841/2081822938] up:boot 2024-05-03T23:01:13.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.160:6832/1859393665,v1:172.21.15.160:6834/1859393665] up:boot 2024-05-03T23:01:13.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.160:6833/3053552479,v1:172.21.15.160:6835/3053552479] up:boot 2024-05-03T23:01:13.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.60:6832/3945474950,v1:172.21.15.60:6833/3945474950] up:boot 2024-05-03T23:01:13.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.60:6834/3299512256,v1:172.21.15.60:6835/3299512256] up:boot 2024-05-03T23:01:13.753 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.160:6836/3420153948,v1:172.21.15.160:6838/3420153948] up:boot 2024-05-03T23:01:13.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.160:6837/661676930,v1:172.21.15.160:6839/661676930] up:boot 2024-05-03T23:01:13.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.60:6836/4087483818,v1:172.21.15.60:6838/4087483818] up:boot 2024-05-03T23:01:13.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: mds.? [v2:172.21.15.60:6837/4202233834,v1:172.21.15.60:6839/4202233834] up:boot 2024-05-03T23:01:13.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-03T23:01:13.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-03T23:01:13.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-03T23:01:13.754 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-03T23:01:13.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-03T23:01:13.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-03T23:01:13.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-03T23:01:13.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-03T23:01:13.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-03T23:01:13.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T23:01:13.755 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:13 smithi044 ceph-mon[28604]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-03T23:01:13.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: pgmap v1011: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-03T23:01:13.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.44:6838/1254765992,v1:172.21.15.44:6839/1254765992] up:boot 2024-05-03T23:01:13.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.44:6840/2081822938,v1:172.21.15.44:6841/2081822938] up:boot 2024-05-03T23:01:13.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.160:6832/1859393665,v1:172.21.15.160:6834/1859393665] up:boot 2024-05-03T23:01:13.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.160:6833/3053552479,v1:172.21.15.160:6835/3053552479] up:boot 2024-05-03T23:01:13.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.60:6832/3945474950,v1:172.21.15.60:6833/3945474950] up:boot 2024-05-03T23:01:13.757 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.60:6834/3299512256,v1:172.21.15.60:6835/3299512256] up:boot 2024-05-03T23:01:13.757 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.160:6836/3420153948,v1:172.21.15.160:6838/3420153948] up:boot 2024-05-03T23:01:13.757 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.160:6837/661676930,v1:172.21.15.160:6839/661676930] up:boot 2024-05-03T23:01:13.757 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.60:6836/4087483818,v1:172.21.15.60:6838/4087483818] up:boot 2024-05-03T23:01:13.757 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: mds.? [v2:172.21.15.60:6837/4202233834,v1:172.21.15.60:6839/4202233834] up:boot 2024-05-03T23:01:13.757 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-03T23:01:13.757 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-03T23:01:13.757 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-03T23:01:13.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-03T23:01:13.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-03T23:01:13.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-03T23:01:13.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-03T23:01:13.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-03T23:01:13.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-03T23:01:13.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T23:01:13.759 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:13 smithi060 ceph-mon[31721]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-03T23:01:13.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: pgmap v1011: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-03T23:01:13.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.44:6838/1254765992,v1:172.21.15.44:6839/1254765992] up:boot 2024-05-03T23:01:13.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.44:6840/2081822938,v1:172.21.15.44:6841/2081822938] up:boot 2024-05-03T23:01:13.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.160:6832/1859393665,v1:172.21.15.160:6834/1859393665] up:boot 2024-05-03T23:01:13.767 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.160:6833/3053552479,v1:172.21.15.160:6835/3053552479] up:boot 2024-05-03T23:01:13.767 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.60:6832/3945474950,v1:172.21.15.60:6833/3945474950] up:boot 2024-05-03T23:01:13.767 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.60:6834/3299512256,v1:172.21.15.60:6835/3299512256] up:boot 2024-05-03T23:01:13.767 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.160:6836/3420153948,v1:172.21.15.160:6838/3420153948] up:boot 2024-05-03T23:01:13.767 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.160:6837/661676930,v1:172.21.15.160:6839/661676930] up:boot 2024-05-03T23:01:13.767 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.60:6836/4087483818,v1:172.21.15.60:6838/4087483818] up:boot 2024-05-03T23:01:13.767 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: mds.? [v2:172.21.15.60:6837/4202233834,v1:172.21.15.60:6839/4202233834] up:boot 2024-05-03T23:01:13.767 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-03T23:01:13.767 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-03T23:01:13.768 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-03T23:01:13.768 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-03T23:01:13.768 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-03T23:01:13.768 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-03T23:01:13.768 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-03T23:01:13.768 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-03T23:01:13.768 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-03T23:01:13.768 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-03T23:01:13.768 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:13 smithi160 ceph-mon[32531]: from='mgr.14152 172.21.15.44:0/3282692182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-03T23:01:15.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.092+0000 7f3604a00700 1 -- 172.21.15.44:0/3346404720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360006b180 msgr2=0x7f360006b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:15.095 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.092+0000 7f3604a00700 1 --2- 172.21.15.44:0/3346404720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360006b180 0x7f360006b600 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f35e8009990 tx=0x7f35e8009ca0 comp rx=0 tx=0).stop 2024-05-03T23:01:15.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.092+0000 7f3604a00700 1 -- 172.21.15.44:0/3346404720 shutdown_connections 2024-05-03T23:01:15.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.092+0000 7f3604a00700 1 --2- 172.21.15.44:0/3346404720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f360006bb40 0x7f3600110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:15.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.092+0000 7f3604a00700 1 --2- 172.21.15.44:0/3346404720 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3600109510 0x7f36001098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:15.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.092+0000 7f3604a00700 1 --2- 172.21.15.44:0/3346404720 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f360006b180 0x7f360006b600 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:15.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.092+0000 7f3604a00700 1 -- 172.21.15.44:0/3346404720 >> 172.21.15.44:0/3346404720 conn(0x7f3600079350 msgr2=0x7f3600079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:01:15.096 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.092+0000 7f3604a00700 1 -- 172.21.15.44:0/3346404720 shutdown_connections 2024-05-03T23:01:15.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.092+0000 7f3604a00700 1 -- 172.21.15.44:0/3346404720 wait complete. 2024-05-03T23:01:15.097 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.093+0000 7f3604a00700 1 Processor -- start 2024-05-03T23:01:15.098 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.093+0000 7f3604a00700 1 -- start start 2024-05-03T23:01:15.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.094+0000 7f3604a00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f360006b180 0x7f360019bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:15.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.094+0000 7f3604a00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f360006bb40 0x7f360019c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:15.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.094+0000 7f3604a00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3600109510 0x7f36001a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:15.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.094+0000 7f3604a00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f36001137b0 con 0x7f3600109510 2024-05-03T23:01:15.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.094+0000 7f3604a00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3600113630 con 0x7f360006b180 2024-05-03T23:01:15.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.094+0000 7f3604a00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3600113930 con 0x7f360006bb40 2024-05-03T23:01:15.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.094+0000 7f35fe800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3600109510 0x7f36001a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:15.099 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.094+0000 7f35fe800700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3600109510 0x7f36001a0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56742/0 (socket says 172.21.15.44:56742) 2024-05-03T23:01:15.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.094+0000 7f35fe800700 1 -- 172.21.15.44:0/3597691740 learned_addr learned my addr 172.21.15.44:0/3597691740 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T23:01:15.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.094+0000 7f35f5400700 1 --2- 172.21.15.44:0/3597691740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f360006bb40 0x7f360019c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:15.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.095+0000 7f35fde00700 1 --2- 172.21.15.44:0/3597691740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f360006b180 0x7f360019bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:15.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.095+0000 7f35fe800700 1 -- 172.21.15.44:0/3597691740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f360006bb40 msgr2=0x7f360019c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:15.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.095+0000 7f35fe800700 1 --2- 172.21.15.44:0/3597691740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f360006bb40 0x7f360019c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:15.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.095+0000 7f35fe800700 1 -- 172.21.15.44:0/3597691740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f360006b180 msgr2=0x7f360019bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:15.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.095+0000 7f35fe800700 1 --2- 172.21.15.44:0/3597691740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f360006b180 0x7f360019bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:15.100 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.095+0000 7f35fe800700 1 -- 172.21.15.44:0/3597691740 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36001a0d90 con 0x7f3600109510 2024-05-03T23:01:15.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.095+0000 7f35fe800700 1 --2- 172.21.15.44:0/3597691740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3600109510 0x7f36001a0650 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f35f800c900 tx=0x7f35f800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:01:15.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.096+0000 7f35f7400700 1 -- 172.21.15.44:0/3597691740 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8007b00 con 0x7f3600109510 2024-05-03T23:01:15.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.096+0000 7f35f7400700 1 -- 172.21.15.44:0/3597691740 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f35f8007ca0 con 0x7f3600109510 2024-05-03T23:01:15.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.096+0000 7f35f7400700 1 -- 172.21.15.44:0/3597691740 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8018640 con 0x7f3600109510 2024-05-03T23:01:15.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.096+0000 7f3604a00700 1 -- 172.21.15.44:0/3597691740 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36001a1080 con 0x7f3600109510 2024-05-03T23:01:15.101 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.096+0000 7f3604a00700 1 -- 172.21.15.44:0/3597691740 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36001a8900 con 0x7f3600109510 2024-05-03T23:01:15.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.097+0000 7f3604a00700 1 -- 172.21.15.44:0/3597691740 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f360006a190 con 0x7f3600109510 2024-05-03T23:01:15.102 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.099+0000 7f35f7400700 1 -- 172.21.15.44:0/3597691740 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f35f800f450 con 0x7f3600109510 2024-05-03T23:01:15.104 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.102+0000 7f35f7400700 1 --2- 172.21.15.44:0/3597691740 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f35e40b2990 0x7f35e40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:15.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.102+0000 7f35f7400700 1 -- 172.21.15.44:0/3597691740 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9696+0+0 (secure 0 0 0) 0x7f35f80e28f0 con 0x7f3600109510 2024-05-03T23:01:15.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.102+0000 7f35fde00700 1 --2- 172.21.15.44:0/3597691740 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f35e40b2990 0x7f35e40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:15.105 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.103+0000 7f35fde00700 1 --2- 172.21.15.44:0/3597691740 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f35e40b2990 0x7f35e40b4e50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f35f000d150 tx=0x7f35f0009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:01:15.109 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.107+0000 7f35f7400700 1 -- 172.21.15.44:0/3597691740 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f35f8014030 con 0x7f3600109510 2024-05-03T23:01:15.396 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.394+0000 7f3604a00700 1 -- 172.21.15.44:0/3597691740 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f36001a8b90 con 0x7f3600109510 2024-05-03T23:01:15.485 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.482+0000 7f35f7400700 1 -- 172.21.15.44:0/3597691740 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) ==== 104+0+0 (secure 0 0 0) 0x7f35f80a9ec0 con 0x7f3600109510 2024-05-03T23:01:15.489 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.486+0000 7f3604a00700 1 -- 172.21.15.44:0/3597691740 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f35e40b2990 msgr2=0x7f35e40b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:15.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.486+0000 7f3604a00700 1 --2- 172.21.15.44:0/3597691740 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f35e40b2990 0x7f35e40b4e50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f35f000d150 tx=0x7f35f0009040 comp rx=0 tx=0).stop 2024-05-03T23:01:15.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.486+0000 7f3604a00700 1 -- 172.21.15.44:0/3597691740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3600109510 msgr2=0x7f36001a0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:15.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.486+0000 7f3604a00700 1 --2- 172.21.15.44:0/3597691740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3600109510 0x7f36001a0650 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f35f800c900 tx=0x7f35f800ccc0 comp rx=0 tx=0).stop 2024-05-03T23:01:15.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.486+0000 7f3604a00700 1 -- 172.21.15.44:0/3597691740 shutdown_connections 2024-05-03T23:01:15.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.486+0000 7f3604a00700 1 --2- 172.21.15.44:0/3597691740 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f3600109510 0x7f36001a0650 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:15.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.486+0000 7f3604a00700 1 --2- 172.21.15.44:0/3597691740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f360006b180 0x7f360019bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:15.490 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.486+0000 7f3604a00700 1 --2- 172.21.15.44:0/3597691740 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f35e40b2990 0x7f35e40b4e50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:15.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.486+0000 7f3604a00700 1 --2- 172.21.15.44:0/3597691740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f360006bb40 0x7f360019c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:15.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.486+0000 7f3604a00700 1 -- 172.21.15.44:0/3597691740 >> 172.21.15.44:0/3597691740 conn(0x7f3600079350 msgr2=0x7f360010e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:01:15.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.487+0000 7f3604a00700 1 -- 172.21.15.44:0/3597691740 shutdown_connections 2024-05-03T23:01:15.491 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:15.487+0000 7f3604a00700 1 -- 172.21.15.44:0/3597691740 wait complete. 2024-05-03T23:01:15.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:15 smithi044 ceph-mon[28604]: pgmap v1012: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T23:01:15.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:15 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3597691740' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-03T23:01:15.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:15 smithi060 ceph-mon[31721]: pgmap v1012: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T23:01:15.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:15 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3597691740' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-03T23:01:15.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:15 smithi160 ceph-mon[32531]: pgmap v1012: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-03T23:01:15.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:15 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3597691740' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-03T23:01:16.337 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-03T23:01:16.501 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:16 smithi044 ceph-mon[28604]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-03T23:01:16.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:16 smithi044 ceph-mon[28604]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-03T23:01:16.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:16 smithi044 ceph-mon[28604]: Cluster is now healthy 2024-05-03T23:01:16.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:16 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3597691740' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-03T23:01:16.502 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:16 smithi044 ceph-mon[28604]: fsmap 12 up:standby 2024-05-03T23:01:16.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:16 smithi060 ceph-mon[31721]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-03T23:01:16.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:16 smithi060 ceph-mon[31721]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-03T23:01:16.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:16 smithi060 ceph-mon[31721]: Cluster is now healthy 2024-05-03T23:01:16.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:16 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3597691740' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-03T23:01:16.756 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:16 smithi060 ceph-mon[31721]: fsmap 12 up:standby 2024-05-03T23:01:16.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:16 smithi160 ceph-mon[32531]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-03T23:01:16.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:16 smithi160 ceph-mon[32531]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-03T23:01:16.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:16 smithi160 ceph-mon[32531]: Cluster is now healthy 2024-05-03T23:01:16.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:16 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3597691740' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-03T23:01:16.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:16 smithi160 ceph-mon[32531]: fsmap 12 up:standby 2024-05-03T23:01:16.772 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T23:01:17.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:17 smithi044 ceph-mon[28604]: pgmap v1013: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T23:01:17.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:17 smithi060 ceph-mon[31721]: pgmap v1013: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T23:01:17.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:17 smithi160 ceph-mon[32531]: pgmap v1013: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-05-03T23:01:19.038 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.035+0000 7f84f7600700 1 -- 172.21.15.44:0/1125858913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f0108460 msgr2=0x7f84f0108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.035+0000 7f84f7600700 1 --2- 172.21.15.44:0/1125858913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f0108460 0x7f84f0108840 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f84e4009990 tx=0x7f84e4009ca0 comp rx=0 tx=0).stop 2024-05-03T23:01:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.035+0000 7f84f7600700 1 -- 172.21.15.44:0/1125858913 shutdown_connections 2024-05-03T23:01:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.035+0000 7f84f7600700 1 --2- 172.21.15.44:0/1125858913 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84f0103ef0 0x7f84f01103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:19.039 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.035+0000 7f84f7600700 1 --2- 172.21.15.44:0/1125858913 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f0108460 0x7f84f0108840 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.035+0000 7f84f7600700 1 --2- 172.21.15.44:0/1125858913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84f0103550 0x7f84f01039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.035+0000 7f84f7600700 1 -- 172.21.15.44:0/1125858913 >> 172.21.15.44:0/1125858913 conn(0x7f84f007a600 msgr2=0x7f84f007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:01:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.036+0000 7f84f7600700 1 -- 172.21.15.44:0/1125858913 shutdown_connections 2024-05-03T23:01:19.040 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.036+0000 7f84f7600700 1 -- 172.21.15.44:0/1125858913 wait complete. 2024-05-03T23:01:19.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.037+0000 7f84f7600700 1 Processor -- start 2024-05-03T23:01:19.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.037+0000 7f84f7600700 1 -- start start 2024-05-03T23:01:19.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.037+0000 7f84f7600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84f0103550 0x7f84f00757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:19.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.037+0000 7f84f7600700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84f0103ef0 0x7f84f0075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:19.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.037+0000 7f84f7600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f0108460 0x7f84f0076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:19.042 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.037+0000 7f84f7600700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7f84f01137e0 con 0x7f84f0108460 2024-05-03T23:01:19.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.037+0000 7f84f7600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f84f0113660 con 0x7f84f0103550 2024-05-03T23:01:19.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.037+0000 7f84f7600700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f84f0113960 con 0x7f84f0103ef0 2024-05-03T23:01:19.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.038+0000 7f84f5600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f0108460 0x7f84f0076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:19.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.038+0000 7f84f5600700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f0108460 0x7f84f0076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:56774/0 (socket says 172.21.15.44:56774) 2024-05-03T23:01:19.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.038+0000 7f84f5600700 1 -- 172.21.15.44:0/2428893321 learned_addr learned my addr 172.21.15.44:0/2428893321 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T23:01:19.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.038+0000 7f84efe00700 1 --2- 172.21.15.44:0/2428893321 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84f0103ef0 0x7f84f0075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:19.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.038+0000 7f84f4c00700 1 --2- 172.21.15.44:0/2428893321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84f0103550 0x7f84f00757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:19.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.038+0000 7f84f5600700 1 -- 172.21.15.44:0/2428893321 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84f0103ef0 msgr2=0x7f84f0075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:19.043 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.038+0000 7f84f5600700 1 --2- 172.21.15.44:0/2428893321 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84f0103ef0 0x7f84f0075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:19.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.038+0000 7f84f5600700 1 -- 172.21.15.44:0/2428893321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84f0103550 msgr2=0x7f84f00757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:19.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.038+0000 7f84f5600700 1 --2- 172.21.15.44:0/2428893321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84f0103550 0x7f84f00757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:19.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.038+0000 7f84f5600700 1 -- 172.21.15.44:0/2428893321 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f01a81e0 con 0x7f84f0108460 2024-05-03T23:01:19.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.039+0000 7f84f5600700 1 --2- 172.21.15.44:0/2428893321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f0108460 0x7f84f0076220 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f84e8007f10 tx=0x7f84e800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:01:19.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.039+0000 7f84ed600700 1 -- 172.21.15.44:0/2428893321 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e800ddd0 con 0x7f84f0108460 2024-05-03T23:01:19.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.039+0000 7f84ed600700 1 -- 172.21.15.44:0/2428893321 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7f84e8004020 con 0x7f84f0108460 2024-05-03T23:01:19.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.039+0000 7f84ed600700 1 -- 172.21.15.44:0/2428893321 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e8015640 con 0x7f84f0108460 2024-05-03T23:01:19.044 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.039+0000 7f84f7600700 1 -- 172.21.15.44:0/2428893321 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f01a84d0 con 0x7f84f0108460 2024-05-03T23:01:19.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.039+0000 7f84f7600700 1 -- 172.21.15.44:0/2428893321 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f01a89c0 con 0x7f84f0108460 2024-05-03T23:01:19.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.040+0000 7f84f7600700 1 -- 172.21.15.44:0/2428893321 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84f006a190 con 0x7f84f0108460 2024-05-03T23:01:19.045 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.043+0000 7f84ed600700 1 -- 172.21.15.44:0/2428893321 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f84e80041d0 con 0x7f84f0108460 2024-05-03T23:01:19.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.044+0000 7f84ed600700 1 --2- 172.21.15.44:0/2428893321 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f84d80b2910 0x7f84d80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:19.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.045+0000 7f84ed600700 1 -- 172.21.15.44:0/2428893321 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9696+0+0 (secure 0 0 0) 0x7f84e80e2bb0 con 0x7f84f0108460 2024-05-03T23:01:19.047 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.045+0000 7f84f4c00700 1 --2- 172.21.15.44:0/2428893321 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f84d80b2910 0x7f84d80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:19.048 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.046+0000 7f84f4c00700 1 --2- 172.21.15.44:0/2428893321 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f84d80b2910 0x7f84d80b4dd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f84e4006010 tx=0x7f84e400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:01:19.049 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.047+0000 7f84ed600700 1 -- 172.21.15.44:0/2428893321 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7f84e8010070 con 0x7f84f0108460 2024-05-03T23:01:19.292 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.290+0000 7f84f7600700 1 -- 172.21.15.44:0/2428893321 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f84f002e510 con 0x7f84f0108460 2024-05-03T23:01:19.498 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.495+0000 7f84ed600700 1 -- 172.21.15.44:0/2428893321 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v91) ==== 181+0+0 (secure 0 0 0) 0x7f84e80b2070 con 0x7f84f0108460 2024-05-03T23:01:19.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.500+0000 7f84f7600700 1 -- 172.21.15.44:0/2428893321 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f84d80b2910 msgr2=0x7f84d80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:19.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.500+0000 7f84f7600700 1 --2- 172.21.15.44:0/2428893321 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f84d80b2910 0x7f84d80b4dd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f84e4006010 tx=0x7f84e400b540 comp rx=0 tx=0).stop 2024-05-03T23:01:19.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.500+0000 7f84f7600700 1 -- 172.21.15.44:0/2428893321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f0108460 msgr2=0x7f84f0076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:19.503 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.500+0000 7f84f7600700 1 --2- 172.21.15.44:0/2428893321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f0108460 0x7f84f0076220 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f84e8007f10 tx=0x7f84e800d3b0 comp rx=0 tx=0).stop 2024-05-03T23:01:19.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.503+0000 7f84f7600700 1 -- 172.21.15.44:0/2428893321 shutdown_connections 2024-05-03T23:01:19.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.503+0000 7f84f7600700 1 --2- 172.21.15.44:0/2428893321 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7f84f0108460 0x7f84f0076220 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:19.505 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.503+0000 7f84f7600700 1 --2- 172.21.15.44:0/2428893321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84f0103550 0x7f84f00757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:19.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.503+0000 7f84f7600700 1 --2- 172.21.15.44:0/2428893321 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7f84d80b2910 0x7f84d80b4dd0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:19.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.503+0000 7f84f7600700 1 --2- 172.21.15.44:0/2428893321 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84f0103ef0 0x7f84f0075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:19.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.503+0000 7f84f7600700 1 -- 172.21.15.44:0/2428893321 >> 172.21.15.44:0/2428893321 conn(0x7f84f007a600 msgr2=0x7f84f0101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:01:19.506 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.503+0000 7f84f7600700 1 -- 172.21.15.44:0/2428893321 shutdown_connections 2024-05-03T23:01:19.507 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:19.504+0000 7f84f7600700 1 -- 172.21.15.44:0/2428893321 wait complete. 2024-05-03T23:01:19.509 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_metadata' removed 2024-05-03T23:01:19.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:19 smithi044 ceph-mon[28604]: pgmap v1014: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-05-03T23:01:19.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:19 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2428893321' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T23:01:19.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:19 smithi160 ceph-mon[32531]: pgmap v1014: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-05-03T23:01:19.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:19 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2428893321' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T23:01:20.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:19 smithi060 ceph-mon[31721]: pgmap v1014: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 7 op/s 2024-05-03T23:01:20.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:19 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2428893321' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T23:01:20.337 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-03T23:01:20.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:20 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/2428893321' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T23:01:20.766 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:20 smithi160 ceph-mon[32531]: osdmap e91: 12 total, 12 up, 12 in 2024-05-03T23:01:20.822 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T23:01:20.973 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:20 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/2428893321' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T23:01:20.973 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:20 smithi044 ceph-mon[28604]: osdmap e91: 12 total, 12 up, 12 in 2024-05-03T23:01:21.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:20 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/2428893321' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T23:01:21.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:20 smithi060 ceph-mon[31721]: osdmap e91: 12 total, 12 up, 12 in 2024-05-03T23:01:21.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:21 smithi044 ceph-mon[28604]: pgmap v1016: 97 pgs: 97 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T23:01:22.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:21 smithi060 ceph-mon[31721]: pgmap v1016: 97 pgs: 97 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T23:01:22.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:21 smithi160 ceph-mon[32531]: pgmap v1016: 97 pgs: 97 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T23:01:23.150 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.146+0000 7fc55fe00700 1 -- 172.21.15.44:0/2388820414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5601055d0 msgr2=0x7fc560105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:23.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.146+0000 7fc55fe00700 1 --2- 172.21.15.44:0/2388820414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5601055d0 0x7fc560105a50 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009990 tx=0x7fc54c009ca0 comp rx=0 tx=0).stop 2024-05-03T23:01:23.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.147+0000 7fc55fe00700 1 -- 172.21.15.44:0/2388820414 shutdown_connections 2024-05-03T23:01:23.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.147+0000 7fc55fe00700 1 --2- 172.21.15.44:0/2388820414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc560105f90 0x7fc5601124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:23.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.147+0000 7fc55fe00700 1 --2- 172.21.15.44:0/2388820414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc56010b660 0x7fc56010ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:23.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.147+0000 7fc55fe00700 1 --2- 172.21.15.44:0/2388820414 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc5601055d0 0x7fc560105a50 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:23.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.147+0000 7fc55fe00700 1 -- 172.21.15.44:0/2388820414 >> 172.21.15.44:0/2388820414 conn(0x7fc5601010c0 msgr2=0x7fc5601034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:01:23.151 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.147+0000 7fc55fe00700 1 -- 172.21.15.44:0/2388820414 shutdown_connections 2024-05-03T23:01:23.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.147+0000 7fc55fe00700 1 -- 172.21.15.44:0/2388820414 wait complete. 2024-05-03T23:01:23.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.148+0000 7fc55fe00700 1 Processor -- start 2024-05-03T23:01:23.152 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.148+0000 7fc55fe00700 1 -- start start 2024-05-03T23:01:23.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.148+0000 7fc55fe00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5601055d0 0x7fc5601a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:23.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.148+0000 7fc55fe00700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc560105f90 0x7fc5601a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:23.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.148+0000 7fc55fe00700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc56010b660 0x7fc56019baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:23.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.148+0000 7fc55fe00700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc560115940 con 0x7fc560105f90 2024-05-03T23:01:23.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.149+0000 7fc55fe00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc5601157c0 con 0x7fc5601055d0 2024-05-03T23:01:23.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.149+0000 7fc55fe00700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc560115ac0 con 0x7fc56010b660 2024-05-03T23:01:23.154 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.149+0000 7fc55e000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc560105f90 0x7fc5601a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:23.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.149+0000 7fc55e000700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc560105f90 0x7fc5601a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48192/0 (socket says 172.21.15.44:48192) 2024-05-03T23:01:23.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.149+0000 7fc55e000700 1 -- 172.21.15.44:0/4029303420 learned_addr learned my addr 172.21.15.44:0/4029303420 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T23:01:23.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.149+0000 7fc55ea00700 1 --2- 172.21.15.44:0/4029303420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5601055d0 0x7fc5601a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:23.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.149+0000 7fc55f400700 1 --2- 172.21.15.44:0/4029303420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc56010b660 0x7fc56019baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:23.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.149+0000 7fc55e000700 1 -- 172.21.15.44:0/4029303420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc56010b660 msgr2=0x7fc56019baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:23.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.149+0000 7fc55e000700 1 --2- 172.21.15.44:0/4029303420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc56010b660 0x7fc56019baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:23.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.149+0000 7fc55e000700 1 -- 172.21.15.44:0/4029303420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5601055d0 msgr2=0x7fc5601a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:23.155 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.149+0000 7fc55e000700 1 --2- 172.21.15.44:0/4029303420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5601055d0 0x7fc5601a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.149+0000 7fc55e000700 1 -- 172.21.15.44:0/4029303420 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56019c200 con 0x7fc560105f90 2024-05-03T23:01:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.149+0000 7fc55f400700 1 --2- 172.21.15.44:0/4029303420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc56010b660 0x7fc56019baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-03T23:01:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.150+0000 7fc55e000700 1 --2- 172.21.15.44:0/4029303420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc560105f90 0x7fc5601a1e20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc54c005910 tx=0x7fc54c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:01:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.150+0000 7fc557400700 1 -- 172.21.15.44:0/4029303420 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c027070 con 0x7fc560105f90 2024-05-03T23:01:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.150+0000 7fc557400700 1 -- 172.21.15.44:0/4029303420 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fc54c003f70 con 0x7fc560105f90 2024-05-03T23:01:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.150+0000 7fc55fe00700 1 -- 172.21.15.44:0/4029303420 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56019c490 con 0x7fc560105f90 2024-05-03T23:01:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.150+0000 7fc557400700 1 -- 172.21.15.44:0/4029303420 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c022e00 con 0x7fc560105f90 2024-05-03T23:01:23.156 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.150+0000 7fc55fe00700 1 -- 172.21.15.44:0/4029303420 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5601a87b0 con 0x7fc560105f90 2024-05-03T23:01:23.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.152+0000 7fc55fe00700 1 -- 172.21.15.44:0/4029303420 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc560106d10 con 0x7fc560105f90 2024-05-03T23:01:23.157 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.154+0000 7fc557400700 1 -- 172.21.15.44:0/4029303420 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc54c02a070 con 0x7fc560105f90 2024-05-03T23:01:23.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.155+0000 7fc557400700 1 --2- 172.21.15.44:0/4029303420 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc5440b2910 0x7fc5440b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:23.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.156+0000 7fc557400700 1 -- 172.21.15.44:0/4029303420 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9113+0+0 (secure 0 0 0) 0x7fc54c0e3530 con 0x7fc560105f90 2024-05-03T23:01:23.158 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.156+0000 7fc55ea00700 1 --2- 172.21.15.44:0/4029303420 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc5440b2910 0x7fc5440b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:23.159 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.156+0000 7fc55ea00700 1 --2- 172.21.15.44:0/4029303420 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc5440b2910 0x7fc5440b4dd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc550005950 tx=0x7fc5500058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:01:23.162 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.160+0000 7fc557400700 1 -- 172.21.15.44:0/4029303420 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc54c013070 con 0x7fc560105f90 2024-05-03T23:01:23.402 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.399+0000 7fc55fe00700 1 -- 172.21.15.44:0/4029303420 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc56019d000 con 0x7fc560105f90 2024-05-03T23:01:23.535 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.532+0000 7fc557400700 1 -- 172.21.15.44:0/4029303420 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v92) ==== 169+0+0 (secure 0 0 0) 0x7fc56019d000 con 0x7fc560105f90 2024-05-03T23:01:23.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.536+0000 7fc55fe00700 1 -- 172.21.15.44:0/4029303420 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc5440b2910 msgr2=0x7fc5440b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:23.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.536+0000 7fc55fe00700 1 --2- 172.21.15.44:0/4029303420 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc5440b2910 0x7fc5440b4dd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc550005950 tx=0x7fc5500058e0 comp rx=0 tx=0).stop 2024-05-03T23:01:23.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.536+0000 7fc55fe00700 1 -- 172.21.15.44:0/4029303420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc560105f90 msgr2=0x7fc5601a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:23.539 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.536+0000 7fc55fe00700 1 --2- 172.21.15.44:0/4029303420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc560105f90 0x7fc5601a1e20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc54c005910 tx=0x7fc54c009f90 comp rx=0 tx=0).stop 2024-05-03T23:01:23.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.537+0000 7fc55fe00700 1 -- 172.21.15.44:0/4029303420 shutdown_connections 2024-05-03T23:01:23.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.537+0000 7fc55fe00700 1 --2- 172.21.15.44:0/4029303420 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc5440b2910 0x7fc5440b4dd0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:23.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.537+0000 7fc55fe00700 1 --2- 172.21.15.44:0/4029303420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc56010b660 0x7fc56019baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:23.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.537+0000 7fc55fe00700 1 --2- 172.21.15.44:0/4029303420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5601055d0 0x7fc5601a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:23.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.537+0000 7fc55fe00700 1 --2- 172.21.15.44:0/4029303420 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc560105f90 0x7fc5601a1e20 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:23.541 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.537+0000 7fc55fe00700 1 -- 172.21.15.44:0/4029303420 >> 172.21.15.44:0/4029303420 conn(0x7fc5601010c0 msgr2=0x7fc560102600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:01:23.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.539+0000 7fc55fe00700 1 -- 172.21.15.44:0/4029303420 shutdown_connections 2024-05-03T23:01:23.542 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:23.539+0000 7fc55fe00700 1 -- 172.21.15.44:0/4029303420 wait complete. 2024-05-03T23:01:23.545 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data' removed 2024-05-03T23:01:23.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:23 smithi044 ceph-mon[28604]: pgmap v1017: 97 pgs: 97 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T23:01:23.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:23 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/4029303420' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T23:01:24.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:23 smithi060 ceph-mon[31721]: pgmap v1017: 97 pgs: 97 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T23:01:24.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:23 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/4029303420' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T23:01:24.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:23 smithi160 ceph-mon[32531]: pgmap v1017: 97 pgs: 97 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T23:01:24.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:23 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/4029303420' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T23:01:24.360 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea shell --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-03T23:01:24.841 INFO:teuthology.orchestra.run.smithi044.stderr:Inferring config /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/mon.a/config 2024-05-03T23:01:25.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:24 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/4029303420' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T23:01:25.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:24 smithi044 ceph-mon[28604]: osdmap e92: 12 total, 12 up, 12 in 2024-05-03T23:01:25.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:24 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/4029303420' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T23:01:25.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:24 smithi060 ceph-mon[31721]: osdmap e92: 12 total, 12 up, 12 in 2024-05-03T23:01:25.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:24 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/4029303420' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T23:01:25.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:24 smithi160 ceph-mon[32531]: osdmap e92: 12 total, 12 up, 12 in 2024-05-03T23:01:25.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:25 smithi044 ceph-mon[28604]: pgmap v1019: 33 pgs: 33 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T23:01:25.907 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:25 smithi060 ceph-mon[31721]: pgmap v1019: 33 pgs: 33 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T23:01:25.917 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:25 smithi160 ceph-mon[32531]: pgmap v1019: 33 pgs: 33 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T23:01:27.123 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.121+0000 7fc847200700 1 -- 172.21.15.44:0/4147857842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc840103550 msgr2=0x7fc8401039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:27.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.121+0000 7fc847200700 1 --2- 172.21.15.44:0/4147857842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc840103550 0x7fc8401039b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009990 tx=0x7fc82c009ca0 comp rx=0 tx=0).stop 2024-05-03T23:01:27.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.122+0000 7fc847200700 1 -- 172.21.15.44:0/4147857842 shutdown_connections 2024-05-03T23:01:27.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.122+0000 7fc847200700 1 --2- 172.21.15.44:0/4147857842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc840103ef0 0x7fc8401103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:27.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.122+0000 7fc847200700 1 --2- 172.21.15.44:0/4147857842 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc840108460 0x7fc840108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:27.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.122+0000 7fc847200700 1 --2- 172.21.15.44:0/4147857842 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc840103550 0x7fc8401039b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:27.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.122+0000 7fc847200700 1 -- 172.21.15.44:0/4147857842 >> 172.21.15.44:0/4147857842 conn(0x7fc84007a600 msgr2=0x7fc84007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:01:27.124 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.122+0000 7fc847200700 1 -- 172.21.15.44:0/4147857842 shutdown_connections 2024-05-03T23:01:27.125 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.122+0000 7fc847200700 1 -- 172.21.15.44:0/4147857842 wait complete. 2024-05-03T23:01:27.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.123+0000 7fc847200700 1 Processor -- start 2024-05-03T23:01:27.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.123+0000 7fc847200700 1 -- start start 2024-05-03T23:01:27.126 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.124+0000 7fc847200700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc840103550 0x7fc84019be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:27.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.124+0000 7fc847200700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc840103ef0 0x7fc84019c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:27.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.124+0000 7fc847200700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc840108460 0x7fc8401a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:27.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.124+0000 7fc847200700 1 -- --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_getmap magic: 0 -- 0x7fc840113830 con 0x7fc840103ef0 2024-05-03T23:01:27.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.124+0000 7fc847200700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc8401136b0 con 0x7fc840108460 2024-05-03T23:01:27.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.124+0000 7fc847200700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc8401139b0 con 0x7fc840103550 2024-05-03T23:01:27.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.124+0000 7fc83f400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc840103ef0 0x7fc84019c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:27.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.124+0000 7fc83f400700 1 --2- >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc840103ef0 0x7fc84019c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.44:3300/0 says I am v2:172.21.15.44:48196/0 (socket says 172.21.15.44:48196) 2024-05-03T23:01:27.127 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.124+0000 7fc83f400700 1 -- 172.21.15.44:0/3842976518 learned_addr learned my addr 172.21.15.44:0/3842976518 (peer_addr_for_me v2:172.21.15.44:0/0) 2024-05-03T23:01:27.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.124+0000 7fc83fe00700 1 --2- 172.21.15.44:0/3842976518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc840103550 0x7fc84019be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:27.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.124+0000 7fc845200700 1 --2- 172.21.15.44:0/3842976518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc840108460 0x7fc8401a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:27.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.125+0000 7fc83f400700 1 -- 172.21.15.44:0/3842976518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc840103550 msgr2=0x7fc84019be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:27.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.125+0000 7fc83f400700 1 --2- 172.21.15.44:0/3842976518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc840103550 0x7fc84019be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:27.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.125+0000 7fc83f400700 1 -- 172.21.15.44:0/3842976518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc840108460 msgr2=0x7fc8401a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:27.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.125+0000 7fc83f400700 1 --2- 172.21.15.44:0/3842976518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc840108460 0x7fc8401a0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:27.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.125+0000 7fc83f400700 1 -- 172.21.15.44:0/3842976518 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8401a0ea0 con 0x7fc840103ef0 2024-05-03T23:01:27.128 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.125+0000 7fc83f400700 1 --2- 172.21.15.44:0/3842976518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc840103ef0 0x7fc84019c3d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc82c000c00 tx=0x7fc82c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:01:27.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.125+0000 7fc83cc00700 1 -- 172.21.15.44:0/3842976518 <== mon.0 v2:172.21.15.44:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c027070 con 0x7fc840103ef0 2024-05-03T23:01:27.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.126+0000 7fc83cc00700 1 -- 172.21.15.44:0/3842976518 <== mon.0 v2:172.21.15.44:3300/0 2 ==== config(27 keys) ==== 1132+0+0 (secure 0 0 0) 0x7fc82c003f70 con 0x7fc840103ef0 2024-05-03T23:01:27.129 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.126+0000 7fc847200700 1 -- 172.21.15.44:0/3842976518 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8401a1130 con 0x7fc840103ef0 2024-05-03T23:01:27.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.126+0000 7fc83cc00700 1 -- 172.21.15.44:0/3842976518 <== mon.0 v2:172.21.15.44:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c022df0 con 0x7fc840103ef0 2024-05-03T23:01:27.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.126+0000 7fc847200700 1 -- 172.21.15.44:0/3842976518 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8401a8a10 con 0x7fc840103ef0 2024-05-03T23:01:27.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.127+0000 7fc847200700 1 -- 172.21.15.44:0/3842976518 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc84006a190 con 0x7fc840103ef0 2024-05-03T23:01:27.130 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.129+0000 7fc83cc00700 1 -- 172.21.15.44:0/3842976518 <== mon.0 v2:172.21.15.44:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc82c02a070 con 0x7fc840103ef0 2024-05-03T23:01:27.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.131+0000 7fc83cc00700 1 --2- 172.21.15.44:0/3842976518 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc8240b2990 0x7fc8240b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-03T23:01:27.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.131+0000 7fc83cc00700 1 -- 172.21.15.44:0/3842976518 <== mon.0 v2:172.21.15.44:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8496+0+0 (secure 0 0 0) 0x7fc82c0e3a10 con 0x7fc840103ef0 2024-05-03T23:01:27.132 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.131+0000 7fc83fe00700 1 --2- 172.21.15.44:0/3842976518 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc8240b2990 0x7fc8240b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-03T23:01:27.133 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.132+0000 7fc83fe00700 1 --2- 172.21.15.44:0/3842976518 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc8240b2990 0x7fc8240b4e50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc830005950 tx=0x7fc8300058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-03T23:01:27.134 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.133+0000 7fc83cc00700 1 -- 172.21.15.44:0/3842976518 <== mon.0 v2:172.21.15.44:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191839 (secure 0 0 0) 0x7fc82c031020 con 0x7fc840103ef0 2024-05-03T23:01:27.372 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.370+0000 7fc847200700 1 -- 172.21.15.44:0/3842976518 --> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc8401a8be0 con 0x7fc840103ef0 2024-05-03T23:01:27.571 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.569+0000 7fc83cc00700 1 -- 172.21.15.44:0/3842976518 <== mon.0 v2:172.21.15.44:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v93) ==== 178+0+0 (secure 0 0 0) 0x7fc82c013070 con 0x7fc840103ef0 2024-05-03T23:01:27.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.574+0000 7fc847200700 1 -- 172.21.15.44:0/3842976518 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc8240b2990 msgr2=0x7fc8240b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:27.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.574+0000 7fc847200700 1 --2- 172.21.15.44:0/3842976518 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc8240b2990 0x7fc8240b4e50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc830005950 tx=0x7fc8300058e0 comp rx=0 tx=0).stop 2024-05-03T23:01:27.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.575+0000 7fc847200700 1 -- 172.21.15.44:0/3842976518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc840103ef0 msgr2=0x7fc84019c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-03T23:01:27.577 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.575+0000 7fc847200700 1 --2- 172.21.15.44:0/3842976518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc840103ef0 0x7fc84019c3d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc82c000c00 tx=0x7fc82c005ef0 comp rx=0 tx=0).stop 2024-05-03T23:01:27.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.575+0000 7fc847200700 1 -- 172.21.15.44:0/3842976518 shutdown_connections 2024-05-03T23:01:27.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.575+0000 7fc847200700 1 --2- 172.21.15.44:0/3842976518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc840108460 0x7fc8401a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:27.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.575+0000 7fc847200700 1 --2- 172.21.15.44:0/3842976518 >> [v2:172.21.15.44:6800/1796677758,v1:172.21.15.44:6801/1796677758] conn(0x7fc8240b2990 0x7fc8240b4e50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:27.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.575+0000 7fc847200700 1 --2- 172.21.15.44:0/3842976518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc840103550 0x7fc84019be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-03T23:01:27.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.575+0000 7fc847200700 1 --2- 172.21.15.44:0/3842976518 >> [v2:172.21.15.44:3300/0,v1:172.21.15.44:6789/0] conn(0x7fc840103ef0 0x7fc84019c3d0 secure :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc82c000c00 tx=0x7fc82c005ef0 comp rx=0 tx=0).stop 2024-05-03T23:01:27.578 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.575+0000 7fc847200700 1 -- 172.21.15.44:0/3842976518 >> 172.21.15.44:0/3842976518 conn(0x7fc84007a600 msgr2=0x7fc840101420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-03T23:01:27.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.576+0000 7fc847200700 1 -- 172.21.15.44:0/3842976518 shutdown_connections 2024-05-03T23:01:27.579 INFO:teuthology.orchestra.run.smithi044.stderr:2024-05-03T23:01:27.576+0000 7fc847200700 1 -- 172.21.15.44:0/3842976518 wait complete. 2024-05-03T23:01:27.580 INFO:teuthology.orchestra.run.smithi044.stderr:pool 'cephfs_data_ec' removed 2024-05-03T23:01:27.974 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:27 smithi044 ceph-mon[28604]: pgmap v1020: 33 pgs: 33 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T23:01:27.975 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:27 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3842976518' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T23:01:28.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:27 smithi060 ceph-mon[31721]: pgmap v1020: 33 pgs: 33 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T23:01:28.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:27 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3842976518' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T23:01:28.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:27 smithi160 ceph-mon[32531]: pgmap v1020: 33 pgs: 33 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T23:01:28.016 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:27 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3842976518' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-03T23:01:28.425 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-03T23:01:28.522 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-03T23:01:28.622 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-03T23:01:28.718 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-03T23:01:28.719 DEBUG:teuthology.orchestra.run.smithi044:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-03T23:01:28.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:28 smithi044 ceph-mon[28604]: from='client.? 172.21.15.44:0/3842976518' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T23:01:28.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:28 smithi044 ceph-mon[28604]: osdmap e93: 12 total, 12 up, 12 in 2024-05-03T23:01:28.752 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:28 smithi044 ceph-mon[28604]: pgmap v1022: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T23:01:28.779 DEBUG:teuthology.orchestra.run.smithi060:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-03T23:01:28.841 DEBUG:teuthology.orchestra.run.smithi160:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-03T23:01:28.899 INFO:tasks.cephadm:Stopping all daemons... 2024-05-03T23:01:28.900 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-03T23:01:28.900 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mon.a 2024-05-03T23:01:29.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:28 smithi060 ceph-mon[31721]: from='client.? 172.21.15.44:0/3842976518' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T23:01:29.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:28 smithi060 ceph-mon[31721]: osdmap e93: 12 total, 12 up, 12 in 2024-05-03T23:01:29.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:28 smithi060 ceph-mon[31721]: pgmap v1022: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T23:01:29.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:28 smithi160 ceph-mon[32531]: from='client.? 172.21.15.44:0/3842976518' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-05-03T23:01:29.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:28 smithi160 ceph-mon[32531]: osdmap e93: 12 total, 12 up, 12 in 2024-05-03T23:01:29.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:28 smithi160 ceph-mon[32531]: pgmap v1022: 1 pgs: 1 active+clean; 577 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-03T23:01:29.252 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:29 smithi044 systemd[1]: Stopping Ceph mon.a for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:01:30.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:29 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-a[28600]: 2024-05-03T23:01:29.521+0000 7fcc15e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:01:30.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:29 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-a[28600]: 2024-05-03T23:01:29.521+0000 7fcc15e00700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-03T23:01:30.002 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:29 smithi044 podman[93873]: 2024-05-03 23:01:29.738294469 +0000 UTC m=+0.369996018 container died de4db08ce6345c7bd078146653f3a317a3fb794c980d38fb3b956f151ffc69b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-03T23:01:30.478 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:30 smithi044 podman[93873]: 2024-05-03 23:01:30.205361646 +0000 UTC m=+0.837063202 container cleanup de4db08ce6345c7bd078146653f3a317a3fb794c980d38fb3b956f151ffc69b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-a, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux ) 2024-05-03T23:01:30.478 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:30 smithi044 bash[93873]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-a 2024-05-03T23:01:30.751 INFO:journalctl@ceph.mon.a.smithi044.stdout:May 03 23:01:30 smithi044 podman[93887]: 2024-05-03 23:01:30.47586731 +0000 UTC m=+0.722457404 container remove de4db08ce6345c7bd078146653f3a317a3fb794c980d38fb3b956f151ffc69b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-03T23:01:31.056 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mon.a.service' 2024-05-03T23:01:31.184 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:01:31.185 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-03T23:01:31.185 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-03T23:01:31.185 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mon.b 2024-05-03T23:01:31.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:31 smithi060 systemd[1]: Stopping Ceph mon.b for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:01:32.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:31 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-b[31717]: 2024-05-03T23:01:31.769+0000 7fcf36600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:01:32.050 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:31 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-b[31717]: 2024-05-03T23:01:31.769+0000 7fcf36600700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-03T23:01:32.361 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:32 smithi060 podman[67500]: 2024-05-03 23:01:32.048609069 +0000 UTC m=+0.421411456 container died cfdc67598a7c40b73c5d333b8af1665eb1ca9cc707cbd094355e56c1ab55c53b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-b, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-03T23:01:32.949 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:32 smithi060 podman[67500]: 2024-05-03 23:01:32.67876242 +0000 UTC m=+1.051564800 container cleanup cfdc67598a7c40b73c5d333b8af1665eb1ca9cc707cbd094355e56c1ab55c53b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-b, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=) 2024-05-03T23:01:32.949 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:32 smithi060 bash[67500]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-b 2024-05-03T23:01:33.255 INFO:journalctl@ceph.mon.b.smithi060.stdout:May 03 23:01:32 smithi060 podman[67513]: 2024-05-03 23:01:32.947653423 +0000 UTC m=+0.879878067 container remove cfdc67598a7c40b73c5d333b8af1665eb1ca9cc707cbd094355e56c1ab55c53b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-05-03T23:01:33.435 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mon.b.service' 2024-05-03T23:01:33.571 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:01:33.571 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-03T23:01:33.571 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-03T23:01:33.572 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mon.c 2024-05-03T23:01:34.015 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:33 smithi160 systemd[1]: Stopping Ceph mon.c for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:01:34.466 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:34 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-c[32521]: 2024-05-03T23:01:34.174+0000 7f1f76a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:01:34.466 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:34 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-c[32521]: 2024-05-03T23:01:34.174+0000 7f1f76a00700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-03T23:01:34.765 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:34 smithi160 podman[68613]: 2024-05-03 23:01:34.463763236 +0000 UTC m=+0.427442634 container died bfea2da91fd4ba74b4292148e6948a85d582dda2c3095b5f0b590f6fab226f5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T23:01:35.052 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:35 smithi160 podman[68613]: 2024-05-03 23:01:35.020157895 +0000 UTC m=+0.983837313 container cleanup bfea2da91fd4ba74b4292148e6948a85d582dda2c3095b5f0b590f6fab226f5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T23:01:35.052 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:35 smithi160 bash[68613]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-c 2024-05-03T23:01:35.516 INFO:journalctl@ceph.mon.c.smithi160.stdout:May 03 23:01:35 smithi160 podman[68627]: 2024-05-03 23:01:35.255699707 +0000 UTC m=+0.773598469 container remove bfea2da91fd4ba74b4292148e6948a85d582dda2c3095b5f0b590f6fab226f5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mon-c, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T23:01:35.805 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mon.c.service' 2024-05-03T23:01:35.946 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:01:35.946 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-03T23:01:35.947 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-03T23:01:35.947 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mgr.x 2024-05-03T23:01:36.502 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 23:01:36 smithi044 systemd[1]: Stopping Ceph mgr.x for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:01:37.002 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 23:01:36 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x[28840]: 2024-05-03T23:01:36.604+0000 7f0336200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:01:37.002 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 23:01:36 smithi044 podman[93994]: 2024-05-03 23:01:36.697492726 +0000 UTC m=+0.312941258 container died 4867f67c70cc9defc3ba41477d3a7a087f4d7f10eef800081321111b7696f91f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240430) 2024-05-03T23:01:37.476 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 23:01:37 smithi044 podman[93994]: 2024-05-03 23:01:37.197054496 +0000 UTC m=+0.812502966 container cleanup 4867f67c70cc9defc3ba41477d3a7a087f4d7f10eef800081321111b7696f91f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-03T23:01:37.476 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 23:01:37 smithi044 bash[93994]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x 2024-05-03T23:01:37.751 INFO:journalctl@ceph.mgr.x.smithi044.stdout:May 03 23:01:37 smithi044 podman[94008]: 2024-05-03 23:01:37.474016157 +0000 UTC m=+0.765632121 container remove 4867f67c70cc9defc3ba41477d3a7a087f4d7f10eef800081321111b7696f91f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:9a047fe7599a549042d06a3fb5b6813a203eabea, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-x, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5) 2024-05-03T23:01:38.073 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mgr.x.service' 2024-05-03T23:01:38.186 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:01:38.186 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-03T23:01:38.186 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-03T23:01:38.187 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mgr.y 2024-05-03T23:01:38.755 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 23:01:38 smithi060 systemd[1]: Stopping Ceph mgr.y for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:01:39.083 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 23:01:38 smithi060 podman[67637]: 2024-05-03 23:01:38.780544368 +0000 UTC m=+0.208327012 container died 37779647d94c304d1b6baad848e94da400daef1b47f7e773ff0b08245ecab775 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0) 2024-05-03T23:01:39.505 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 23:01:39 smithi060 podman[67637]: 2024-05-03 23:01:39.235810078 +0000 UTC m=+0.663592736 container cleanup 37779647d94c304d1b6baad848e94da400daef1b47f7e773ff0b08245ecab775 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-05-03T23:01:39.505 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 23:01:39 smithi060 bash[67637]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y 2024-05-03T23:01:40.005 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 23:01:39 smithi060 podman[67651]: 2024-05-03 23:01:39.612631999 +0000 UTC m=+0.815458353 container remove 37779647d94c304d1b6baad848e94da400daef1b47f7e773ff0b08245ecab775 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-y, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430) 2024-05-03T23:01:40.005 INFO:journalctl@ceph.mgr.y.smithi060.stdout:May 03 23:01:39 smithi060 systemd[1]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-05-03T23:01:40.188 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mgr.y.service' 2024-05-03T23:01:40.300 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:01:40.300 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-03T23:01:40.301 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-03T23:01:40.301 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mgr.z 2024-05-03T23:01:40.765 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 23:01:40 smithi160 systemd[1]: Stopping Ceph mgr.z for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:01:41.266 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 23:01:41 smithi160 podman[68748]: 2024-05-03 23:01:41.006568781 +0000 UTC m=+0.275606349 container died 3fc33530ccfba8d8ee288d9f8b73de0c311c621b2987e3b0703fe9b21b527206 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T23:01:41.663 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 23:01:41 smithi160 podman[68748]: 2024-05-03 23:01:41.443458219 +0000 UTC m=+0.712495783 container cleanup 3fc33530ccfba8d8ee288d9f8b73de0c311c621b2987e3b0703fe9b21b527206 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS) 2024-05-03T23:01:41.664 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 23:01:41 smithi160 bash[68748]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z 2024-05-03T23:01:42.015 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 23:01:41 smithi160 podman[68762]: 2024-05-03 23:01:41.661722738 +0000 UTC m=+0.641760622 container remove 3fc33530ccfba8d8ee288d9f8b73de0c311c621b2987e3b0703fe9b21b527206 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mgr-z, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-03T23:01:42.015 INFO:journalctl@ceph.mgr.z.smithi160.stdout:May 03 23:01:41 smithi160 systemd[1]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-05-03T23:01:42.138 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mgr.z.service' 2024-05-03T23:01:42.243 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:01:42.244 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-03T23:01:42.244 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-03T23:01:42.244 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.0 2024-05-03T23:01:42.752 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 23:01:42 smithi044 systemd[1]: Stopping Ceph osd.0 for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:01:43.252 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 23:01:42 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-0[43553]: 2024-05-03T23:01:42.842+0000 7fa99c800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:01:43.252 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 23:01:42 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-0[43553]: 2024-05-03T23:01:42.842+0000 7fa99c800700 -1 osd.0 93 *** Got signal Terminated *** 2024-05-03T23:01:43.252 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 23:01:42 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-0[43553]: 2024-05-03T23:01:42.842+0000 7fa99c800700 -1 osd.0 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T23:01:48.735 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 23:01:48 smithi044 podman[94112]: 2024-05-03 23:01:48.372913225 +0000 UTC m=+5.683066557 container died 318e3b36bd1a6613019e5eb388fcddada324cd7a27c3e8bc08ff7a4be1fd9e32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T23:01:49.002 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 23:01:48 smithi044 podman[94112]: 2024-05-03 23:01:48.853134971 +0000 UTC m=+6.163288266 container cleanup 318e3b36bd1a6613019e5eb388fcddada324cd7a27c3e8bc08ff7a4be1fd9e32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-0, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-05-03T23:01:49.002 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 23:01:48 smithi044 bash[94112]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-0 2024-05-03T23:01:49.501 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 23:01:49 smithi044 podman[94144]: 2024-05-03 23:01:49.096088655 +0000 UTC m=+0.709457246 container remove 318e3b36bd1a6613019e5eb388fcddada324cd7a27c3e8bc08ff7a4be1fd9e32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T23:01:50.252 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 23:01:49 smithi044 podman[94234]: 2024-05-03 23:01:49.854613312 +0000 UTC m=+0.038806119 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T23:01:50.252 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 23:01:49 smithi044 podman[94234]: 2024-05-03 23:01:49.989040889 +0000 UTC m=+0.173233703 container create 817d0fd54cdbd5ff8735888951bb6ee7fd90c9d0cc42008e527d7f2b82e9837d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, GIT_CLEAN=True, ceph=True) 2024-05-03T23:01:50.752 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 23:01:50 smithi044 podman[94234]: 2024-05-03 23:01:50.310123743 +0000 UTC m=+0.494316627 container init 817d0fd54cdbd5ff8735888951bb6ee7fd90c9d0cc42008e527d7f2b82e9837d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-03T23:01:50.752 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 23:01:50 smithi044 podman[94234]: 2024-05-03 23:01:50.322076193 +0000 UTC m=+0.506269041 container start 817d0fd54cdbd5ff8735888951bb6ee7fd90c9d0cc42008e527d7f2b82e9837d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-03T23:01:50.752 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 23:01:50 smithi044 podman[94234]: 2024-05-03 23:01:50.416997658 +0000 UTC m=+0.601190546 container attach 817d0fd54cdbd5ff8735888951bb6ee7fd90c9d0cc42008e527d7f2b82e9837d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-03T23:01:51.142 INFO:journalctl@ceph.osd.0.smithi044.stdout:May 03 23:01:50 smithi044 podman[94234]: 2024-05-03 23:01:50.790571374 +0000 UTC m=+0.974764221 container died 817d0fd54cdbd5ff8735888951bb6ee7fd90c9d0cc42008e527d7f2b82e9837d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T23:01:51.529 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.0.service' 2024-05-03T23:01:51.648 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:01:51.648 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-03T23:01:51.648 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-03T23:01:51.649 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.1 2024-05-03T23:01:52.005 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 23:01:51 smithi060 systemd[1]: Stopping Ceph osd.1 for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:01:52.756 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 23:01:52 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-1[36317]: 2024-05-03T23:01:52.255+0000 7f3458c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:01:52.756 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 23:01:52 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-1[36317]: 2024-05-03T23:01:52.255+0000 7f3458c00700 -1 osd.1 93 *** Got signal Terminated *** 2024-05-03T23:01:52.756 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 23:01:52 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-1[36317]: 2024-05-03T23:01:52.255+0000 7f3458c00700 -1 osd.1 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T23:01:58.076 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 23:01:57 smithi060 podman[67761]: 2024-05-03 23:01:57.765405287 +0000 UTC m=+5.642370016 container died 6113c484caf5326c02f9ecb30033f7ebd848a64c83ef2f1fed24aafdf6f43975 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-1, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-03T23:01:58.505 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 23:01:58 smithi060 podman[67761]: 2024-05-03 23:01:58.250363958 +0000 UTC m=+6.127328719 container cleanup 6113c484caf5326c02f9ecb30033f7ebd848a64c83ef2f1fed24aafdf6f43975 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T23:01:58.506 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 23:01:58 smithi060 bash[67761]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-1 2024-05-03T23:01:59.005 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 23:01:58 smithi060 podman[67780]: 2024-05-03 23:01:58.710579268 +0000 UTC m=+0.931927311 container remove 6113c484caf5326c02f9ecb30033f7ebd848a64c83ef2f1fed24aafdf6f43975 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-1, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T23:01:59.464 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 23:01:59 smithi060 podman[67866]: 2024-05-03 23:01:59.204337155 +0000 UTC m=+0.041555899 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T23:01:59.464 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 23:01:59 smithi060 podman[67866]: 2024-05-03 23:01:59.337097281 +0000 UTC m=+0.174316057 container create 930ab4f0655817af648bd5b05753f73dc08eb2947efaf3cfd9b3e2655802c4d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-05-03T23:01:59.755 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 23:01:59 smithi060 podman[67866]: 2024-05-03 23:01:59.607431837 +0000 UTC m=+0.444650620 container init 930ab4f0655817af648bd5b05753f73dc08eb2947efaf3cfd9b3e2655802c4d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-05-03T23:01:59.755 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 23:01:59 smithi060 podman[67866]: 2024-05-03 23:01:59.61788637 +0000 UTC m=+0.455105149 container start 930ab4f0655817af648bd5b05753f73dc08eb2947efaf3cfd9b3e2655802c4d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-1-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-03T23:02:00.084 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 23:01:59 smithi060 podman[67866]: 2024-05-03 23:01:59.756479999 +0000 UTC m=+0.593698799 container attach 930ab4f0655817af648bd5b05753f73dc08eb2947efaf3cfd9b3e2655802c4d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, GIT_CLEAN=True) 2024-05-03T23:02:00.432 INFO:journalctl@ceph.osd.1.smithi060.stdout:May 03 23:02:00 smithi060 podman[67899]: 2024-05-03 23:02:00.144888363 +0000 UTC m=+0.038478137 container died 930ab4f0655817af648bd5b05753f73dc08eb2947efaf3cfd9b3e2655802c4d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-05-03T23:02:00.822 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.1.service' 2024-05-03T23:02:00.928 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:02:00.928 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-03T23:02:00.928 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-03T23:02:00.929 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.2 2024-05-03T23:02:01.265 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 23:02:01 smithi160 systemd[1]: Stopping Ceph osd.2 for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:02:01.969 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 23:02:01 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-2[37736]: 2024-05-03T23:02:01.530+0000 7ffb4b600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:02:01.970 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 23:02:01 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-2[37736]: 2024-05-03T23:02:01.530+0000 7ffb4b600700 -1 osd.2 93 *** Got signal Terminated *** 2024-05-03T23:02:01.970 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 23:02:01 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-2[37736]: 2024-05-03T23:02:01.530+0000 7ffb4b600700 -1 osd.2 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T23:02:07.249 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 23:02:06 smithi160 podman[68875]: 2024-05-03 23:02:06.944299281 +0000 UTC m=+5.594006744 container died eddd156b5c6f1b84766cec477f6e51808ddad4e2e891003ef4045ee5c6fd9b86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-03T23:02:07.515 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 23:02:07 smithi160 podman[68875]: 2024-05-03 23:02:07.391627305 +0000 UTC m=+6.041334785 container cleanup eddd156b5c6f1b84766cec477f6e51808ddad4e2e891003ef4045ee5c6fd9b86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-03T23:02:07.516 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 23:02:07 smithi160 bash[68875]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-2 2024-05-03T23:02:08.015 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 23:02:07 smithi160 podman[68906]: 2024-05-03 23:02:07.652074634 +0000 UTC m=+0.693553379 container remove eddd156b5c6f1b84766cec477f6e51808ddad4e2e891003ef4045ee5c6fd9b86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-2, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS) 2024-05-03T23:02:08.735 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 23:02:08 smithi160 podman[68998]: 2024-05-03 23:02:08.328908082 +0000 UTC m=+0.041117590 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T23:02:08.735 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 23:02:08 smithi160 podman[68998]: 2024-05-03 23:02:08.45325271 +0000 UTC m=+0.165462195 container create 799ef9ae10f6540b1ebbe0795c3366772d27653af16f09972595015952aac04d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-03T23:02:09.016 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 23:02:08 smithi160 podman[68998]: 2024-05-03 23:02:08.732901374 +0000 UTC m=+0.445110865 container init 799ef9ae10f6540b1ebbe0795c3366772d27653af16f09972595015952aac04d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux ) 2024-05-03T23:02:09.016 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 23:02:08 smithi160 podman[68998]: 2024-05-03 23:02:08.744841348 +0000 UTC m=+0.457050840 container start 799ef9ae10f6540b1ebbe0795c3366772d27653af16f09972595015952aac04d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-03T23:02:09.016 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 23:02:08 smithi160 podman[68998]: 2024-05-03 23:02:08.839817685 +0000 UTC m=+0.552027180 container attach 799ef9ae10f6540b1ebbe0795c3366772d27653af16f09972595015952aac04d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T23:02:09.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:09 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:09.163+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:09.515 INFO:journalctl@ceph.osd.2.smithi160.stdout:May 03 23:02:09 smithi160 podman[68998]: 2024-05-03 23:02:09.19252619 +0000 UTC m=+0.904735729 container died 799ef9ae10f6540b1ebbe0795c3366772d27653af16f09972595015952aac04d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-03T23:02:09.933 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.2.service' 2024-05-03T23:02:10.037 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:02:10.037 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-03T23:02:10.038 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-03T23:02:10.038 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.3 2024-05-03T23:02:10.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:09 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:09.819+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:10.502 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 23:02:10 smithi044 systemd[1]: Stopping Ceph osd.3 for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:02:10.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:10 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:10.215+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:10.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:10 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:10.162+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:11.002 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 23:02:10 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-3[50497]: 2024-05-03T23:02:10.655+0000 7f9f80c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:02:11.002 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 23:02:10 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-3[50497]: 2024-05-03T23:02:10.655+0000 7f9f80c00700 -1 osd.3 93 *** Got signal Terminated *** 2024-05-03T23:02:11.002 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 23:02:10 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-3[50497]: 2024-05-03T23:02:10.655+0000 7f9f80c00700 -1 osd.3 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T23:02:11.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:10 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:10.813+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:11.501 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:11 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:11.169+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:11.504 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:11.153+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:12.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:11 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:11.862+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:12.501 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:12 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:12.213+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:12.504 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:12 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:12.164+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:13.001 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 23:02:12 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-3[50497]: 2024-05-03T23:02:12.510+0000 7f9f77400700 -1 osd.3 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:46.418004+0000 front 2024-05-03T23:01:46.418086+0000 (oldest deadline 2024-05-03T23:02:12.318264+0000) 2024-05-03T23:02:13.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:12 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:12.868+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:13.501 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:13 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:13.236+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:13.504 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:13 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:13.139+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:14.001 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 23:02:13 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-3[50497]: 2024-05-03T23:02:13.515+0000 7f9f77400700 -1 osd.3 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:46.418004+0000 front 2024-05-03T23:01:46.418086+0000 (oldest deadline 2024-05-03T23:02:12.318264+0000) 2024-05-03T23:02:14.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:13 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:13.884+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:14.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:14 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:14.246+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:14.502 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 23:02:14 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-3[50497]: 2024-05-03T23:02:14.473+0000 7f9f77400700 -1 osd.3 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:46.418004+0000 front 2024-05-03T23:01:46.418086+0000 (oldest deadline 2024-05-03T23:02:12.318264+0000) 2024-05-03T23:02:14.504 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:14 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:14.090+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:15.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:14 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:14.888+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:15.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:15 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:15.120+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:15.752 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 23:02:15 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-3[50497]: 2024-05-03T23:02:15.440+0000 7f9f77400700 -1 osd.3 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:46.418004+0000 front 2024-05-03T23:01:46.418086+0000 (oldest deadline 2024-05-03T23:02:12.318264+0000) 2024-05-03T23:02:15.752 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:15 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:15.259+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:16.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:15 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:15.892+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:16.480 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:16 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:16.251+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:16.480 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 23:02:16 smithi044 podman[94339]: 2024-05-03 23:02:16.151469688 +0000 UTC m=+5.648093552 container died 74c24d9d1c1060357bd1d4c4fb4a7250bbfc9fbd58af7894d8433acbe8d86871 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-3, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-03T23:02:16.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:16 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:16.072+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:16.752 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 23:02:16 smithi044 podman[94339]: 2024-05-03 23:02:16.573935201 +0000 UTC m=+6.070559115 container cleanup 74c24d9d1c1060357bd1d4c4fb4a7250bbfc9fbd58af7894d8433acbe8d86871 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-3, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-05-03T23:02:16.752 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 23:02:16 smithi044 bash[94339]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-3 2024-05-03T23:02:17.244 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 23:02:16 smithi044 podman[94358]: 2024-05-03 23:02:16.883572843 +0000 UTC m=+0.723560276 container remove 74c24d9d1c1060357bd1d4c4fb4a7250bbfc9fbd58af7894d8433acbe8d86871 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T23:02:17.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:16 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:16.853+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:17.501 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:17 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:17.240+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:17.504 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:17 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:17.081+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:18.066 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 23:02:17 smithi044 podman[94444]: 2024-05-03 23:02:17.659208776 +0000 UTC m=+0.036326054 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T23:02:18.066 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 23:02:17 smithi044 podman[94444]: 2024-05-03 23:02:17.79063432 +0000 UTC m=+0.167751620 container create 070afb86c5b2ee86e456eb03f3d8fb77f53a4ba5f414e321ec031b2e60a70fbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-03T23:02:18.066 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 23:02:18 smithi044 podman[94444]: 2024-05-03 23:02:18.063577932 +0000 UTC m=+0.440695253 container init 070afb86c5b2ee86e456eb03f3d8fb77f53a4ba5f414e321ec031b2e60a70fbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS) 2024-05-03T23:02:18.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:17 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:17.861+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:18.501 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:18 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:18.259+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:18.502 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 23:02:18 smithi044 podman[94444]: 2024-05-03 23:02:18.075543281 +0000 UTC m=+0.452660582 container start 070afb86c5b2ee86e456eb03f3d8fb77f53a4ba5f414e321ec031b2e60a70fbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2) 2024-05-03T23:02:18.502 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 23:02:18 smithi044 podman[94444]: 2024-05-03 23:02:18.179127398 +0000 UTC m=+0.556244756 container attach 070afb86c5b2ee86e456eb03f3d8fb77f53a4ba5f414e321ec031b2e60a70fbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T23:02:18.504 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:18 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:18.079+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:18.907 INFO:journalctl@ceph.osd.3.smithi044.stdout:May 03 23:02:18 smithi044 podman[94444]: 2024-05-03 23:02:18.558321885 +0000 UTC m=+0.935439207 container died 070afb86c5b2ee86e456eb03f3d8fb77f53a4ba5f414e321ec031b2e60a70fbb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-3-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T23:02:19.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:18 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:18.865+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:19.016 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:18 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:18.629+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:52.747545+0000 front 2024-05-03T23:01:52.747753+0000 (oldest deadline 2024-05-03T23:02:18.047633+0000) 2024-05-03T23:02:19.331 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.3.service' 2024-05-03T23:02:19.448 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:02:19.448 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-03T23:02:19.448 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-03T23:02:19.449 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.4 2024-05-03T23:02:19.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:19 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:19.111+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:19.751 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:19 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:19.254+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:19.883 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 23:02:19 smithi060 systemd[1]: Stopping Ceph osd.4 for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:02:20.015 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:19 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:19.675+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:52.747545+0000 front 2024-05-03T23:01:52.747753+0000 (oldest deadline 2024-05-03T23:02:18.047633+0000) 2024-05-03T23:02:20.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:19 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:19.876+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:20.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:19 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:19.876+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:20.154 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:19 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:19.882+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:20.155 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 23:02:20 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-4[43103]: 2024-05-03T23:02:20.013+0000 7f3ff2800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:02:20.155 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 23:02:20 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-4[43103]: 2024-05-03T23:02:20.013+0000 7f3ff2800700 -1 osd.4 93 *** Got signal Terminated *** 2024-05-03T23:02:20.155 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 23:02:20 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-4[43103]: 2024-05-03T23:02:20.013+0000 7f3ff2800700 -1 osd.4 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T23:02:20.155 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 23:02:20 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-4[43103]: 2024-05-03T23:02:20.015+0000 7f3fe9000700 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:54.981620+0000 front 2024-05-03T23:01:54.981872+0000 (oldest deadline 2024-05-03T23:02:19.681434+0000) 2024-05-03T23:02:20.501 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:20 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:20.230+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:20.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:20 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:20.427+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:20.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:20 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:20.153+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:20.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:20 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:20.153+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:21.015 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:20 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:20.625+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:52.747545+0000 front 2024-05-03T23:01:52.747753+0000 (oldest deadline 2024-05-03T23:02:18.047633+0000) 2024-05-03T23:02:21.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:20 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:20.858+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:21.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:20 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:20.858+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:21.187 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 23:02:21 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-4[43103]: 2024-05-03T23:02:21.025+0000 7f3fe9000700 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:54.981620+0000 front 2024-05-03T23:01:54.981872+0000 (oldest deadline 2024-05-03T23:02:19.681434+0000) 2024-05-03T23:02:21.188 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:20 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:20.873+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:21.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:21 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:21.208+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:21.503 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:21 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:21.395+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:21.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:21 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:21.185+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:21.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:21 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:21.185+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:22.015 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:21 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:21.597+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:52.747545+0000 front 2024-05-03T23:01:52.747753+0000 (oldest deadline 2024-05-03T23:02:18.047633+0000) 2024-05-03T23:02:22.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:21 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:21.824+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:22.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:21 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:21.824+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:22.215 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 23:02:22 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-4[43103]: 2024-05-03T23:02:22.036+0000 7f3fe9000700 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:54.981620+0000 front 2024-05-03T23:01:54.981872+0000 (oldest deadline 2024-05-03T23:02:19.681434+0000) 2024-05-03T23:02:22.216 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:21 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:21.840+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:22.442 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:22 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:22.163+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:22.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:22 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:22.214+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:22.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:22 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:22.214+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:22.751 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:22 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:22.440+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:23.015 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:22 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:22.562+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:52.747545+0000 front 2024-05-03T23:01:52.747753+0000 (oldest deadline 2024-05-03T23:02:18.047633+0000) 2024-05-03T23:02:23.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:22 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:22.775+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:23.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:22 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:22.775+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:23.227 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:22 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:22.867+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:23.228 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 23:02:23 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-4[43103]: 2024-05-03T23:02:23.025+0000 7f3fe9000700 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:54.981620+0000 front 2024-05-03T23:01:54.981872+0000 (oldest deadline 2024-05-03T23:02:19.681434+0000) 2024-05-03T23:02:23.501 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:23 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:23.416+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:23.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:23 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:23.179+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:23.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:23 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:23.179+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:23.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:23 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:23.226+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:23.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:23 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:23.226+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:23.765 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:23 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:23.520+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:52.747545+0000 front 2024-05-03T23:01:52.747753+0000 (oldest deadline 2024-05-03T23:02:18.047633+0000) 2024-05-03T23:02:23.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:23 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:23.469+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:24.207 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:23 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:23.818+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:24.208 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 23:02:24 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-4[43103]: 2024-05-03T23:02:24.063+0000 7f3fe9000700 -1 osd.4 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:54.981620+0000 front 2024-05-03T23:01:54.981872+0000 (oldest deadline 2024-05-03T23:02:19.681434+0000) 2024-05-03T23:02:24.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:23 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:23.776+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:24.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:23 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:23.776+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:24.501 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:24 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:24.404+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:24.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:24 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:24.204+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:24.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:24 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:24.204+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:24.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:24 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:24.206+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:24.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:24 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:24.206+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:24.759 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:24 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:24.549+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:52.747545+0000 front 2024-05-03T23:01:52.747753+0000 (oldest deadline 2024-05-03T23:02:18.047633+0000) 2024-05-03T23:02:24.760 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:24 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:24.489+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:25.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:24 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:24.757+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:25.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:24 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:24.757+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:25.250 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:24 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:24.774+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:25.501 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:25 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:25.387+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:25.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:25 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:25.162+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:25.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:25 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:25.162+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:25.505 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 23:02:25 smithi060 podman[67983]: 2024-05-03 23:02:25.38056064 +0000 UTC m=+5.511028203 container died d54263ce383093f41d353ad057d9b1e48a5bd7b89eacfd723232d0ebab4dc4d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2) 2024-05-03T23:02:25.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:25 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:25.249+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:25.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:25 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:25.249+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:25.743 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:25 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:25.483+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:25.743 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:25 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:25.548+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:52.747545+0000 front 2024-05-03T23:01:52.747753+0000 (oldest deadline 2024-05-03T23:02:18.047633+0000) 2024-05-03T23:02:26.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:25 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:25.741+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:26.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:25 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:25.741+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:26.184 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:25 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:25.755+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:26.185 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 23:02:25 smithi060 podman[67983]: 2024-05-03 23:02:25.948137679 +0000 UTC m=+6.078605305 container cleanup d54263ce383093f41d353ad057d9b1e48a5bd7b89eacfd723232d0ebab4dc4d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-4, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T23:02:26.185 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 23:02:25 smithi060 bash[67983]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-4 2024-05-03T23:02:26.501 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:26 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:26.354+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:26.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:26 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:26.158+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:26.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:26 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:26.158+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:26.504 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:26 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:26.270+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:26.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:26 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:26.270+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:26.505 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 23:02:26 smithi060 podman[67999]: 2024-05-03 23:02:26.182643276 +0000 UTC m=+0.786540662 container remove d54263ce383093f41d353ad057d9b1e48a5bd7b89eacfd723232d0ebab4dc4d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240430, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T23:02:26.700 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:26 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:26.592+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:52.747545+0000 front 2024-05-03T23:01:52.747753+0000 (oldest deadline 2024-05-03T23:02:18.047633+0000) 2024-05-03T23:02:26.700 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:26 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:26.435+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:27.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:26 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:26.698+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:27.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:26 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:26.698+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:27.076 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:26 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:26.757+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:27.406 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:27 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:27.299+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:27.406 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:27 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:27.299+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:27.406 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:27 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:27.299+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:27.406 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 23:02:27 smithi060 podman[68088]: 2024-05-03 23:02:26.981945889 +0000 UTC m=+0.037996621 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T23:02:27.406 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 23:02:27 smithi060 podman[68088]: 2024-05-03 23:02:27.125819062 +0000 UTC m=+0.181869850 container create cc176785f4fd6b38dd5f9c7dfc85effd6d5ca5c74fdccb81046c16ab8d286063 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-03T23:02:27.407 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 23:02:27 smithi060 podman[68088]: 2024-05-03 23:02:27.40440075 +0000 UTC m=+0.460451501 container init cc176785f4fd6b38dd5f9c7dfc85effd6d5ca5c74fdccb81046c16ab8d286063 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-4-deactivate, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T23:02:27.501 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:27 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:27.334+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:27.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:27 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:27.135+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:27.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:27 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:27.135+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:27.755 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 23:02:27 smithi060 podman[68088]: 2024-05-03 23:02:27.416555247 +0000 UTC m=+0.472606022 container start cc176785f4fd6b38dd5f9c7dfc85effd6d5ca5c74fdccb81046c16ab8d286063 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T23:02:27.755 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 23:02:27 smithi060 podman[68088]: 2024-05-03 23:02:27.511693783 +0000 UTC m=+0.567744565 container attach cc176785f4fd6b38dd5f9c7dfc85effd6d5ca5c74fdccb81046c16ab8d286063 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T23:02:27.765 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:27 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:27.481+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:27.765 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:27 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:27.620+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:52.747545+0000 front 2024-05-03T23:01:52.747753+0000 (oldest deadline 2024-05-03T23:02:18.047633+0000) 2024-05-03T23:02:27.765 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:27 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:27.621+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.651317+0000 front 2024-05-03T23:02:05.651237+0000 (oldest deadline 2024-05-03T23:02:27.351559+0000) 2024-05-03T23:02:27.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:27 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:27.730+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:27.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:27 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:27.730+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:27.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:27 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:27.730+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:28.255 INFO:journalctl@ceph.osd.4.smithi060.stdout:May 03 23:02:27 smithi060 podman[68088]: 2024-05-03 23:02:27.886282373 +0000 UTC m=+0.942333125 container died cc176785f4fd6b38dd5f9c7dfc85effd6d5ca5c74fdccb81046c16ab8d286063 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-05-03T23:02:28.256 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:27 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:27.788+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:28.501 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:28 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:28.187+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:28.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:28 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:28.187+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:28.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:28 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:28.187+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:02.411382+0000 front 2024-05-03T23:02:02.411514+0000 (oldest deadline 2024-05-03T23:02:27.711611+0000) 2024-05-03T23:02:28.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:28 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:28.351+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:28.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:28 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:28.351+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:28.625 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:28 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:28.266+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:28.625 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:28 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:28.266+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:28.625 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:28 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:28.266+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:28.670 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.4.service' 2024-05-03T23:02:28.765 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:28 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:28.505+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:28.766 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:28 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:28.586+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:52.747545+0000 front 2024-05-03T23:01:52.747753+0000 (oldest deadline 2024-05-03T23:02:18.047633+0000) 2024-05-03T23:02:28.766 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:28 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:28.586+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.651317+0000 front 2024-05-03T23:02:05.651237+0000 (oldest deadline 2024-05-03T23:02:27.351559+0000) 2024-05-03T23:02:28.782 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:02:28.782 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-03T23:02:28.782 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-03T23:02:28.783 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.5 2024-05-03T23:02:28.880 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:28 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:28.796+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:28.880 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:28 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:28.796+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:29.265 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:28 smithi160 systemd[1]: Stopping Ceph osd.5 for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:02:29.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:28 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:28.776+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:29.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:28 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:28.776+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:29.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:28 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:28.776+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:29.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:29 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:29.344+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:29.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:29 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:29.345+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:29.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:29 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:29.227+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:29.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:29 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:29.227+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:29.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:29 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:29.227+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:02.411382+0000 front 2024-05-03T23:02:02.411514+0000 (oldest deadline 2024-05-03T23:02:27.711611+0000) 2024-05-03T23:02:29.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:29 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:29.218+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:29.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:29 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:29.218+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:29.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:29 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:29.218+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:29.636 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:29 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:29.481+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:29.637 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:29 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:29.382+0000 7fbdf4200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:02:29.637 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:29 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:29.382+0000 7fbdf4200700 -1 osd.5 93 *** Got signal Terminated *** 2024-05-03T23:02:29.637 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:29 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:29.382+0000 7fbdf4200700 -1 osd.5 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T23:02:29.637 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:29 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:29.633+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:52.747545+0000 front 2024-05-03T23:01:52.747753+0000 (oldest deadline 2024-05-03T23:02:18.047633+0000) 2024-05-03T23:02:29.637 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:29 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:29.633+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.651317+0000 front 2024-05-03T23:02:05.651237+0000 (oldest deadline 2024-05-03T23:02:27.351559+0000) 2024-05-03T23:02:30.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:29 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:29.815+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:30.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:29 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:29.815+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:30.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:29 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:29.815+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:30.214 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:29 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:29.760+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:30.215 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:29 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:29.760+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:30.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:30 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:30.346+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:30.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:30 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:30.347+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:30.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:30 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:30.190+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:30.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:30 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:30.190+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:30.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:30 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:30.191+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:02.411382+0000 front 2024-05-03T23:02:02.411514+0000 (oldest deadline 2024-05-03T23:02:27.711611+0000) 2024-05-03T23:02:30.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:30 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:30.212+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:30.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:30 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:30.212+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:30.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:30 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:30.212+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:30.765 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:30 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:30.637+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:52.747545+0000 front 2024-05-03T23:01:52.747753+0000 (oldest deadline 2024-05-03T23:02:18.047633+0000) 2024-05-03T23:02:30.766 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:30 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:30.637+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.651317+0000 front 2024-05-03T23:02:05.651237+0000 (oldest deadline 2024-05-03T23:02:27.351559+0000) 2024-05-03T23:02:30.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:30 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:30.449+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:30.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:30 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:30.449+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:31.005 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:30 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:30.739+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:31.005 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:30 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:30.739+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:31.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:30 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:30.816+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:31.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:30 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:30.816+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:31.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:30 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:30.816+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:31.501 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:31 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:31.311+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:31.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:31 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:31.311+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:31.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:31 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:31.147+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:31.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:31 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:31.147+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:31.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:31 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:31.147+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:02.411382+0000 front 2024-05-03T23:02:02.411514+0000 (oldest deadline 2024-05-03T23:02:27.711611+0000) 2024-05-03T23:02:31.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:31 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:31.214+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:31.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:31 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:31.214+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:31.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:31 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:31.214+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:31.627 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:31 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:31.476+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:31.628 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:31 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:31.476+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:31.960 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:31 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:31.625+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:52.747545+0000 front 2024-05-03T23:01:52.747753+0000 (oldest deadline 2024-05-03T23:02:18.047633+0000) 2024-05-03T23:02:31.960 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:31 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:31.625+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.651317+0000 front 2024-05-03T23:02:05.651237+0000 (oldest deadline 2024-05-03T23:02:27.351559+0000) 2024-05-03T23:02:31.960 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:31 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:31.775+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:31.960 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:31 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:31.775+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:31.961 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:31 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:31.775+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:32.255 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:31 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:31.753+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:32.255 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:31 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:31.753+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:32.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:32 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:32.305+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:32.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:32 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:32.305+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:32.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:32 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:32.099+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:32.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:32 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:32.099+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:32.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:32 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:32.099+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:02.411382+0000 front 2024-05-03T23:02:02.411514+0000 (oldest deadline 2024-05-03T23:02:27.711611+0000) 2024-05-03T23:02:32.733 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:32 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:32.260+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:32.733 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:32 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:32.260+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:32.733 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:32 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:32.260+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:32.739 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:32 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:32.464+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:32.739 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:32 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:32.464+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:32.739 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:32 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:32.671+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:52.747545+0000 front 2024-05-03T23:01:52.747753+0000 (oldest deadline 2024-05-03T23:02:18.047633+0000) 2024-05-03T23:02:32.739 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:32 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:32.671+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.651317+0000 front 2024-05-03T23:02:05.651237+0000 (oldest deadline 2024-05-03T23:02:27.351559+0000) 2024-05-03T23:02:33.005 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:32 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:32.730+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:33.005 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:32 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:32.730+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:33.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:32 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:32.736+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:33.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:32 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:32.736+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:33.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:32 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:32.736+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:33.503 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:33 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:33.269+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:33.503 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:33 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:33.269+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:33.504 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:33 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:33.106+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:33.504 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:33 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:33.106+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:33.504 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:33 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:33.106+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:02.411382+0000 front 2024-05-03T23:02:02.411514+0000 (oldest deadline 2024-05-03T23:02:27.711611+0000) 2024-05-03T23:02:33.730 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:33 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:33.659+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:52.747545+0000 front 2024-05-03T23:01:52.747753+0000 (oldest deadline 2024-05-03T23:02:18.047633+0000) 2024-05-03T23:02:33.730 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:33 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5[44477]: 2024-05-03T23:02:33.659+0000 7fbdeaa00700 -1 osd.5 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.651317+0000 front 2024-05-03T23:02:05.651237+0000 (oldest deadline 2024-05-03T23:02:27.351559+0000) 2024-05-03T23:02:33.730 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:33 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:33.425+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:33.730 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:33 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:33.425+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:33.755 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:33 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:33.272+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:33.755 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:33 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:33.272+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:33.755 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:33 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:33.272+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:34.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:33 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:33.727+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:34.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:33 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:33.727+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:34.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:33 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:33.727+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:34.238 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:33 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:33.770+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:34.238 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:33 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:33.770+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:34.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:34 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:34.318+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:34.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:34 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:34.318+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:34.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:34 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:34.123+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:34.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:34 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:34.123+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:34.503 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:34 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:34.124+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:02.411382+0000 front 2024-05-03T23:02:02.411514+0000 (oldest deadline 2024-05-03T23:02:27.711611+0000) 2024-05-03T23:02:34.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:34 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:34.235+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:34.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:34 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:34.235+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:34.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:34 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:34.235+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:34.696 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:34 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:34.393+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:34.697 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:34 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:34.393+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:35.015 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:34 smithi160 podman[69101]: 2024-05-03 23:02:34.835879403 +0000 UTC m=+5.634624522 container died 1697cffc01159b97d1bfcfb6cf50aa48954ee9371a033200cd7e7ae0116d2870 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T23:02:35.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:34 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:34.694+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:35.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:34 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:34.694+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:35.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:34 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:34.694+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:35.191 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:34 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:34.777+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:35.191 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:34 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:34.777+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:35.501 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:35 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:35.269+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:35.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:35 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:35.269+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:35.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:35 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:35.143+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:35.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:35 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:35.143+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:35.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:35 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:35.143+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:02.411382+0000 front 2024-05-03T23:02:02.411514+0000 (oldest deadline 2024-05-03T23:02:27.711611+0000) 2024-05-03T23:02:35.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:35 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:35.188+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:35.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:35 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:35.188+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:35.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:35 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:35.188+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:35.515 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:35 smithi160 podman[69101]: 2024-05-03 23:02:35.304779313 +0000 UTC m=+6.103524428 container cleanup 1697cffc01159b97d1bfcfb6cf50aa48954ee9371a033200cd7e7ae0116d2870 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T23:02:35.516 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:35 smithi160 bash[69101]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5 2024-05-03T23:02:35.516 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:35 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:35.421+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:35.516 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:35 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:35.421+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:36.005 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:35 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:35.752+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:36.005 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:35 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:35.752+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:36.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:35 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:35.712+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:36.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:35 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:35.712+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:36.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:35 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:35.712+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:36.016 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:35 smithi160 podman[69132]: 2024-05-03 23:02:35.539408919 +0000 UTC m=+0.697442691 container remove 1697cffc01159b97d1bfcfb6cf50aa48954ee9371a033200cd7e7ae0116d2870 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T23:02:36.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:36 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:36.224+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:36.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:36 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:36.224+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:36.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:36 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:36.176+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:36.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:36 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:36.176+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:36.503 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:36 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:36.176+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:02.411382+0000 front 2024-05-03T23:02:02.411514+0000 (oldest deadline 2024-05-03T23:02:27.711611+0000) 2024-05-03T23:02:36.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:36 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:36.183+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:36.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:36 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:36.183+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:36.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:36 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:36.183+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:36.704 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:36 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:36.461+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:36.704 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:36 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:36.461+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:36.705 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:36 smithi160 podman[69219]: 2024-05-03 23:02:36.289906703 +0000 UTC m=+0.038587326 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T23:02:36.705 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:36 smithi160 podman[69219]: 2024-05-03 23:02:36.406993499 +0000 UTC m=+0.155674130 container create 03decaefb21fc7e56f6c78baea6393a4a2ae6abbded5a31d474ed9bdfce01fe6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T23:02:37.016 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:36 smithi160 podman[69219]: 2024-05-03 23:02:36.702452935 +0000 UTC m=+0.451133610 container init 03decaefb21fc7e56f6c78baea6393a4a2ae6abbded5a31d474ed9bdfce01fe6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T23:02:37.016 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:36 smithi160 podman[69219]: 2024-05-03 23:02:36.714022095 +0000 UTC m=+0.462702696 container start 03decaefb21fc7e56f6c78baea6393a4a2ae6abbded5a31d474ed9bdfce01fe6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5) 2024-05-03T23:02:37.016 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:36 smithi160 podman[69219]: 2024-05-03 23:02:36.801158024 +0000 UTC m=+0.549838662 container attach 03decaefb21fc7e56f6c78baea6393a4a2ae6abbded5a31d474ed9bdfce01fe6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True) 2024-05-03T23:02:37.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:36 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:36.733+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:37.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:36 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:36.733+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:37.017 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:36 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:36.733+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:37.164 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:36 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:36.772+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:37.164 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:36 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:36.772+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:37.165 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:36 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:36.772+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.419072+0000 front 2024-05-03T23:02:14.418629+0000 (oldest deadline 2024-05-03T23:02:36.619298+0000) 2024-05-03T23:02:37.501 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:37 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:37.256+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:37.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:37 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:37.256+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:37.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:37 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:37.175+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:37.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:37 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:37.175+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:37.503 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:37 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:37.175+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:02.411382+0000 front 2024-05-03T23:02:02.411514+0000 (oldest deadline 2024-05-03T23:02:27.711611+0000) 2024-05-03T23:02:37.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:37 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:37.161+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:37.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:37 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:37.161+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:37.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:37 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:37.161+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:37.512 INFO:journalctl@ceph.osd.5.smithi160.stdout:May 03 23:02:37 smithi160 podman[69219]: 2024-05-03 23:02:37.169660137 +0000 UTC m=+0.918340775 container died 03decaefb21fc7e56f6c78baea6393a4a2ae6abbded5a31d474ed9bdfce01fe6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-03T23:02:37.765 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:37 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:37.510+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:37.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:37 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:37.510+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:38.049 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:37 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:37.781+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:38.049 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:37 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:37.781+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:38.049 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:37 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:37.781+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:38.099 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.5.service' 2024-05-03T23:02:38.169 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:37 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:37.796+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:38.169 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:37 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:37.796+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:38.169 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:37 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:37.796+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.419072+0000 front 2024-05-03T23:02:14.418629+0000 (oldest deadline 2024-05-03T23:02:36.619298+0000) 2024-05-03T23:02:38.203 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:02:38.204 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-03T23:02:38.204 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-03T23:02:38.204 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.6 2024-05-03T23:02:38.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:38.282+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:38.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:38.282+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:38.503 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:38.282+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:38.503 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:38.178+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:38.503 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:38.178+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:38.503 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:38.178+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:02.411382+0000 front 2024-05-03T23:02:02.411514+0000 (oldest deadline 2024-05-03T23:02:27.711611+0000) 2024-05-03T23:02:38.503 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:38 smithi044 systemd[1]: Stopping Ceph osd.6 for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:02:38.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:38 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:38.166+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:38.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:38 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:38.166+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:38.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:38 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:38.166+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:38.765 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:38 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:38.488+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:38.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:38 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:38.488+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:39.162 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:38.802+0000 7f749d000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:02:39.162 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:38.802+0000 7f749d000700 -1 osd.6 93 *** Got signal Terminated *** 2024-05-03T23:02:39.162 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:38 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:38.802+0000 7f749d000700 -1 osd.6 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T23:02:39.162 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:39 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:39.159+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:39.163 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:39 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:39.159+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:39.183 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:38 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:38.817+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:39.183 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:38 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:38.817+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:39.183 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:38 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:38.817+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.419072+0000 front 2024-05-03T23:02:14.418629+0000 (oldest deadline 2024-05-03T23:02:36.619298+0000) 2024-05-03T23:02:39.225 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:38 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:38.792+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:39.225 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:38 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:38.792+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:39.225 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:38 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:38.792+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:39.501 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:39 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:39.159+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:02.411382+0000 front 2024-05-03T23:02:02.411514+0000 (oldest deadline 2024-05-03T23:02:27.711611+0000) 2024-05-03T23:02:39.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:39 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:39.159+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.114884+0000 front 2024-05-03T23:02:14.114935+0000 (oldest deadline 2024-05-03T23:02:38.814920+0000) 2024-05-03T23:02:39.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:39 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:39.300+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:39.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:39 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:39.300+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:39.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:39 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:39.300+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:39.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:39 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:39.180+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:39.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:39 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:39.180+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:39.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:39 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:39.180+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:39.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:39 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:39.180+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:39.765 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:39 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:39.479+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:39.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:39 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:39.479+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:40.149 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:39 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:39.863+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:40.149 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:39 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:39.863+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:40.149 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:39 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:39.863+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.419072+0000 front 2024-05-03T23:02:14.418629+0000 (oldest deadline 2024-05-03T23:02:36.619298+0000) 2024-05-03T23:02:40.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:39 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:39.764+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:40.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:39 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:39.764+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:40.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:39 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:39.764+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:40.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:40 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:40.268+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:40.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:40 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:40.268+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:40.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:40 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:40.268+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:40.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:40 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:40.132+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:40.503 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:40 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:40.132+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:40.503 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:40 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:40.132+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:02.411382+0000 front 2024-05-03T23:02:02.411514+0000 (oldest deadline 2024-05-03T23:02:27.711611+0000) 2024-05-03T23:02:40.503 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:40 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:40.132+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.114884+0000 front 2024-05-03T23:02:14.114935+0000 (oldest deadline 2024-05-03T23:02:38.814920+0000) 2024-05-03T23:02:40.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:40 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:40.146+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:40.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:40 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:40.146+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:40.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:40 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:40.146+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:40.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:40 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:40.146+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:40.765 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:40 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:40.729+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:40.765 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:40 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:40.729+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:40.765 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:40 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:40.729+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:40.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:40 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:40.481+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:40.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:40 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:40.481+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:40.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:40 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:40.481+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:41.255 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:40 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:40.899+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:41.255 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:40 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:40.899+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:41.256 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:40 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:40.899+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.419072+0000 front 2024-05-03T23:02:14.418629+0000 (oldest deadline 2024-05-03T23:02:36.619298+0000) 2024-05-03T23:02:41.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:41 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:41.111+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:41.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:41 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:41.111+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:41.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:41 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:41.111+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:41.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:41 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:41.111+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:41.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:41 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:41.305+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:41.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:41 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:41.305+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:41.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:41 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:41.305+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:41.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:41 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:41.120+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:41.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:41 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:41.120+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:41.503 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:41 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:41.120+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:02.411382+0000 front 2024-05-03T23:02:02.411514+0000 (oldest deadline 2024-05-03T23:02:27.711611+0000) 2024-05-03T23:02:41.503 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:41 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:41.120+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.114884+0000 front 2024-05-03T23:02:14.114935+0000 (oldest deadline 2024-05-03T23:02:38.814920+0000) 2024-05-03T23:02:41.765 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:41 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:41.480+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:41.765 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:41 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:41.480+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:41.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:41 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:41.480+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:42.255 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:41 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:41.944+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:42.255 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:41 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:41.944+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:42.255 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:41 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:41.944+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.419072+0000 front 2024-05-03T23:02:14.418629+0000 (oldest deadline 2024-05-03T23:02:36.619298+0000) 2024-05-03T23:02:42.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:42 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:42.086+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:42.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:42 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:42.086+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:42.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:42 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:42.086+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:42.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:42 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:42.086+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:42.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:41 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:41.771+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:42.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:41 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:41.771+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:42.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:41 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:41.771+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:42.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:42 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:42.349+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:42.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:42 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:42.349+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:42.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:42 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:42.349+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:42.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:42 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:42.139+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:42.503 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:42 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:42.139+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:42.503 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:42 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:42.139+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:02.411382+0000 front 2024-05-03T23:02:02.411514+0000 (oldest deadline 2024-05-03T23:02:27.711611+0000) 2024-05-03T23:02:42.503 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:42 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:42.139+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.114884+0000 front 2024-05-03T23:02:14.114935+0000 (oldest deadline 2024-05-03T23:02:38.814920+0000) 2024-05-03T23:02:42.765 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:42 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:42.490+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:42.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:42 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:42.490+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:42.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:42 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:42.490+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:43.255 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:42 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:42.901+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:43.255 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:42 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:42.901+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:43.255 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:42 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:42.901+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.419072+0000 front 2024-05-03T23:02:14.418629+0000 (oldest deadline 2024-05-03T23:02:36.619298+0000) 2024-05-03T23:02:43.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:43 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:43.124+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:43.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:43 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:43.124+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:43.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:43 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:43.124+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:43.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:43 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:43.124+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:43.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:42 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:42.814+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:43.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:42 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:42.814+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:43.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:42 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:42.814+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:43.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:43 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:43.369+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:43.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:43 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:43.369+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:43.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:43 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:43.369+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:43.502 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:43 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:43.154+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.806781+0000 front 2024-05-03T23:01:47.807078+0000 (oldest deadline 2024-05-03T23:02:09.507056+0000) 2024-05-03T23:02:43.503 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:43 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:43.154+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:57.110316+0000 front 2024-05-03T23:01:57.110249+0000 (oldest deadline 2024-05-03T23:02:22.410498+0000) 2024-05-03T23:02:43.503 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:43 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:43.154+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:02.411382+0000 front 2024-05-03T23:02:02.411514+0000 (oldest deadline 2024-05-03T23:02:27.711611+0000) 2024-05-03T23:02:43.503 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:43 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6[57129]: 2024-05-03T23:02:43.154+0000 7f7493800700 -1 osd.6 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.114884+0000 front 2024-05-03T23:02:14.114935+0000 (oldest deadline 2024-05-03T23:02:38.814920+0000) 2024-05-03T23:02:43.765 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:43 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:43.476+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:43.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:43 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:43.476+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:43.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:43 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:43.476+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:44.167 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:43 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:43.859+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:44.168 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:43 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:43.859+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:44.168 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:43 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:43.859+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.419072+0000 front 2024-05-03T23:02:14.418629+0000 (oldest deadline 2024-05-03T23:02:36.619298+0000) 2024-05-03T23:02:44.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:43 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:43.784+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:44.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:43 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:43.784+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:44.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:43 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:43.784+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:44.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:44 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:44.165+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:44.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:44 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:44.165+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:44.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:44 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:44.165+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:44.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:44 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:44.165+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:44.752 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:44 smithi044 podman[94560]: 2024-05-03 23:02:44.369156583 +0000 UTC m=+5.736893128 container died e72d962a6be8974f5547ce8ea3daa92d45f14169391fbf222ff110ae9b4396ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T23:02:44.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:44 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:44.394+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:44.753 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:44 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:44.394+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:44.753 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:44 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:44.394+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:44.765 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:44 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:44.428+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:44.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:44 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:44.428+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:44.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:44 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:44.428+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:45.156 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:44 smithi044 podman[94560]: 2024-05-03 23:02:44.886217463 +0000 UTC m=+6.253954029 container cleanup e72d962a6be8974f5547ce8ea3daa92d45f14169391fbf222ff110ae9b4396ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T23:02:45.156 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:44 smithi044 bash[94560]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6 2024-05-03T23:02:45.165 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:44 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:44.827+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:45.166 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:44 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:44.827+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:45.166 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:44 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:44.827+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.419072+0000 front 2024-05-03T23:02:14.418629+0000 (oldest deadline 2024-05-03T23:02:36.619298+0000) 2024-05-03T23:02:45.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:44 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:44.774+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:45.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:44 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:44.774+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:45.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:44 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:44.774+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:45.444 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:45 smithi044 podman[94578]: 2024-05-03 23:02:45.153976701 +0000 UTC m=+0.767901617 container remove e72d962a6be8974f5547ce8ea3daa92d45f14169391fbf222ff110ae9b4396ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T23:02:45.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:45 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:45.163+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:45.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:45 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:45.163+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:45.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:45 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:45.163+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:45.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:45 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:45.163+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:45.751 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:45 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:45.441+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:45.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:45 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:45.441+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:45.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:45 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:45.442+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:45.752 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:45 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:45.440+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:45.752 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:45 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:45.440+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:45.752 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:45 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:45.440+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:46.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:45 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:45.749+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:46.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:45 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:45.749+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:46.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:45 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:45.749+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:46.201 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:45 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:45.816+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:46.201 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:45 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:45.816+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:46.202 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:45 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:45.816+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.419072+0000 front 2024-05-03T23:02:14.418629+0000 (oldest deadline 2024-05-03T23:02:36.619298+0000) 2024-05-03T23:02:46.202 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:45 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:45.816+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:21.921283+0000 front 2024-05-03T23:02:21.921686+0000 (oldest deadline 2024-05-03T23:02:45.421101+0000) 2024-05-03T23:02:46.320 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:46 smithi044 podman[94663]: 2024-05-03 23:02:45.968651048 +0000 UTC m=+0.039299918 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T23:02:46.321 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:46 smithi044 podman[94663]: 2024-05-03 23:02:46.088176234 +0000 UTC m=+0.158825157 container create 27b4f1237bfa9695f6e855618a1272ccae206c0e3e2506e387c914c857bb4813 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS) 2024-05-03T23:02:46.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:46 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:46.198+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:46.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:46 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:46.198+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:46.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:46 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:46.198+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:46.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:46 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:46.198+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:46.667 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:46 smithi044 podman[94663]: 2024-05-03 23:02:46.524992464 +0000 UTC m=+0.595641329 container init 27b4f1237bfa9695f6e855618a1272ccae206c0e3e2506e387c914c857bb4813 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T23:02:46.667 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:46 smithi044 podman[94663]: 2024-05-03 23:02:46.540494061 +0000 UTC m=+0.611142947 container start 27b4f1237bfa9695f6e855618a1272ccae206c0e3e2506e387c914c857bb4813 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, ceph=True) 2024-05-03T23:02:46.667 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:46 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:46.454+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:46.667 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:46 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:46.454+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:46.668 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:46 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:46.454+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:46.729 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:46 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:46.726+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:46.730 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:46 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:46.726+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:46.730 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:46 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:46.726+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:46.730 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:46 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:46.476+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:46.730 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:46 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:46.476+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:46.731 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:46 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:46.476+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:47.002 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:46 smithi044 podman[94663]: 2024-05-03 23:02:46.665638277 +0000 UTC m=+0.736287166 container attach 27b4f1237bfa9695f6e855618a1272ccae206c0e3e2506e387c914c857bb4813 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-05-03T23:02:47.192 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:46 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:46.795+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:47.192 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:46 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:46.795+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:47.192 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:46 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:46.795+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.419072+0000 front 2024-05-03T23:02:14.418629+0000 (oldest deadline 2024-05-03T23:02:36.619298+0000) 2024-05-03T23:02:47.192 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:46 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:46.795+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:21.921283+0000 front 2024-05-03T23:02:21.921686+0000 (oldest deadline 2024-05-03T23:02:45.421101+0000) 2024-05-03T23:02:47.350 INFO:journalctl@ceph.osd.6.smithi044.stdout:May 03 23:02:47 smithi044 podman[94663]: 2024-05-03 23:02:47.005558163 +0000 UTC m=+1.076207024 container died 27b4f1237bfa9695f6e855618a1272ccae206c0e3e2506e387c914c857bb4813 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T23:02:47.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:47 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:47.189+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:47.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:47 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:47.189+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:47.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:47 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:47.189+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:47.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:47 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:47.189+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:47.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:47 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:47.189+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:02:47.748 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:47 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:47.466+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:47.748 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:47 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:47.466+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:47.748 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:47 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:47.466+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:47.749 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:47 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:47.466+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.822077+0000 front 2024-05-03T23:02:24.822013+0000 (oldest deadline 2024-05-03T23:02:46.521624+0000) 2024-05-03T23:02:47.751 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:47 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:47.461+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:47.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:47 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:47.461+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:47.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:47 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:47.461+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:47.782 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.6.service' 2024-05-03T23:02:47.872 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:02:47.872 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-03T23:02:47.872 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-03T23:02:47.872 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.7 2024-05-03T23:02:48.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:47 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:47.745+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:48.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:47 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:47.745+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:48.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:47 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:47.745+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:48.195 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:47 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:47.797+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:48.196 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:47 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:47.797+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:48.196 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:47 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:47.797+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.419072+0000 front 2024-05-03T23:02:14.418629+0000 (oldest deadline 2024-05-03T23:02:36.619298+0000) 2024-05-03T23:02:48.196 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:47 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:47.797+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:21.921283+0000 front 2024-05-03T23:02:21.921686+0000 (oldest deadline 2024-05-03T23:02:45.421101+0000) 2024-05-03T23:02:48.196 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:47 smithi060 systemd[1]: Stopping Ceph osd.7 for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:02:48.455 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:48 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:48.192+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:48.455 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:48 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:48.192+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:48.456 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:48 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:48.192+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:48.456 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:48 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:48.192+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:48.456 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:48 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:48.192+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:02:48.750 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:48 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:48.493+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:48.750 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:48 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:48.493+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:48.751 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:48 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:48.493+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:48.751 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:48 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:48.493+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.822077+0000 front 2024-05-03T23:02:24.822013+0000 (oldest deadline 2024-05-03T23:02:46.521624+0000) 2024-05-03T23:02:48.755 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:48 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:48.452+0000 7fdee5800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:02:48.755 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:48 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:48.452+0000 7fdee5800700 -1 osd.7 93 *** Got signal Terminated *** 2024-05-03T23:02:48.755 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:48 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:48.452+0000 7fdee5800700 -1 osd.7 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T23:02:49.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:48 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:48.505+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:49.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:48 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:48.505+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:49.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:48 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:48.505+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:49.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:48 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:48.747+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:49.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:48 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:48.747+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:49.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:48 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:48.747+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:49.208 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:48 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:48.840+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:49.209 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:48 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:48.840+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:49.209 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:48 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:48.840+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.419072+0000 front 2024-05-03T23:02:14.418629+0000 (oldest deadline 2024-05-03T23:02:36.619298+0000) 2024-05-03T23:02:49.209 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:48 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:48.840+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:21.921283+0000 front 2024-05-03T23:02:21.921686+0000 (oldest deadline 2024-05-03T23:02:45.421101+0000) 2024-05-03T23:02:49.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:49 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:49.206+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:49.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:49 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:49.206+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:49.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:49 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:49.206+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:49.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:49 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:49.206+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:49.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:49 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:49.206+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:02:49.736 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:49 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:49.733+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:49.736 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:49 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:49.474+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:49.737 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:49 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:49.474+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:49.737 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:49 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:49.474+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:49.737 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:49 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:49.474+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.822077+0000 front 2024-05-03T23:02:24.822013+0000 (oldest deadline 2024-05-03T23:02:46.521624+0000) 2024-05-03T23:02:50.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:49 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:49.531+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:50.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:49 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:49.531+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:50.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:49 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:49.531+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:50.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:49 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:49.733+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:50.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:49 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:49.733+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:50.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:49 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:49.733+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:02:50.174 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:49 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:49.797+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:50.174 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:49 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:49.797+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:50.174 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:49 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:49.797+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.419072+0000 front 2024-05-03T23:02:14.418629+0000 (oldest deadline 2024-05-03T23:02:36.619298+0000) 2024-05-03T23:02:50.174 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:49 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:49.797+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:21.921283+0000 front 2024-05-03T23:02:21.921686+0000 (oldest deadline 2024-05-03T23:02:45.421101+0000) 2024-05-03T23:02:50.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:50 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:50.171+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:50.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:50 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:50.171+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:50.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:50 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:50.171+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:50.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:50 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:50.171+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:50.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:50 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:50.171+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:02:50.756 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:50 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:50.440+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:50.756 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:50 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:50.440+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:50.756 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:50 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:50.440+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:50.757 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:50 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:50.440+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.822077+0000 front 2024-05-03T23:02:24.822013+0000 (oldest deadline 2024-05-03T23:02:46.521624+0000) 2024-05-03T23:02:51.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:50 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:50.564+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:51.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:50 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:50.564+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:51.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:50 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:50.564+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:51.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:50 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:50.564+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:02:51.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:50 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:50.753+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:51.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:50 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:50.753+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:51.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:50 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:50.753+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:51.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:50 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:50.753+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:02:51.130 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:50 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:50.817+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:51.130 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:50 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:50.817+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:51.130 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:50 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:50.817+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.419072+0000 front 2024-05-03T23:02:14.418629+0000 (oldest deadline 2024-05-03T23:02:36.619298+0000) 2024-05-03T23:02:51.130 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:50 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:50.817+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:21.921283+0000 front 2024-05-03T23:02:21.921686+0000 (oldest deadline 2024-05-03T23:02:45.421101+0000) 2024-05-03T23:02:51.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:51 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:51.126+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:51.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:51 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:51.126+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:51.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:51 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:51.126+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:51.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:51 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:51.127+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:51.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:51 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:51.127+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:02:51.716 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:51 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:51.398+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:51.716 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:51 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:51.398+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:51.716 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:51 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:51.398+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:51.716 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:51 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:51.398+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.822077+0000 front 2024-05-03T23:02:24.822013+0000 (oldest deadline 2024-05-03T23:02:46.521624+0000) 2024-05-03T23:02:52.001 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:51 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:51.595+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:52.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:51 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:51.595+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:52.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:51 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:51.595+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:52.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:51 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:51.595+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:02:52.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:51 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:51.713+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:52.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:51 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:51.713+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:52.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:51 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:51.713+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:52.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:51 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:51.713+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:02:52.170 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:51 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:51.838+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:52.170 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:51 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:51.838+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:52.170 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:51 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:51.838+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.419072+0000 front 2024-05-03T23:02:14.418629+0000 (oldest deadline 2024-05-03T23:02:36.619298+0000) 2024-05-03T23:02:52.170 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:51 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:51.838+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:21.921283+0000 front 2024-05-03T23:02:21.921686+0000 (oldest deadline 2024-05-03T23:02:45.421101+0000) 2024-05-03T23:02:52.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:52 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:52.167+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:52.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:52 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:52.167+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:52.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:52 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:52.167+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:52.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:52 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:52.167+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:52.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:52 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:52.167+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:02:52.741 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:52 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:52.421+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:52.741 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:52 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:52.421+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:52.741 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:52 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:52.421+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:52.741 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:52 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:52.421+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.822077+0000 front 2024-05-03T23:02:24.822013+0000 (oldest deadline 2024-05-03T23:02:46.521624+0000) 2024-05-03T23:02:53.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:52 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:52.593+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:53.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:52 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:52.593+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:53.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:52 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:52.593+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:53.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:52 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:52.593+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:02:53.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:52 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:52.738+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:53.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:52 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:52.738+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:53.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:52 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:52.738+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:53.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:52 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:52.738+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:02:53.151 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:52 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:52.811+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.211303+0000 front 2024-05-03T23:01:55.211480+0000 (oldest deadline 2024-05-03T23:02:19.311500+0000) 2024-05-03T23:02:53.151 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:52 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:52.811+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.613596+0000 front 2024-05-03T23:02:04.613675+0000 (oldest deadline 2024-05-03T23:02:28.615060+0000) 2024-05-03T23:02:53.151 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:52 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:52.811+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.419072+0000 front 2024-05-03T23:02:14.418629+0000 (oldest deadline 2024-05-03T23:02:36.619298+0000) 2024-05-03T23:02:53.151 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:52 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7[49863]: 2024-05-03T23:02:52.811+0000 7fdee1000700 -1 osd.7 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:21.921283+0000 front 2024-05-03T23:02:21.921686+0000 (oldest deadline 2024-05-03T23:02:45.421101+0000) 2024-05-03T23:02:53.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:53 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:53.148+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:53.507 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:53 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:53.148+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:53.508 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:53 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:53.148+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:53.508 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:53 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:53.148+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:53.508 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:53 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:53.148+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:02:53.727 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:53 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:53.427+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:53.727 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:53 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:53.427+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:53.727 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:53 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:53.427+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:53.728 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:53 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:53.427+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.822077+0000 front 2024-05-03T23:02:24.822013+0000 (oldest deadline 2024-05-03T23:02:46.521624+0000) 2024-05-03T23:02:54.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:53 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:53.566+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:54.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:53 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:53.566+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:54.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:53 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:53.566+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:54.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:53 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:53.566+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:02:54.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:53 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:53.725+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:54.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:53 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:53.725+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:54.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:53 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:53.725+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:54.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:53 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:53.725+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:02:54.255 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:53 smithi060 podman[68203]: 2024-05-03 23:02:53.927633747 +0000 UTC m=+5.613490142 container died 749d88ae1242cd94a9bbd4a4b3d4ee0e598a9508366afbcaea9ddf97fb790480 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430) 2024-05-03T23:02:54.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:54 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:54.162+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:54.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:54 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:54.162+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:54.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:54 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:54.162+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:54.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:54 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:54.162+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:54.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:54 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:54.162+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:02:54.744 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:54 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:54.464+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:54.744 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:54 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:54.464+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:54.744 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:54 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:54.464+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:54.744 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:54 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:54.464+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.822077+0000 front 2024-05-03T23:02:24.822013+0000 (oldest deadline 2024-05-03T23:02:46.521624+0000) 2024-05-03T23:02:54.748 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:54 smithi060 podman[68203]: 2024-05-03 23:02:54.461968057 +0000 UTC m=+6.147824408 container cleanup 749d88ae1242cd94a9bbd4a4b3d4ee0e598a9508366afbcaea9ddf97fb790480 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-03T23:02:54.748 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:54 smithi060 bash[68203]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7 2024-05-03T23:02:55.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:54 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:54.550+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:55.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:54 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:54.550+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:55.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:54 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:54.550+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:55.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:54 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:54.550+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:02:55.004 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:54 smithi060 podman[68223]: 2024-05-03 23:02:54.746297848 +0000 UTC m=+0.802284737 container remove 749d88ae1242cd94a9bbd4a4b3d4ee0e598a9508366afbcaea9ddf97fb790480 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7, ceph=True, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-03T23:02:55.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:54 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:54.741+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:55.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:54 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:54.741+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:55.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:54 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:54.741+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:55.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:54 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:54.741+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:02:55.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:55 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:55.116+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:55.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:55 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:55.116+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:55.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:55 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:55.117+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:55.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:55 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:55.117+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:55.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:55 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:55.117+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:02:55.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:55 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:55.117+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:02:55.765 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:55 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:55.710+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:55.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:55 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:55.710+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:55.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:55 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:55.710+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:55.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:55 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:55.710+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:02:55.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:55 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:55.509+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:55.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:55 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:55.509+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:55.767 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:55 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:55.509+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:55.767 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:55 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:55.509+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.822077+0000 front 2024-05-03T23:02:24.822013+0000 (oldest deadline 2024-05-03T23:02:46.521624+0000) 2024-05-03T23:02:55.767 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:55 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:55.509+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:30.623835+0000 front 2024-05-03T23:02:30.623896+0000 (oldest deadline 2024-05-03T23:02:55.324072+0000) 2024-05-03T23:02:55.892 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:55 smithi060 podman[68308]: 2024-05-03 23:02:55.507121234 +0000 UTC m=+0.041631716 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T23:02:55.892 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:55 smithi060 podman[68308]: 2024-05-03 23:02:55.730674456 +0000 UTC m=+0.265184981 container create 38e1681073af4cac4d9f233e6f62718aaa19fec6a0fe86440ee950f5293e901b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T23:02:56.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:55 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:55.510+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:56.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:55 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:55.510+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:56.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:55 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:55.510+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:56.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:55 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:55.510+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:02:56.151 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:56 smithi060 podman[68308]: 2024-05-03 23:02:56.00972064 +0000 UTC m=+0.544231145 container init 38e1681073af4cac4d9f233e6f62718aaa19fec6a0fe86440ee950f5293e901b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-05-03T23:02:56.151 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:56 smithi060 podman[68308]: 2024-05-03 23:02:56.021302902 +0000 UTC m=+0.555813407 container start 38e1681073af4cac4d9f233e6f62718aaa19fec6a0fe86440ee950f5293e901b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T23:02:56.152 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:56 smithi060 podman[68308]: 2024-05-03 23:02:56.150071132 +0000 UTC m=+0.684581616 container attach 38e1681073af4cac4d9f233e6f62718aaa19fec6a0fe86440ee950f5293e901b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7-deactivate, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-03T23:02:56.152 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:56 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:56.074+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:56.152 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:56 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:56.074+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:56.152 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:56 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:56.074+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:56.152 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:56 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:56.074+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:56.152 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:56 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:56.074+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:02:56.153 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:56 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:56.074+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:02:56.755 INFO:journalctl@ceph.osd.7.smithi060.stdout:May 03 23:02:56 smithi060 podman[68308]: 2024-05-03 23:02:56.496345884 +0000 UTC m=+1.030856356 container died 38e1681073af4cac4d9f233e6f62718aaa19fec6a0fe86440ee950f5293e901b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True) 2024-05-03T23:02:56.765 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:56 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:56.679+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:56.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:56 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:56.679+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:56.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:56 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:56.679+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:56.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:56 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:56.679+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:02:56.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:56 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:56.473+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:56.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:56 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:56.473+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:56.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:56 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:56.473+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:56.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:56 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:56.473+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.822077+0000 front 2024-05-03T23:02:24.822013+0000 (oldest deadline 2024-05-03T23:02:46.521624+0000) 2024-05-03T23:02:56.767 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:56 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:56.473+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:30.623835+0000 front 2024-05-03T23:02:30.623896+0000 (oldest deadline 2024-05-03T23:02:55.324072+0000) 2024-05-03T23:02:57.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:56 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:56.536+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:57.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:56 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:56.536+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:57.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:56 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:56.536+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:57.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:56 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:56.536+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:02:57.255 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:57 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:57.114+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:57.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:57 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:57.114+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:57.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:57 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:57.114+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:57.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:57 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:57.114+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:57.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:57 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:57.114+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:02:57.256 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:57 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:57.114+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:02:57.373 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.7.service' 2024-05-03T23:02:57.493 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:02:57.494 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-03T23:02:57.494 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-03T23:02:57.494 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.8 2024-05-03T23:02:57.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:57 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:57.494+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:57.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:57 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:57.494+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:57.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:57 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:57.494+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:57.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:57 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:57.494+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:02:57.765 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:57 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:57.475+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:57.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:57 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:57.475+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:57.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:57 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:57.475+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:57.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:57 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:57.475+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.822077+0000 front 2024-05-03T23:02:24.822013+0000 (oldest deadline 2024-05-03T23:02:46.521624+0000) 2024-05-03T23:02:57.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:57 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:57.475+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:30.623835+0000 front 2024-05-03T23:02:30.623896+0000 (oldest deadline 2024-05-03T23:02:55.324072+0000) 2024-05-03T23:02:57.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:57 smithi160 systemd[1]: Stopping Ceph osd.8 for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:02:57.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:57 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:57.637+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:57.767 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:57 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:57.637+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:57.767 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:57 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:57.638+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:57.767 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:57 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:57.638+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:02:58.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:58 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:58.143+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:58.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:58 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:58.143+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:58.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:58 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:58.143+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:58.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:58 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:58.143+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:58.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:58 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:58.143+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:02:58.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:58 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:58.143+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:02:58.515 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:58 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:58.079+0000 7f7b22c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:02:58.515 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:58 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:58.079+0000 7f7b22c00700 -1 osd.8 93 *** Got signal Terminated *** 2024-05-03T23:02:58.515 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:58 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:58.079+0000 7f7b22c00700 -1 osd.8 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T23:02:58.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:58 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:58.487+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:02:58.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:58 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:58.487+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:02:58.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:58 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:58.487+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:02:58.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:58 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:58.487+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:02:58.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:58 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:58.487+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:34.360155+0000 front 2024-05-03T23:02:34.360224+0000 (oldest deadline 2024-05-03T23:02:58.460273+0000) 2024-05-03T23:02:59.015 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:58 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:58.521+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:59.016 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:58 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:58.521+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:59.016 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:58 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:58.521+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:59.016 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:58 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:58.521+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.822077+0000 front 2024-05-03T23:02:24.822013+0000 (oldest deadline 2024-05-03T23:02:46.521624+0000) 2024-05-03T23:02:59.016 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:58 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:58.521+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:30.623835+0000 front 2024-05-03T23:02:30.623896+0000 (oldest deadline 2024-05-03T23:02:55.324072+0000) 2024-05-03T23:02:59.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:58 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:58.589+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:59.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:58 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:58.589+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:59.017 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:58 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:58.589+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:59.017 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:58 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:58.589+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:02:59.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:59 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:59.134+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:02:59.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:59 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:59.134+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:02:59.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:59 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:59.134+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:02:59.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:59 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:59.134+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:02:59.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:59 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:59.134+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:02:59.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:02:59 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:02:59.134+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:02:59.765 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:59 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:59.487+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:02:59.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:59 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:59.487+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:02:59.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:59 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:59.487+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:02:59.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:59 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:59.487+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.822077+0000 front 2024-05-03T23:02:24.822013+0000 (oldest deadline 2024-05-03T23:02:46.521624+0000) 2024-05-03T23:02:59.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:02:59 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:02:59.487+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:30.623835+0000 front 2024-05-03T23:02:30.623896+0000 (oldest deadline 2024-05-03T23:02:55.324072+0000) 2024-05-03T23:02:59.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:59 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:59.606+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:02:59.767 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:59 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:59.606+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:02:59.767 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:59 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:59.606+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:02:59.767 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:59 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:59.606+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:02:59.767 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:02:59 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:02:59.606+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:00.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:59 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:59.508+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:03:00.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:59 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:59.508+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:03:00.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:59 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:59.508+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:03:00.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:59 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:59.508+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:03:00.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:02:59 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:02:59.508+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:34.360155+0000 front 2024-05-03T23:02:34.360224+0000 (oldest deadline 2024-05-03T23:02:58.460273+0000) 2024-05-03T23:03:00.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:00 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:00.157+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:00.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:00 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:00.157+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:00.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:00 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:00.157+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:00.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:00 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:00.157+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:00.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:00 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:00.157+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:00.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:00 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:00.157+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:00.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:00 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:00.479+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:03:00.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:00 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:00.479+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:03:00.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:00 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:00.479+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:03:00.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:00 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:00.479+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:03:00.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:00 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:00.479+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:34.360155+0000 front 2024-05-03T23:02:34.360224+0000 (oldest deadline 2024-05-03T23:02:58.460273+0000) 2024-05-03T23:03:00.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:00 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:03:00.452+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:03:00.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:00 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:03:00.452+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:03:00.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:00 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:03:00.452+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:03:00.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:00 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:03:00.452+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.822077+0000 front 2024-05-03T23:02:24.822013+0000 (oldest deadline 2024-05-03T23:02:46.521624+0000) 2024-05-03T23:03:00.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:00 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:03:00.452+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:30.623835+0000 front 2024-05-03T23:02:30.623896+0000 (oldest deadline 2024-05-03T23:02:55.324072+0000) 2024-05-03T23:03:00.767 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:00 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:00.627+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:00.767 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:00 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:00.627+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:00.767 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:00 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:00.627+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:00.767 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:00 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:00.627+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:00.767 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:00 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:00.627+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:01.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:01 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:01.131+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:01.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:01 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:01.131+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:01.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:01 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:01.131+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:01.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:01 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:01.131+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:01.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:01 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:01.131+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:01.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:01 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:01.131+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:01.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:01 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:01.438+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:03:01.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:01 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:01.438+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:03:01.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:01 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:01.438+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:03:01.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:01 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:01.438+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:03:01.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:01 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:01.438+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:34.360155+0000 front 2024-05-03T23:02:34.360224+0000 (oldest deadline 2024-05-03T23:02:58.460273+0000) 2024-05-03T23:03:01.765 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:01 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:03:01.478+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:03:01.765 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:01 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:03:01.478+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:03:01.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:01 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:03:01.478+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:03:01.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:01 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:03:01.478+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.822077+0000 front 2024-05-03T23:02:24.822013+0000 (oldest deadline 2024-05-03T23:02:46.521624+0000) 2024-05-03T23:03:01.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:01 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:03:01.478+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:30.623835+0000 front 2024-05-03T23:02:30.623896+0000 (oldest deadline 2024-05-03T23:02:55.324072+0000) 2024-05-03T23:03:01.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:01 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:01.592+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:01.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:01 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:01.592+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:01.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:01 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:01.592+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:01.767 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:01 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:01.592+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:01.767 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:01 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:01.592+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:02.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:02 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:02.110+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:02.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:02 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:02.110+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:02.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:02 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:02.110+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:02.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:02 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:02.110+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:02.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:02 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:02.110+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:02.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:02 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:02.110+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:02.751 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:02 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:02.397+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:03:02.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:02 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:02.397+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:03:02.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:02 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:02.397+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:03:02.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:02 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:02.397+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:03:02.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:02 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:02.397+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:34.360155+0000 front 2024-05-03T23:02:34.360224+0000 (oldest deadline 2024-05-03T23:02:58.460273+0000) 2024-05-03T23:03:02.765 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:02 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:03:02.502+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:51.511993+0000 front 2024-05-03T23:01:51.511661+0000 (oldest deadline 2024-05-03T23:02:22.713232+0000) 2024-05-03T23:03:02.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:02 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:03:02.502+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:03.815718+0000 front 2024-05-03T23:02:03.815776+0000 (oldest deadline 2024-05-03T23:02:29.715815+0000) 2024-05-03T23:03:02.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:02 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:03:02.502+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:14.919217+0000 front 2024-05-03T23:02:14.919413+0000 (oldest deadline 2024-05-03T23:02:39.619374+0000) 2024-05-03T23:03:02.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:02 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:03:02.502+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.822077+0000 front 2024-05-03T23:02:24.822013+0000 (oldest deadline 2024-05-03T23:02:46.521624+0000) 2024-05-03T23:03:02.766 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:02 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8[51412]: 2024-05-03T23:03:02.502+0000 7f7b19400700 -1 osd.8 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:30.623835+0000 front 2024-05-03T23:02:30.623896+0000 (oldest deadline 2024-05-03T23:02:55.324072+0000) 2024-05-03T23:03:02.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:02 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:02.569+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:02.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:02 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:02.569+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:02.767 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:02 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:02.569+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:02.767 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:02 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:02.569+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:02.767 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:02 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:02.569+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:03.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:03 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:03.079+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:03.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:03 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:03.079+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:03.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:03 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:03.079+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:03.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:03 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:03.079+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:03.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:03 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:03.079+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:03.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:03 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:03.079+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:03.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:03 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:03.390+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:03:03.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:03 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:03.390+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:03:03.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:03 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:03.390+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:03:03.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:03 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:03.390+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:03:03.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:03 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:03.390+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:34.360155+0000 front 2024-05-03T23:02:34.360224+0000 (oldest deadline 2024-05-03T23:02:58.460273+0000) 2024-05-03T23:03:03.948 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:03 smithi160 podman[69325]: 2024-05-03 23:03:03.628405964 +0000 UTC m=+5.720610938 container died 5c9c663f8123b755b92b08a98f6f049585274a8fc798abe3e63047f4cf69c643 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-03T23:03:03.948 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:03 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:03.602+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:03.948 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:03 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:03.602+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:03.948 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:03 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:03.602+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:03.949 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:03 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:03.602+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:03.949 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:03 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:03.602+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:04.265 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:04 smithi160 podman[69325]: 2024-05-03 23:03:04.073809214 +0000 UTC m=+6.166014215 container cleanup 5c9c663f8123b755b92b08a98f6f049585274a8fc798abe3e63047f4cf69c643 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-03T23:03:04.265 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:04 smithi160 bash[69325]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8 2024-05-03T23:03:04.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:04 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:04.067+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:04.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:04 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:04.067+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:04.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:04 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:04.067+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:04.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:04 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:04.067+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:04.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:04 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:04.067+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:04.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:04 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:04.067+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:04.568 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:04 smithi160 podman[69344]: 2024-05-03 23:03:04.266675045 +0000 UTC m=+0.631637089 container remove 5c9c663f8123b755b92b08a98f6f049585274a8fc798abe3e63047f4cf69c643 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T23:03:04.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:04 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:04.393+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:03:04.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:04 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:04.393+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:03:04.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:04 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:04.393+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:03:04.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:04 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:04.393+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:03:04.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:04 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:04.393+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:34.360155+0000 front 2024-05-03T23:02:34.360224+0000 (oldest deadline 2024-05-03T23:02:58.460273+0000) 2024-05-03T23:03:05.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:04 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:04.566+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:05.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:04 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:04.566+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:05.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:04 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:04.566+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:05.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:04 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:04.566+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:05.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:04 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:04.566+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:05.390 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:05 smithi160 podman[69434]: 2024-05-03 23:03:05.008284859 +0000 UTC m=+0.036706261 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T23:03:05.391 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:05 smithi160 podman[69434]: 2024-05-03 23:03:05.133929869 +0000 UTC m=+0.162351266 container create 033869521b5ebfd1d652ac359ef4d5383ee740a30ccd51ba304525c4cd1bf455 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T23:03:05.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:05 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:05.112+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:05.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:05 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:05.112+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:05.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:05 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:05.112+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:05.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:05 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:05.112+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:05.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:05 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:05.112+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:05.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:05 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:05.112+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:05.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:05 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:05.112+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:40.841529+0000 front 2024-05-03T23:02:40.841330+0000 (oldest deadline 2024-05-03T23:03:04.940803+0000) 2024-05-03T23:03:05.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:05 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:05.423+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:03:05.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:05 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:05.423+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:03:05.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:05 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:05.423+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:03:05.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:05 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:05.423+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:03:05.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:05 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:05.423+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:34.360155+0000 front 2024-05-03T23:02:34.360224+0000 (oldest deadline 2024-05-03T23:02:58.460273+0000) 2024-05-03T23:03:05.765 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:05 smithi160 podman[69434]: 2024-05-03 23:03:05.388392576 +0000 UTC m=+0.416813999 container init 033869521b5ebfd1d652ac359ef4d5383ee740a30ccd51ba304525c4cd1bf455 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8-deactivate, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=) 2024-05-03T23:03:05.765 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:05 smithi160 podman[69434]: 2024-05-03 23:03:05.400139561 +0000 UTC m=+0.428560961 container start 033869521b5ebfd1d652ac359ef4d5383ee740a30ccd51ba304525c4cd1bf455 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-03T23:03:05.765 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:05 smithi160 podman[69434]: 2024-05-03 23:03:05.469769443 +0000 UTC m=+0.498190913 container attach 033869521b5ebfd1d652ac359ef4d5383ee740a30ccd51ba304525c4cd1bf455 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=) 2024-05-03T23:03:05.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:05 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:05.518+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:05.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:05 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:05.518+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:05.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:05 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:05.518+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:05.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:05 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:05.518+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:05.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:05 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:05.518+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:06.147 INFO:journalctl@ceph.osd.8.smithi160.stdout:May 03 23:03:05 smithi160 podman[69434]: 2024-05-03 23:03:05.852912946 +0000 UTC m=+0.881334337 container died 033869521b5ebfd1d652ac359ef4d5383ee740a30ccd51ba304525c4cd1bf455 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS) 2024-05-03T23:03:06.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:06 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:06.138+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:06.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:06 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:06.138+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:06.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:06 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:06.138+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:06.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:06 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:06.138+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:06.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:06 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:06.138+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:06.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:06 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:06.138+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:06.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:06 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:06.138+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:40.841529+0000 front 2024-05-03T23:02:40.841330+0000 (oldest deadline 2024-05-03T23:03:04.940803+0000) 2024-05-03T23:03:06.521 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.8.service' 2024-05-03T23:03:06.637 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:03:06.638 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-03T23:03:06.638 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-03T23:03:06.638 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.9 2024-05-03T23:03:06.721 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:06 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:06.427+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:03:06.722 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:06 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:06.427+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:03:06.722 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:06 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:06.427+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:03:06.722 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:06 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:06.427+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:03:06.722 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:06 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:06.427+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:34.360155+0000 front 2024-05-03T23:02:34.360224+0000 (oldest deadline 2024-05-03T23:02:58.460273+0000) 2024-05-03T23:03:06.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:06 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:06.553+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:06.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:06 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:06.553+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:06.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:06 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:06.553+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:06.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:06 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:06.553+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:06.767 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:06 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:06.553+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:07.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:06 smithi044 systemd[1]: Stopping Ceph osd.9 for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:03:07.503 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:07 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:07.238+0000 7fa794800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:03:07.503 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:07 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:07.238+0000 7fa794800700 -1 osd.9 93 *** Got signal Terminated *** 2024-05-03T23:03:07.503 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:07 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:07.238+0000 7fa794800700 -1 osd.9 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T23:03:07.503 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:07 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:07.415+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:03:07.503 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:07 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:07.415+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:03:07.504 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:07 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:07.415+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:03:07.504 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:07 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:07.415+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:03:07.504 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:07 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:07.415+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:34.360155+0000 front 2024-05-03T23:02:34.360224+0000 (oldest deadline 2024-05-03T23:02:58.460273+0000) 2024-05-03T23:03:07.504 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:07 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:07.415+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:41.362261+0000 front 2024-05-03T23:02:41.362326+0000 (oldest deadline 2024-05-03T23:03:07.262097+0000) 2024-05-03T23:03:07.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:07 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:07.103+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:07.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:07 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:07.103+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:07.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:07 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:07.103+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:07.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:07 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:07.103+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:07.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:07 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:07.103+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:07.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:07 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:07.103+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:07.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:07 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:07.103+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:40.841529+0000 front 2024-05-03T23:02:40.841330+0000 (oldest deadline 2024-05-03T23:03:04.940803+0000) 2024-05-03T23:03:07.765 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:07 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:07.506+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:07.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:07 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:07.506+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:07.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:07 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:07.506+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:07.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:07 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:07.506+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:07.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:07 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:07.506+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:07.766 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:07 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:07.506+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:08.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:08 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:08.149+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:08.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:08 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:08.149+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:08.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:08 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:08.149+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:08.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:08 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:08.149+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:08.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:08 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:08.149+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:08.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:08 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:08.149+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:08.507 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:08 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:08.149+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:40.841529+0000 front 2024-05-03T23:02:40.841330+0000 (oldest deadline 2024-05-03T23:03:04.940803+0000) 2024-05-03T23:03:08.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:08 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:08.424+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:03:08.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:08 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:08.424+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:03:08.753 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:08 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:08.424+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:03:08.753 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:08 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:08.424+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:03:08.753 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:08 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:08.424+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:34.360155+0000 front 2024-05-03T23:02:34.360224+0000 (oldest deadline 2024-05-03T23:02:58.460273+0000) 2024-05-03T23:03:08.753 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:08 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:08.424+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:41.362261+0000 front 2024-05-03T23:02:41.362326+0000 (oldest deadline 2024-05-03T23:03:07.262097+0000) 2024-05-03T23:03:09.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:08 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:08.551+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:09.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:08 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:08.551+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:09.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:08 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:08.551+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:09.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:08 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:08.551+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:09.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:08 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:08.551+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:09.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:08 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:08.551+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:09.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:09 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:09.165+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:09.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:09 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:09.165+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:09.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:09 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:09.165+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:09.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:09 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:09.165+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:09.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:09 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:09.165+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:09.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:09 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:09.165+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:09.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:09 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:09.165+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:40.841529+0000 front 2024-05-03T23:02:40.841330+0000 (oldest deadline 2024-05-03T23:03:04.940803+0000) 2024-05-03T23:03:09.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:09 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:09.450+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:03:09.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:09 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:09.450+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:03:09.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:09 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:09.450+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:03:09.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:09 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:09.450+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:03:09.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:09 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:09.450+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:34.360155+0000 front 2024-05-03T23:02:34.360224+0000 (oldest deadline 2024-05-03T23:02:58.460273+0000) 2024-05-03T23:03:09.753 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:09 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:09.450+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:41.362261+0000 front 2024-05-03T23:02:41.362326+0000 (oldest deadline 2024-05-03T23:03:07.262097+0000) 2024-05-03T23:03:10.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:09 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:09.590+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:10.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:09 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:09.590+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:10.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:09 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:09.590+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:10.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:09 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:09.590+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:10.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:09 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:09.590+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:10.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:09 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:09.590+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:10.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:10 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:10.164+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:10.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:10 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:10.164+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:10.507 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:10 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:10.164+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:10.507 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:10 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:10.164+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:10.507 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:10 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:10.164+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:10.508 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:10 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:10.164+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:10.508 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:10 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:10.164+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:40.841529+0000 front 2024-05-03T23:02:40.841330+0000 (oldest deadline 2024-05-03T23:03:04.940803+0000) 2024-05-03T23:03:10.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:10 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:10.482+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:03:10.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:10 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:10.482+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:03:10.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:10 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:10.482+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:03:10.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:10 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:10.482+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:03:10.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:10 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:10.482+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:34.360155+0000 front 2024-05-03T23:02:34.360224+0000 (oldest deadline 2024-05-03T23:02:58.460273+0000) 2024-05-03T23:03:10.753 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:10 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:10.482+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:41.362261+0000 front 2024-05-03T23:02:41.362326+0000 (oldest deadline 2024-05-03T23:03:07.262097+0000) 2024-05-03T23:03:11.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:10 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:10.625+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:11.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:10 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:10.625+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:11.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:10 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:10.625+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:11.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:10 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:10.625+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:11.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:10 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:10.625+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:11.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:10 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:10.625+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:11.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:11.213+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:11.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:11.213+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:11.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:11.213+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:11.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:11.213+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:11.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:11.213+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:11.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:11.213+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:11.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:11 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:11.213+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:40.841529+0000 front 2024-05-03T23:02:40.841330+0000 (oldest deadline 2024-05-03T23:03:04.940803+0000) 2024-05-03T23:03:11.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:11 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:11.435+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.047217+0000 front 2024-05-03T23:01:56.047310+0000 (oldest deadline 2024-05-03T23:02:19.547426+0000) 2024-05-03T23:03:11.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:11 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:11.435+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:01.652193+0000 front 2024-05-03T23:02:01.652251+0000 (oldest deadline 2024-05-03T23:02:27.552205+0000) 2024-05-03T23:03:11.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:11 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:11.435+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:13.455367+0000 front 2024-05-03T23:02:13.455977+0000 (oldest deadline 2024-05-03T23:02:37.554834+0000) 2024-05-03T23:03:11.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:11 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:11.435+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:24.457767+0000 front 2024-05-03T23:02:24.457919+0000 (oldest deadline 2024-05-03T23:02:49.757453+0000) 2024-05-03T23:03:11.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:11 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:11.435+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:34.360155+0000 front 2024-05-03T23:02:34.360224+0000 (oldest deadline 2024-05-03T23:02:58.460273+0000) 2024-05-03T23:03:11.752 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:11 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9[63897]: 2024-05-03T23:03:11.435+0000 7fa78b000700 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:41.362261+0000 front 2024-05-03T23:02:41.362326+0000 (oldest deadline 2024-05-03T23:03:07.262097+0000) 2024-05-03T23:03:12.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:11 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:11.662+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:12.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:11 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:11.662+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:12.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:11 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:11.663+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:12.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:11 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:11.663+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:12.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:11 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:11.663+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:12.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:11 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:11.663+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:12.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:12 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:12.183+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:12.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:12 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:12.183+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:12.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:12 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:12.183+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:12.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:12 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:12.183+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:12.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:12 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:12.183+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:12.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:12 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:12.183+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:12.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:12 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:12.183+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:40.841529+0000 front 2024-05-03T23:02:40.841330+0000 (oldest deadline 2024-05-03T23:03:04.940803+0000) 2024-05-03T23:03:13.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:12 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:12.674+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:13.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:12 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:12.674+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:13.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:12 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:12.674+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:13.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:12 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:12.674+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:13.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:12 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:12.674+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:13.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:12 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:12.674+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:13.153 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:12 smithi044 podman[94779]: 2024-05-03 23:03:12.828412395 +0000 UTC m=+5.747240361 container died a46085ca316209058a9bb7283f326684da2b800702159f2fecb8bacfd4fd5440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-03T23:03:13.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:13 smithi044 podman[94779]: 2024-05-03 23:03:13.263948659 +0000 UTC m=+6.182776682 container cleanup a46085ca316209058a9bb7283f326684da2b800702159f2fecb8bacfd4fd5440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-03T23:03:13.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:13 smithi044 bash[94779]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9 2024-05-03T23:03:13.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:13 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:13.155+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:13.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:13 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:13.155+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:13.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:13 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:13.155+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:13.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:13 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:13.155+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:13.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:13 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:13.155+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:13.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:13 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:13.155+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:13.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:13 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:13.155+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:40.841529+0000 front 2024-05-03T23:02:40.841330+0000 (oldest deadline 2024-05-03T23:03:04.940803+0000) 2024-05-03T23:03:14.001 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:13 smithi044 podman[94798]: 2024-05-03 23:03:13.573367433 +0000 UTC m=+0.728139414 container remove a46085ca316209058a9bb7283f326684da2b800702159f2fecb8bacfd4fd5440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-05-03T23:03:14.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:13 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:13.723+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:14.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:13 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:13.723+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:14.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:13 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:13.723+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:14.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:13 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:13.723+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:14.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:13 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:13.723+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:14.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:13 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:13.723+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:14.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:14 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:14.118+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:14.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:14 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:14.118+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:14.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:14 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:14.118+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:14.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:14 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:14.118+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:14.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:14 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:14.118+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:14.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:14 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:14.118+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:14.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:14 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:14.118+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:40.841529+0000 front 2024-05-03T23:02:40.841330+0000 (oldest deadline 2024-05-03T23:03:04.940803+0000) 2024-05-03T23:03:14.746 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:14 smithi044 podman[94884]: 2024-05-03 23:03:14.312296431 +0000 UTC m=+0.043166057 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T23:03:14.747 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:14 smithi044 podman[94884]: 2024-05-03 23:03:14.465929334 +0000 UTC m=+0.196798952 container create 12a0c4a4e3e21695af40bb23eda28d8775bdfb7c07753f01976ecd5579870006 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9-deactivate, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-03T23:03:14.747 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:14 smithi044 podman[94884]: 2024-05-03 23:03:14.744285652 +0000 UTC m=+0.475155277 container init 12a0c4a4e3e21695af40bb23eda28d8775bdfb7c07753f01976ecd5579870006 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-03T23:03:15.001 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:14 smithi044 podman[94884]: 2024-05-03 23:03:14.757545933 +0000 UTC m=+0.488415522 container start 12a0c4a4e3e21695af40bb23eda28d8775bdfb7c07753f01976ecd5579870006 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9-deactivate, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, io.buildah.version=1.33.5) 2024-05-03T23:03:15.002 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:14 smithi044 podman[94884]: 2024-05-03 23:03:14.818098834 +0000 UTC m=+0.548968443 container attach 12a0c4a4e3e21695af40bb23eda28d8775bdfb7c07753f01976ecd5579870006 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-03T23:03:15.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:14 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:14.694+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:15.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:14 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:14.694+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:15.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:14 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:14.694+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:15.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:14 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:14.694+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:15.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:14 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:14.694+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:15.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:14 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:14.694+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:15.502 INFO:journalctl@ceph.osd.9.smithi044.stdout:May 03 23:03:15 smithi044 podman[94884]: 2024-05-03 23:03:15.232206405 +0000 UTC m=+0.963075987 container died 12a0c4a4e3e21695af40bb23eda28d8775bdfb7c07753f01976ecd5579870006 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-9-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T23:03:15.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:15 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:15.143+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:15.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:15 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:15.143+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:15.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:15 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:15.143+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:15.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:15 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:15.143+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:15.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:15 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:15.143+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:15.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:15 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:15.143+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:15.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:15 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:15.143+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:40.841529+0000 front 2024-05-03T23:02:40.841330+0000 (oldest deadline 2024-05-03T23:03:04.940803+0000) 2024-05-03T23:03:15.981 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.9.service' 2024-05-03T23:03:16.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:15 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:15.740+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:16.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:15 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:15.740+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:16.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:15 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:15.740+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:16.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:15 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:15.740+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:16.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:15 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:15.740+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:16.016 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:15 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:15.740+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:16.083 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:03:16.083 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-03T23:03:16.083 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-03T23:03:16.083 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.10 2024-05-03T23:03:16.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:16 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:16.160+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:16.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:16 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:16.160+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:16.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:16 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:16.160+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:16.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:16 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:16.160+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:16.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:16 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:16.160+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:16.507 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:16 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:16.160+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:16.507 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:16 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:16.160+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:40.841529+0000 front 2024-05-03T23:02:40.841330+0000 (oldest deadline 2024-05-03T23:03:04.940803+0000) 2024-05-03T23:03:16.507 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:16 smithi060 systemd[1]: Stopping Ceph osd.10 for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:03:17.182 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:16 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:16.776+0000 7f63cc200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:03:17.182 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:16 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:16.776+0000 7f63cc200700 -1 osd.10 93 *** Got signal Terminated *** 2024-05-03T23:03:17.182 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:16 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:16.776+0000 7f63cc200700 -1 osd.10 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T23:03:17.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:16 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:16.781+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:17.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:16 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:16.781+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:17.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:16 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:16.781+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:17.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:16 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:16.781+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:17.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:16 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:16.781+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:17.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:16 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:16.781+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:17.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:17 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:17.179+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:17.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:17 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:17.179+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:17.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:17 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:17.179+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:17.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:17 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:17.179+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:17.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:17 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:17.179+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:17.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:17 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:17.179+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:17.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:17 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:17.179+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:40.841529+0000 front 2024-05-03T23:02:40.841330+0000 (oldest deadline 2024-05-03T23:03:04.940803+0000) 2024-05-03T23:03:18.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:17 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:17.807+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:18.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:17 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:17.807+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:18.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:17 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:17.807+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:18.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:17 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:17.807+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:18.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:17 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:17.807+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:18.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:17 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:17.807+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:18.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:18 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:18.149+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:18.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:18 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:18.149+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:18.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:18 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:18.149+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:18.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:18 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:18.149+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:18.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:18 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:18.149+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:18.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:18 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:18.149+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:18.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:18 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:18.149+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:40.841529+0000 front 2024-05-03T23:02:40.841330+0000 (oldest deadline 2024-05-03T23:03:04.940803+0000) 2024-05-03T23:03:19.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:18 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:18.789+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:19.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:18 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:18.789+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:19.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:18 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:18.789+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:19.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:18 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:18.789+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:19.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:18 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:18.789+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:19.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:18 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:18.789+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:19.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:19 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:19.191+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:19.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:19 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:19.191+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:19.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:19 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:19.191+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:19.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:19 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:19.191+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:19.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:19 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:19.191+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:19.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:19 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:19.191+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:19.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:19 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:19.191+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:40.841529+0000 front 2024-05-03T23:02:40.841330+0000 (oldest deadline 2024-05-03T23:03:04.940803+0000) 2024-05-03T23:03:20.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:19 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:19.774+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:20.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:19 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:19.774+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:20.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:19 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:19.774+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:20.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:19 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:19.774+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:20.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:19 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:19.774+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:20.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:19 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:19.774+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:20.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:19 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:19.774+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-05-03T23:02:48.478344+0000 front 2024-05-03T23:02:48.478432+0000 (oldest deadline 2024-05-03T23:03:19.679136+0000) 2024-05-03T23:03:20.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:20 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:20.185+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:20.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:20 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:20.185+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:20.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:20 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:20.185+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:20.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:20 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:20.185+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:20.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:20 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:20.185+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:20.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:20 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:20.185+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:20.507 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:20 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:20.185+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:40.841529+0000 front 2024-05-03T23:02:40.841330+0000 (oldest deadline 2024-05-03T23:03:04.940803+0000) 2024-05-03T23:03:21.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:20 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:20.792+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:21.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:20 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:20.792+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:21.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:20 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:20.792+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:21.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:20 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:20.792+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:21.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:20 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:20.792+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:21.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:20 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:20.792+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:21.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:20 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:20.792+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-05-03T23:02:48.478344+0000 front 2024-05-03T23:02:48.478432+0000 (oldest deadline 2024-05-03T23:03:19.679136+0000) 2024-05-03T23:03:21.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:21 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:21.194+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:47.823783+0000 front 2024-05-03T23:01:47.824223+0000 (oldest deadline 2024-05-03T23:02:08.924065+0000) 2024-05-03T23:03:21.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:21 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:21.194+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:55.926999+0000 front 2024-05-03T23:01:55.927204+0000 (oldest deadline 2024-05-03T23:02:20.027185+0000) 2024-05-03T23:03:21.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:21 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:21.194+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:05.328807+0000 front 2024-05-03T23:02:05.328744+0000 (oldest deadline 2024-05-03T23:02:27.029015+0000) 2024-05-03T23:03:21.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:21 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:21.194+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6814 osd.3 since back 2024-05-03T23:02:12.832703+0000 front 2024-05-03T23:02:12.832484+0000 (oldest deadline 2024-05-03T23:02:38.732570+0000) 2024-05-03T23:03:21.505 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:21 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:21.194+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:20.434574+0000 front 2024-05-03T23:02:20.434689+0000 (oldest deadline 2024-05-03T23:02:46.334518+0000) 2024-05-03T23:03:21.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:21 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:21.194+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:29.138039+0000 front 2024-05-03T23:02:29.138499+0000 (oldest deadline 2024-05-03T23:02:55.037822+0000) 2024-05-03T23:03:21.506 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:21 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10[56853]: 2024-05-03T23:03:21.194+0000 7f63c2a00700 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:40.841529+0000 front 2024-05-03T23:02:40.841330+0000 (oldest deadline 2024-05-03T23:03:04.940803+0000) 2024-05-03T23:03:22.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:21 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:21.782+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:22.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:21 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:21.782+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:22.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:21 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:21.782+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:22.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:21 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:21.782+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:22.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:21 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:21.782+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:22.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:21 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:21.782+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:22.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:21 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:21.782+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-05-03T23:02:48.478344+0000 front 2024-05-03T23:02:48.478432+0000 (oldest deadline 2024-05-03T23:03:19.679136+0000) 2024-05-03T23:03:22.422 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:22 smithi060 podman[68424]: 2024-05-03 23:03:22.164725025 +0000 UTC m=+5.559465692 container died c4ed067f93564595ba83819571a53f142b9eb3bb81c7e7bf4f08ded83ac3222a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-05-03T23:03:22.755 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:22 smithi060 podman[68424]: 2024-05-03 23:03:22.496979625 +0000 UTC m=+5.891720329 container cleanup c4ed067f93564595ba83819571a53f142b9eb3bb81c7e7bf4f08ded83ac3222a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T23:03:22.755 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:22 smithi060 bash[68424]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10 2024-05-03T23:03:22.756 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:22 smithi060 podman[68442]: 2024-05-03 23:03:22.672881755 +0000 UTC m=+0.491599310 container remove c4ed067f93564595ba83819571a53f142b9eb3bb81c7e7bf4f08ded83ac3222a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD) 2024-05-03T23:03:23.265 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:22 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:22.824+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:23.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:22 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:22.824+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:23.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:22 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:22.824+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:23.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:22 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:22.824+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:23.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:22 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:22.824+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:23.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:22 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:22.824+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:23.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:22 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:22.824+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-05-03T23:02:48.478344+0000 front 2024-05-03T23:02:48.478432+0000 (oldest deadline 2024-05-03T23:03:19.679136+0000) 2024-05-03T23:03:23.779 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:23 smithi060 podman[68527]: 2024-05-03 23:03:23.431260532 +0000 UTC m=+0.037272237 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T23:03:23.779 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:23 smithi060 podman[68527]: 2024-05-03 23:03:23.531800522 +0000 UTC m=+0.137812230 container create e4ccf1e8d4f24a91df831a9d154f535f8bc2446bb45e6a5f0e2d56466ef347de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T23:03:23.780 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:23 smithi060 podman[68527]: 2024-05-03 23:03:23.777361668 +0000 UTC m=+0.383373416 container init e4ccf1e8d4f24a91df831a9d154f535f8bc2446bb45e6a5f0e2d56466ef347de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD) 2024-05-03T23:03:24.255 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:23 smithi060 podman[68527]: 2024-05-03 23:03:23.790666478 +0000 UTC m=+0.396678250 container start e4ccf1e8d4f24a91df831a9d154f535f8bc2446bb45e6a5f0e2d56466ef347de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T23:03:24.276 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:23 smithi060 podman[68527]: 2024-05-03 23:03:23.867379695 +0000 UTC m=+0.473391421 container attach e4ccf1e8d4f24a91df831a9d154f535f8bc2446bb45e6a5f0e2d56466ef347de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T23:03:24.276 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:23 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:23.808+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:24.276 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:23 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:23.808+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:24.276 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:23 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:23.808+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:24.277 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:23 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:23.808+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:24.277 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:23 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:23.808+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:24.277 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:23 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:23.808+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:24.277 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:23 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:23.808+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-05-03T23:02:48.478344+0000 front 2024-05-03T23:02:48.478432+0000 (oldest deadline 2024-05-03T23:03:19.679136+0000) 2024-05-03T23:03:24.553 INFO:journalctl@ceph.osd.10.smithi060.stdout:May 03 23:03:24 smithi060 podman[68527]: 2024-05-03 23:03:24.259569731 +0000 UTC m=+0.865581480 container died e4ccf1e8d4f24a91df831a9d154f535f8bc2446bb45e6a5f0e2d56466ef347de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-05-03T23:03:24.907 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.10.service' 2024-05-03T23:03:25.018 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:03:25.018 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-03T23:03:25.018 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-03T23:03:25.019 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.11 2024-05-03T23:03:25.101 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:24 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:24.846+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:25.102 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:24 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:24.846+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:25.102 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:24 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:24.846+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:25.102 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:24 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:24.846+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:25.102 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:24 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:24.846+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:25.102 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:24 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:24.846+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:25.102 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:24 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:24.846+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-05-03T23:02:48.478344+0000 front 2024-05-03T23:02:48.478432+0000 (oldest deadline 2024-05-03T23:03:19.679136+0000) 2024-05-03T23:03:25.515 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:25 smithi160 systemd[1]: Stopping Ceph osd.11 for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:03:25.889 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:25 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:25.581+0000 7f2a8ba00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:03:25.889 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:25 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:25.581+0000 7f2a8ba00700 -1 osd.11 93 *** Got signal Terminated *** 2024-05-03T23:03:25.889 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:25 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:25.581+0000 7f2a8ba00700 -1 osd.11 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-03T23:03:26.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:25 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:25.887+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:26.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:25 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:25.887+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:26.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:25 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:25.887+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:26.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:25 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:25.887+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:26.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:25 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:25.887+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:26.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:25 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:25.887+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:26.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:25 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:25.887+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-05-03T23:02:48.478344+0000 front 2024-05-03T23:02:48.478432+0000 (oldest deadline 2024-05-03T23:03:19.679136+0000) 2024-05-03T23:03:27.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:26 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:26.890+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:27.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:26 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:26.890+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:27.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:26 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:26.890+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:27.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:26 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:26.890+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:27.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:26 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:26.890+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:27.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:26 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:26.890+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:27.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:26 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:26.890+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-05-03T23:02:48.478344+0000 front 2024-05-03T23:02:48.478432+0000 (oldest deadline 2024-05-03T23:03:19.679136+0000) 2024-05-03T23:03:27.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:26 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:26.890+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6820 osd.8 since back 2024-05-03T23:02:59.680016+0000 front 2024-05-03T23:02:59.680150+0000 (oldest deadline 2024-05-03T23:03:26.080925+0000) 2024-05-03T23:03:28.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:27 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:27.939+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:28.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:27 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:27.939+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:28.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:27 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:27.939+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:28.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:27 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:27.939+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:28.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:27 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:27.939+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:28.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:27 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:27.939+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:28.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:27 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:27.939+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-05-03T23:02:48.478344+0000 front 2024-05-03T23:02:48.478432+0000 (oldest deadline 2024-05-03T23:03:19.679136+0000) 2024-05-03T23:03:28.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:27 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:27.939+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6820 osd.8 since back 2024-05-03T23:02:59.680016+0000 front 2024-05-03T23:02:59.680150+0000 (oldest deadline 2024-05-03T23:03:26.080925+0000) 2024-05-03T23:03:29.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:28 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:28.958+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:29.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:28 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:28.958+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:29.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:28 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:28.958+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:29.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:28 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:28.958+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:29.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:28 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:28.958+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:29.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:28 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:28.958+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:29.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:28 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:28.958+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-05-03T23:02:48.478344+0000 front 2024-05-03T23:02:48.478432+0000 (oldest deadline 2024-05-03T23:03:19.679136+0000) 2024-05-03T23:03:29.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:28 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:28.958+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6820 osd.8 since back 2024-05-03T23:02:59.680016+0000 front 2024-05-03T23:02:59.680150+0000 (oldest deadline 2024-05-03T23:03:26.080925+0000) 2024-05-03T23:03:30.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:30 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:30.001+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6806 osd.0 since back 2024-05-03T23:01:42.155899+0000 front 2024-05-03T23:01:42.156088+0000 (oldest deadline 2024-05-03T23:02:09.156700+0000) 2024-05-03T23:03:30.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:30 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:30.001+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-05-03T23:01:56.661118+0000 front 2024-05-03T23:01:56.660926+0000 (oldest deadline 2024-05-03T23:02:19.560827+0000) 2024-05-03T23:03:30.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:30 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:30.001+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2024-05-03T23:02:04.164208+0000 front 2024-05-03T23:02:04.164776+0000 (oldest deadline 2024-05-03T23:02:27.664384+0000) 2024-05-03T23:03:30.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:30 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:30.001+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-05-03T23:02:23.271668+0000 front 2024-05-03T23:02:23.271892+0000 (oldest deadline 2024-05-03T23:02:49.171290+0000) 2024-05-03T23:03:30.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:30 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:30.001+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2024-05-03T23:02:33.272861+0000 front 2024-05-03T23:02:33.273252+0000 (oldest deadline 2024-05-03T23:02:59.173152+0000) 2024-05-03T23:03:30.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:30 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:30.001+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.44:6822 osd.6 since back 2024-05-03T23:02:39.174978+0000 front 2024-05-03T23:02:39.174712+0000 (oldest deadline 2024-05-03T23:03:06.776014+0000) 2024-05-03T23:03:30.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:30 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:30.001+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-05-03T23:02:48.478344+0000 front 2024-05-03T23:02:48.478432+0000 (oldest deadline 2024-05-03T23:03:19.679136+0000) 2024-05-03T23:03:30.267 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:30 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11[58096]: 2024-05-03T23:03:30.001+0000 7f2a87200700 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.160:6820 osd.8 since back 2024-05-03T23:02:59.680016+0000 front 2024-05-03T23:02:59.680150+0000 (oldest deadline 2024-05-03T23:03:26.080925+0000) 2024-05-03T23:03:31.439 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:31 smithi160 podman[69538]: 2024-05-03 23:03:31.145705316 +0000 UTC m=+5.692553471 container died 86520ec4fa0eafb1f397b87f82258ee25fd7407abb7ab8091447166f436929bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-03T23:03:31.752 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:31 smithi160 podman[69538]: 2024-05-03 23:03:31.54867149 +0000 UTC m=+6.095519622 container cleanup 86520ec4fa0eafb1f397b87f82258ee25fd7407abb7ab8091447166f436929bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-03T23:03:31.752 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:31 smithi160 bash[69538]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11 2024-05-03T23:03:32.015 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:31 smithi160 podman[69556]: 2024-05-03 23:03:31.87491632 +0000 UTC m=+0.711342094 container remove 86520ec4fa0eafb1f397b87f82258ee25fd7407abb7ab8091447166f436929bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-05-03T23:03:32.890 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:32 smithi160 podman[69652]: 2024-05-03 23:03:32.540066148 +0000 UTC m=+0.042144645 image pull ee4d846202496ba6096593e8e8becc0700a5eb7ebd95536031187f5f337d4012 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd 2024-05-03T23:03:32.890 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:32 smithi160 podman[69652]: 2024-05-03 23:03:32.634105576 +0000 UTC m=+0.136184097 container create 43d621b50a8a2f94d200d0da15a55d749423e7f6d9419e8b955a42eb7ee93c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-03T23:03:33.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:32 smithi160 podman[69652]: 2024-05-03 23:03:32.888969938 +0000 UTC m=+0.391048405 container init 43d621b50a8a2f94d200d0da15a55d749423e7f6d9419e8b955a42eb7ee93c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True) 2024-05-03T23:03:33.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:32 smithi160 podman[69652]: 2024-05-03 23:03:32.899827482 +0000 UTC m=+0.401905948 container start 43d621b50a8a2f94d200d0da15a55d749423e7f6d9419e8b955a42eb7ee93c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-05-03T23:03:33.266 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:32 smithi160 podman[69652]: 2024-05-03 23:03:32.986188361 +0000 UTC m=+0.488266833 container attach 43d621b50a8a2f94d200d0da15a55d749423e7f6d9419e8b955a42eb7ee93c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-03T23:03:33.646 INFO:journalctl@ceph.osd.11.smithi160.stdout:May 03 23:03:33 smithi160 podman[69652]: 2024-05-03 23:03:33.350470951 +0000 UTC m=+0.852549482 container died 43d621b50a8a2f94d200d0da15a55d749423e7f6d9419e8b955a42eb7ee93c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-03T23:03:33.985 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@osd.11.service' 2024-05-03T23:03:34.092 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:03:34.092 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-03T23:03:34.092 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-03T23:03:34.093 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.a 2024-05-03T23:03:34.502 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 23:03:34 smithi044 systemd[1]: Stopping Ceph mds.a for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:03:35.001 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 23:03:34 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-a[71404]: 2024-05-03T23:03:34.654+0000 7f554e200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:03:35.002 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 23:03:34 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-a[71404]: 2024-05-03T23:03:34.654+0000 7f554e200700 -1 mds.a *** got signal Terminated *** 2024-05-03T23:03:38.987 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 23:03:38 smithi044 podman[95001]: 2024-05-03 23:03:38.667240327 +0000 UTC m=+4.131259713 container died 8276c737a75ead193e2ac5042545bceafd25b1cea1deb3dd1ee295bfc9a100b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-a, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-03T23:03:39.252 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 23:03:39 smithi044 podman[95001]: 2024-05-03 23:03:39.089474391 +0000 UTC m=+4.553493787 container cleanup 8276c737a75ead193e2ac5042545bceafd25b1cea1deb3dd1ee295bfc9a100b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-03T23:03:39.252 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 23:03:39 smithi044 bash[95001]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-a 2024-05-03T23:03:39.751 INFO:journalctl@ceph.mds.a.smithi044.stdout:May 03 23:03:39 smithi044 podman[95015]: 2024-05-03 23:03:39.399125821 +0000 UTC m=+0.708063691 container remove 8276c737a75ead193e2ac5042545bceafd25b1cea1deb3dd1ee295bfc9a100b3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T23:03:39.976 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.a.service' 2024-05-03T23:03:40.079 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:03:40.079 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-03T23:03:40.080 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-03T23:03:40.080 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.d 2024-05-03T23:03:40.501 INFO:journalctl@ceph.mds.d.smithi044.stdout:May 03 23:03:40 smithi044 systemd[1]: Stopping Ceph mds.d for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:03:41.001 INFO:journalctl@ceph.mds.d.smithi044.stdout:May 03 23:03:40 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-d[70005]: 2024-05-03T23:03:40.692+0000 7f15f2200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:03:41.002 INFO:journalctl@ceph.mds.d.smithi044.stdout:May 03 23:03:40 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-d[70005]: 2024-05-03T23:03:40.692+0000 7f15f2200700 -1 mds.d *** got signal Terminated *** 2024-05-03T23:03:43.542 INFO:journalctl@ceph.mds.d.smithi044.stdout:May 03 23:03:43 smithi044 podman[95122]: 2024-05-03 23:03:43.269084112 +0000 UTC m=+2.707692345 container died 8cc7f2b267219f52ee57107964277921ef86854ff9ec906a76b3519ae039020f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-d, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-05-03T23:03:43.855 INFO:journalctl@ceph.mds.d.smithi044.stdout:May 03 23:03:43 smithi044 podman[95122]: 2024-05-03 23:03:43.682188861 +0000 UTC m=+3.120797110 container cleanup 8cc7f2b267219f52ee57107964277921ef86854ff9ec906a76b3519ae039020f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-d, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-03T23:03:43.856 INFO:journalctl@ceph.mds.d.smithi044.stdout:May 03 23:03:43 smithi044 bash[95122]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-d 2024-05-03T23:03:44.252 INFO:journalctl@ceph.mds.d.smithi044.stdout:May 03 23:03:43 smithi044 podman[95136]: 2024-05-03 23:03:43.853069657 +0000 UTC m=+0.569663974 container remove 8cc7f2b267219f52ee57107964277921ef86854ff9ec906a76b3519ae039020f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-d, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-05-03T23:03:44.429 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.d.service' 2024-05-03T23:03:44.546 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:03:44.546 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-03T23:03:44.546 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-03T23:03:44.547 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.g 2024-05-03T23:03:45.001 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 23:03:44 smithi044 systemd[1]: Stopping Ceph mds.g for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:03:45.501 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 23:03:45 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-g[70961]: 2024-05-03T23:03:45.137+0000 7f9890400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:03:45.502 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 23:03:45 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-g[70961]: 2024-05-03T23:03:45.137+0000 7f9890400700 -1 mds.g *** got signal Terminated *** 2024-05-03T23:03:47.871 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 23:03:47 smithi044 podman[95241]: 2024-05-03 23:03:47.550866949 +0000 UTC m=+2.527426611 container died 1ed06d1b8655542ff382bc8edd015ab062bbc8e245881df7fc82146cf1153fa6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-g, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-03T23:03:48.252 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 23:03:47 smithi044 podman[95241]: 2024-05-03 23:03:47.980910047 +0000 UTC m=+2.957469705 container cleanup 1ed06d1b8655542ff382bc8edd015ab062bbc8e245881df7fc82146cf1153fa6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-g, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T23:03:48.252 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 23:03:47 smithi044 bash[95241]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-g 2024-05-03T23:03:48.751 INFO:journalctl@ceph.mds.g.smithi044.stdout:May 03 23:03:48 smithi044 podman[95256]: 2024-05-03 23:03:48.356701203 +0000 UTC m=+0.788219382 container remove 1ed06d1b8655542ff382bc8edd015ab062bbc8e245881df7fc82146cf1153fa6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-03T23:03:48.869 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.g.service' 2024-05-03T23:03:48.980 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:03:48.980 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-03T23:03:48.980 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-03T23:03:48.981 DEBUG:teuthology.orchestra.run.smithi044:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.j 2024-05-03T23:03:49.501 INFO:journalctl@ceph.mds.j.smithi044.stdout:May 03 23:03:49 smithi044 systemd[1]: Stopping Ceph mds.j for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:03:50.001 INFO:journalctl@ceph.mds.j.smithi044.stdout:May 03 23:03:49 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-j[69548]: 2024-05-03T23:03:49.632+0000 7fc688400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:03:50.002 INFO:journalctl@ceph.mds.j.smithi044.stdout:May 03 23:03:49 smithi044 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-j[69548]: 2024-05-03T23:03:49.632+0000 7fc688400700 -1 mds.j *** got signal Terminated *** 2024-05-03T23:03:53.966 INFO:journalctl@ceph.mds.j.smithi044.stdout:May 03 23:03:53 smithi044 podman[95362]: 2024-05-03 23:03:53.648885161 +0000 UTC m=+4.150129099 container died 8b089bba3c0639917e8842fa574f73cb94d26d2f6898199ef022b4e060230b9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe) 2024-05-03T23:03:54.220 INFO:journalctl@ceph.mds.j.smithi044.stdout:May 03 23:03:54 smithi044 podman[95362]: 2024-05-03 23:03:54.059623748 +0000 UTC m=+4.560867691 container cleanup 8b089bba3c0639917e8842fa574f73cb94d26d2f6898199ef022b4e060230b9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-j, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-03T23:03:54.221 INFO:journalctl@ceph.mds.j.smithi044.stdout:May 03 23:03:54 smithi044 bash[95362]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-j 2024-05-03T23:03:54.502 INFO:journalctl@ceph.mds.j.smithi044.stdout:May 03 23:03:54 smithi044 podman[95376]: 2024-05-03 23:03:54.218663842 +0000 UTC m=+0.546567070 container remove 8b089bba3c0639917e8842fa574f73cb94d26d2f6898199ef022b4e060230b9f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-j, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0) 2024-05-03T23:03:54.743 DEBUG:teuthology.orchestra.run.smithi044:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.j.service' 2024-05-03T23:03:54.856 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:03:54.857 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-03T23:03:54.857 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-03T23:03:54.857 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.b 2024-05-03T23:03:55.255 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 23:03:54 smithi060 systemd[1]: Stopping Ceph mds.b for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:03:55.755 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 23:03:55 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-b[62484]: 2024-05-03T23:03:55.395+0000 7f4db1000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:03:55.755 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 23:03:55 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-b[62484]: 2024-05-03T23:03:55.395+0000 7f4db1000700 -1 mds.b *** got signal Terminated *** 2024-05-03T23:03:59.663 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 23:03:59 smithi060 podman[68633]: 2024-05-03 23:03:59.410838967 +0000 UTC m=+4.133607148 container died 0922f61147fd52423a14b8b08b65089b088480bc7b4b386a219ca3ee36123fbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-05-03T23:03:59.919 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 23:03:59 smithi060 podman[68633]: 2024-05-03 23:03:59.89563642 +0000 UTC m=+4.618404598 container cleanup 0922f61147fd52423a14b8b08b65089b088480bc7b4b386a219ca3ee36123fbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-03T23:03:59.920 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 23:03:59 smithi060 bash[68633]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-b 2024-05-03T23:04:00.466 INFO:journalctl@ceph.mds.b.smithi060.stdout:May 03 23:04:00 smithi060 podman[68659]: 2024-05-03 23:04:00.205247583 +0000 UTC m=+0.769203293 container remove 0922f61147fd52423a14b8b08b65089b088480bc7b4b386a219ca3ee36123fbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-b, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-03T23:04:00.508 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.b.service' 2024-05-03T23:04:00.622 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:04:00.622 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-03T23:04:00.623 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-03T23:04:00.623 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.e 2024-05-03T23:04:00.755 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 23:04:00 smithi060 systemd[1]: Stopping Ceph mds.e for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:04:01.505 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 23:04:01 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-e[61863]: 2024-05-03T23:04:01.198+0000 7fe800e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:04:01.505 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 23:04:01 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-e[61863]: 2024-05-03T23:04:01.198+0000 7fe800e00700 -1 mds.e *** got signal Terminated *** 2024-05-03T23:04:03.899 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 23:04:03 smithi060 podman[68764]: 2024-05-03 23:04:03.60943838 +0000 UTC m=+2.535727691 container died 884b783230cfa19fe0d054042753d708244be50f132d1a6a13169a63ad570da3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-e, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240430, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-05-03T23:04:04.255 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 23:04:04 smithi060 podman[68764]: 2024-05-03 23:04:04.016019237 +0000 UTC m=+2.942308573 container cleanup 884b783230cfa19fe0d054042753d708244be50f132d1a6a13169a63ad570da3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240430, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T23:04:04.255 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 23:04:04 smithi060 bash[68764]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-e 2024-05-03T23:04:04.755 INFO:journalctl@ceph.mds.e.smithi060.stdout:May 03 23:04:04 smithi060 podman[68778]: 2024-05-03 23:04:04.350733772 +0000 UTC m=+0.727456824 container remove 884b783230cfa19fe0d054042753d708244be50f132d1a6a13169a63ad570da3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS) 2024-05-03T23:04:04.882 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.e.service' 2024-05-03T23:04:04.998 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:04:04.998 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-03T23:04:04.998 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-03T23:04:04.999 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.h 2024-05-03T23:04:05.506 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 23:04:05 smithi060 systemd[1]: Stopping Ceph mds.h for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:04:06.005 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 23:04:05 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-h[62169]: 2024-05-03T23:04:05.619+0000 7f848e600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:04:06.005 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 23:04:05 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-h[62169]: 2024-05-03T23:04:05.619+0000 7f848e600700 -1 mds.h *** got signal Terminated *** 2024-05-03T23:04:08.005 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 23:04:07 smithi060 podman[68883]: 2024-05-03 23:04:07.629952183 +0000 UTC m=+2.136658510 container died 36e06da620b3498eeeae54e9441c7c03ae90a1116fee4398c9f362d0abb9d29a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-h, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-03T23:04:08.398 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 23:04:08 smithi060 podman[68883]: 2024-05-03 23:04:08.17863583 +0000 UTC m=+2.685342151 container cleanup 36e06da620b3498eeeae54e9441c7c03ae90a1116fee4398c9f362d0abb9d29a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-03T23:04:08.398 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 23:04:08 smithi060 bash[68883]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-h 2024-05-03T23:04:08.754 INFO:journalctl@ceph.mds.h.smithi060.stdout:May 03 23:04:08 smithi060 podman[68899]: 2024-05-03 23:04:08.396034163 +0000 UTC m=+0.752617808 container remove 36e06da620b3498eeeae54e9441c7c03ae90a1116fee4398c9f362d0abb9d29a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-h, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-03T23:04:09.011 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.h.service' 2024-05-03T23:04:09.125 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:04:09.125 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-03T23:04:09.125 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-03T23:04:09.126 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.k 2024-05-03T23:04:09.505 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 23:04:09 smithi060 systemd[1]: Stopping Ceph mds.k for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:04:10.005 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 23:04:09 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-k[61555]: 2024-05-03T23:04:09.697+0000 7fa157000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:04:10.005 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 23:04:09 smithi060 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-k[61555]: 2024-05-03T23:04:09.697+0000 7fa157000700 -1 mds.k *** got signal Terminated *** 2024-05-03T23:04:11.898 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 23:04:11 smithi060 podman[69005]: 2024-05-03 23:04:11.617530115 +0000 UTC m=+2.051184739 container died 76669e1cfdcc330f2fd0db366bc7f13d6db9ad959e3313faca2bf3f83395718f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-k, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-03T23:04:12.255 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 23:04:12 smithi060 podman[69005]: 2024-05-03 23:04:12.006886707 +0000 UTC m=+2.440541327 container cleanup 76669e1cfdcc330f2fd0db366bc7f13d6db9ad959e3313faca2bf3f83395718f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240430, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T23:04:12.255 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 23:04:12 smithi060 bash[69005]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-k 2024-05-03T23:04:12.737 INFO:journalctl@ceph.mds.k.smithi060.stdout:May 03 23:04:12 smithi060 podman[69019]: 2024-05-03 23:04:12.257742925 +0000 UTC m=+0.627197344 container remove 76669e1cfdcc330f2fd0db366bc7f13d6db9ad959e3313faca2bf3f83395718f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=) 2024-05-03T23:04:12.774 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.k.service' 2024-05-03T23:04:12.883 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:04:12.883 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-03T23:04:12.883 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-03T23:04:12.884 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.c 2024-05-03T23:04:13.247 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 23:04:13 smithi160 systemd[1]: Stopping Ceph mds.c for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:04:13.515 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 23:04:13 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-c[63274]: 2024-05-03T23:04:13.443+0000 7f70b8000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:04:13.516 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 23:04:13 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-c[63274]: 2024-05-03T23:04:13.443+0000 7f70b8000700 -1 mds.c *** got signal Terminated *** 2024-05-03T23:04:15.866 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 23:04:15 smithi160 podman[69760]: 2024-05-03 23:04:15.589461335 +0000 UTC m=+2.266493730 container stop 9ce22ca19a12e8c68c50edae570dfd66f72463e087c7405b547ceeb3f1015761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5) 2024-05-03T23:04:15.867 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 23:04:15 smithi160 podman[69760]: 2024-05-03 23:04:15.615493706 +0000 UTC m=+2.292526106 container died 9ce22ca19a12e8c68c50edae570dfd66f72463e087c7405b547ceeb3f1015761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-c, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-03T23:04:16.140 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 23:04:15 smithi160 podman[69760]: 2024-05-03 23:04:15.996107649 +0000 UTC m=+2.673140109 container cleanup 9ce22ca19a12e8c68c50edae570dfd66f72463e087c7405b547ceeb3f1015761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-c, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240430, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-03T23:04:16.141 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 23:04:15 smithi160 bash[69760]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-c 2024-05-03T23:04:16.515 INFO:journalctl@ceph.mds.c.smithi160.stdout:May 03 23:04:16 smithi160 podman[69785]: 2024-05-03 23:04:16.138695711 +0000 UTC m=+0.531896357 container remove 9ce22ca19a12e8c68c50edae570dfd66f72463e087c7405b547ceeb3f1015761 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-c, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240430, org.label-schema.license=GPLv2, ceph=True) 2024-05-03T23:04:16.636 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.c.service' 2024-05-03T23:04:16.748 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:04:16.748 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-03T23:04:16.748 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-03T23:04:16.748 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.f 2024-05-03T23:04:17.265 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 23:04:16 smithi160 systemd[1]: Stopping Ceph mds.f for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:04:17.765 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 23:04:17 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-f[62971]: 2024-05-03T23:04:17.356+0000 7f7388c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:04:17.766 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 23:04:17 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-f[62971]: 2024-05-03T23:04:17.356+0000 7f7388c00700 -1 mds.f *** got signal Terminated *** 2024-05-03T23:04:19.895 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 23:04:19 smithi160 podman[69892]: 2024-05-03 23:04:19.620988816 +0000 UTC m=+2.406226783 container died 102dcaa56d834db83e735f7a215ab5447edc8948612b5604b3a7f529ef8d7295 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-f, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-03T23:04:20.160 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 23:04:19 smithi160 podman[69892]: 2024-05-03 23:04:19.999485608 +0000 UTC m=+2.784723568 container cleanup 102dcaa56d834db83e735f7a215ab5447edc8948612b5604b3a7f529ef8d7295 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-f, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T23:04:20.160 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 23:04:20 smithi160 bash[69892]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-f 2024-05-03T23:04:20.515 INFO:journalctl@ceph.mds.f.smithi160.stdout:May 03 23:04:20 smithi160 podman[69906]: 2024-05-03 23:04:20.158600995 +0000 UTC m=+0.521517468 container remove 102dcaa56d834db83e735f7a215ab5447edc8948612b5604b3a7f529ef8d7295 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-f, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, ceph=True, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-05-03T23:04:20.635 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.f.service' 2024-05-03T23:04:20.743 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:04:20.743 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-03T23:04:20.743 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-03T23:04:20.743 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.i 2024-05-03T23:04:21.015 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 23:04:20 smithi160 systemd[1]: Stopping Ceph mds.i for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:04:21.765 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 23:04:21 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-i[63578]: 2024-05-03T23:04:21.324+0000 7f8e1b400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:04:21.765 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 23:04:21 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-i[63578]: 2024-05-03T23:04:21.324+0000 7f8e1b400700 -1 mds.i *** got signal Terminated *** 2024-05-03T23:04:23.868 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 23:04:23 smithi160 podman[70016]: 2024-05-03 23:04:23.603771921 +0000 UTC m=+2.397567818 container died 31853a619ebc4b4647d7fc2d91bc32e68f4e5f9d19afa28a8f064df1feec2e03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-i, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-03T23:04:24.266 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 23:04:23 smithi160 podman[70016]: 2024-05-03 23:04:23.960603949 +0000 UTC m=+2.754399862 container cleanup 31853a619ebc4b4647d7fc2d91bc32e68f4e5f9d19afa28a8f064df1feec2e03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-i, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-05-03T23:04:24.266 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 23:04:23 smithi160 bash[70016]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-i 2024-05-03T23:04:24.266 INFO:journalctl@ceph.mds.i.smithi160.stdout:May 03 23:04:24 smithi160 podman[70030]: 2024-05-03 23:04:24.094668193 +0000 UTC m=+0.474002073 container remove 31853a619ebc4b4647d7fc2d91bc32e68f4e5f9d19afa28a8f064df1feec2e03 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-i, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-03T23:04:24.628 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.i.service' 2024-05-03T23:04:24.729 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:04:24.730 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-03T23:04:24.730 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-03T23:04:24.730 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.l 2024-05-03T23:04:25.265 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 23:04:24 smithi160 systemd[1]: Stopping Ceph mds.l for 5b0efdca-099c-11ef-bc97-c7b262605968... 2024-05-03T23:04:25.765 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 23:04:25 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-l[62651]: 2024-05-03T23:04:25.310+0000 7fb029e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-03T23:04:25.766 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 23:04:25 smithi160 ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-l[62651]: 2024-05-03T23:04:25.310+0000 7fb029e00700 -1 mds.l *** got signal Terminated *** 2024-05-03T23:04:27.951 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 23:04:27 smithi160 podman[70137]: 2024-05-03 23:04:27.627667878 +0000 UTC m=+2.442650596 container died 7283b54e36480e164d7c7b44502256262227e04f607e5dc8f0a6c886d3367cb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-l, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240430, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True) 2024-05-03T23:04:27.952 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 23:04:27 smithi160 podman[70137]: 2024-05-03 23:04:27.948825592 +0000 UTC m=+2.763808310 container cleanup 7283b54e36480e164d7c7b44502256262227e04f607e5dc8f0a6c886d3367cb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-l, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.build-date=20240430, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-03T23:04:27.952 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 23:04:27 smithi160 bash[70137]: ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-l 2024-05-03T23:04:28.265 INFO:journalctl@ceph.mds.l.smithi160.stdout:May 03 23:04:28 smithi160 podman[70151]: 2024-05-03 23:04:28.147819128 +0000 UTC m=+0.503143872 container remove 7283b54e36480e164d7c7b44502256262227e04f607e5dc8f0a6c886d3367cb2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:68e15ae152ef5c805c733e76da8fc1d3dd4ee669d5ba025f457e05725baa24dd, name=ceph-5b0efdca-099c-11ef-bc97-c7b262605968-mds-l, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240430, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240501.193033-9a047fe, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-05-03T23:04:28.670 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-5b0efdca-099c-11ef-bc97-c7b262605968@mds.l.service' 2024-05-03T23:04:28.776 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-03T23:04:28.777 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-03T23:04:28.777 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-03T23:04:29.096 INFO:teuthology.orchestra.run.smithi044.stdout:Deleting cluster with fsid: 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T23:04:34.101 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-03T23:04:34.429 INFO:teuthology.orchestra.run.smithi060.stdout:Deleting cluster with fsid: 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T23:04:39.602 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-03T23:04:39.914 INFO:teuthology.orchestra.run.smithi160.stdout:Deleting cluster with fsid: 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T23:04:44.894 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-03T23:04:44.994 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-03T23:04:45.097 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-03T23:04:45.191 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-03T23:04:45.194 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687548/remote/smithi044/crash 2024-05-03T23:04:45.194 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/crash -- . 2024-05-03T23:04:45.304 INFO:teuthology.orchestra.run.smithi044.stderr:tar: /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-03T23:04:45.304 INFO:teuthology.orchestra.run.smithi044.stderr:tar: Error is not recoverable: exiting now 2024-05-03T23:04:45.310 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687548/remote/smithi060/crash 2024-05-03T23:04:45.311 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/crash -- . 2024-05-03T23:04:45.411 INFO:teuthology.orchestra.run.smithi060.stderr:tar: /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-03T23:04:45.412 INFO:teuthology.orchestra.run.smithi060.stderr:tar: Error is not recoverable: exiting now 2024-05-03T23:04:45.416 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687548/remote/smithi160/crash 2024-05-03T23:04:45.417 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/crash -- . 2024-05-03T23:04:45.525 INFO:teuthology.orchestra.run.smithi160.stderr:tar: /var/lib/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-03T23:04:45.525 INFO:teuthology.orchestra.run.smithi160.stderr:tar: Error is not recoverable: exiting now 2024-05-03T23:04:45.529 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-03T23:04:45.529 DEBUG:teuthology.orchestra.run.smithi044:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-05-03T23:04:45.641 INFO:tasks.cephadm:Compressing logs... 2024-05-03T23:04:45.641 DEBUG:teuthology.orchestra.run.smithi044:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-03T23:04:45.645 DEBUG:teuthology.orchestra.run.smithi060:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-03T23:04:45.653 DEBUG:teuthology.orchestra.run.smithi160:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-03T23:04:45.702 INFO:teuthology.orchestra.run.smithi044.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-03T23:04:45.702 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-05-03T23:04:45.703 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-03T23:04:45.704 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.log 2024-05-03T23:04:45.705 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-03T23:04:45.706 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.g.log 2024-05-03T23:04:45.708 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.j.log 2024-05-03T23:04:45.709 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.3.log 2024-05-03T23:04:45.710 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.j.log: 88.9% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-03T23:04:45.711 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.0.log 2024-05-03T23:04:45.711 INFO:teuthology.orchestra.run.smithi044.stderr: 90.3% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-03T23:04:45.713 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mgr.x.log 2024-05-03T23:04:45.713 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.0.log: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-03T23:04:45.714 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mon.a.log 2024-05-03T23:04:45.718 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.6.log 2024-05-03T23:04:45.718 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mon.a.log: /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.6.log: 96.9% -- replaced with /var/log/ceph/ceph-client.0.log.gz 94.5% 2024-05-03T23:04:45.718 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.j.log.gz 2024-05-03T23:04:45.720 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-03T23:04:45.721 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.a.log 2024-05-03T23:04:45.723 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.cephadm.log: 83.2% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-03T23:04:45.724 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-03T23:04:45.727 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.a.log: /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.d.log 2024-05-03T23:04:45.729 INFO:teuthology.orchestra.run.smithi044.stderr:gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.9.log 2024-05-03T23:04:45.733 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.d.log: /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-05-03T23:04:45.734 INFO:teuthology.orchestra.run.smithi160.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-03T23:04:45.734 INFO:teuthology.orchestra.run.smithi160.stderr:: No such file or directory 2024-05-03T23:04:45.734 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.log 2024-05-03T23:04:45.735 INFO:teuthology.orchestra.run.smithi060.stderr:find: ‘/var/log/rbd-target-api’gzip: No such file or directory -5 2024-05-03T23:04:45.735 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/cephadm.log 2024-05-03T23:04:45.736 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.2.log 2024-05-03T23:04:45.736 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.f.log 2024-05-03T23:04:45.737 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.log 2024-05-03T23:04:45.738 INFO:teuthology.orchestra.run.smithi160.stderr: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-03T23:04:45.738 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-03T23:04:45.739 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.5.log 2024-05-03T23:04:45.740 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-03T23:04:45.740 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.log: 91.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-03T23:04:45.740 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.7.log 2024-05-03T23:04:45.740 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.b.log 2024-05-03T23:04:45.741 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.4.log 2024-05-03T23:04:45.742 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.audit.log: 88.9% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-03T23:04:45.742 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.c.log 2024-05-03T23:04:45.742 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mon.c.log 2024-05-03T23:04:45.742 INFO:teuthology.orchestra.run.smithi160.stderr: 90.5% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-03T23:04:45.744 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mgr.z.log 2024-05-03T23:04:45.744 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.1.log 2024-05-03T23:04:45.744 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-03T23:04:45.744 INFO:teuthology.orchestra.run.smithi060.stderr: 90.4% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-03T23:04:45.745 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mgr.y.log 2024-05-03T23:04:45.745 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.h.log 2024-05-03T23:04:45.746 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.i.log 2024-05-03T23:04:45.746 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-03T23:04:45.747 INFO:teuthology.orchestra.run.smithi044.stderr:/var/log/ceph/ceph-client.admin.log: 94.5% 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-05-03T23:04:45.748 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.10.log 2024-05-03T23:04:45.749 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.i.log: /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.11.log 2024-05-03T23:04:45.749 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-03T23:04:45.750 INFO:teuthology.orchestra.run.smithi044.stderr: -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.d.log.gz 2024-05-03T23:04:45.752 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.11.log: 83.2% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.cephadm.log.gzgzip 2024-05-03T23:04:45.753 INFO:teuthology.orchestra.run.smithi160.stderr: -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.8.log 2024-05-03T23:04:45.754 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.10.log: /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.cephadm.log: 83.3%gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.e.log 2024-05-03T23:04:45.754 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-03T23:04:45.755 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-03T23:04:45.755 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-03T23:04:45.756 INFO:teuthology.orchestra.run.smithi044.stderr: 91.0% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-03T23:04:45.757 INFO:teuthology.orchestra.run.smithi160.stderr: 93.3% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mgr.z.log.gz 2024-05-03T23:04:45.759 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mon.b.log 2024-05-03T23:04:45.761 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-volume.log: 93.2% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mgr.y.log.gz 2024-05-03T23:04:45.763 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.8.log: /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.l.log 2024-05-03T23:04:45.765 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.k.log 2024-05-03T23:04:45.777 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.l.log: 90.9% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-03T23:04:45.792 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.k.log: 90.9% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-03T23:04:45.808 INFO:teuthology.orchestra.run.smithi044.stderr: 94.6% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.g.log.gz 2024-05-03T23:04:45.817 INFO:teuthology.orchestra.run.smithi160.stderr: 94.1% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.i.log.gz 2024-05-03T23:04:45.825 INFO:teuthology.orchestra.run.smithi060.stderr: 94.0% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.h.log.gz 2024-05-03T23:04:45.837 INFO:teuthology.orchestra.run.smithi044.stderr: 94.6% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.a.log.gz 2024-05-03T23:04:45.839 INFO:teuthology.orchestra.run.smithi160.stderr: 94.7% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.f.log.gz 2024-05-03T23:04:45.845 INFO:teuthology.orchestra.run.smithi160.stderr: 94.5% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.c.log.gz 2024-05-03T23:04:45.864 INFO:teuthology.orchestra.run.smithi060.stderr: 93.9% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.e.log.gz 2024-05-03T23:04:45.873 INFO:teuthology.orchestra.run.smithi060.stderr: 93.9% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.k.log.gz 2024-05-03T23:04:45.891 INFO:teuthology.orchestra.run.smithi160.stderr: 94.6% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.l.log.gz 2024-05-03T23:04:45.983 INFO:teuthology.orchestra.run.smithi060.stderr: 93.8% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mds.b.log.gz 2024-05-03T23:04:46.028 INFO:teuthology.orchestra.run.smithi044.stderr: 90.4% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mgr.x.log.gz 2024-05-03T23:04:46.202 INFO:teuthology.orchestra.run.smithi060.stderr: 92.3% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mon.b.log.gz 2024-05-03T23:04:46.311 INFO:teuthology.orchestra.run.smithi160.stderr: 91.9% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mon.c.log.gz 2024-05-03T23:04:46.694 INFO:teuthology.orchestra.run.smithi160.stderr: 92.4% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.11.log.gz 2024-05-03T23:04:46.843 INFO:teuthology.orchestra.run.smithi060.stderr: 92.3% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.1.log.gz 2024-05-03T23:04:46.973 INFO:teuthology.orchestra.run.smithi044.stderr: 90.3% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-mon.a.log.gz 2024-05-03T23:04:47.030 INFO:teuthology.orchestra.run.smithi060.stderr: 92.6% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.7.log.gz 2024-05-03T23:04:47.030 INFO:teuthology.orchestra.run.smithi044.stderr: 92.6% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.0.log.gz 2024-05-03T23:04:47.183 INFO:teuthology.orchestra.run.smithi160.stderr: 93.0% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.8.log.gz 2024-05-03T23:04:47.311 INFO:teuthology.orchestra.run.smithi044.stderr: 93.2% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.3.log.gz 2024-05-03T23:04:47.318 INFO:teuthology.orchestra.run.smithi044.stderr: 93.0% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.9.log.gz 2024-05-03T23:04:47.441 INFO:teuthology.orchestra.run.smithi060.stderr: 93.1% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.4.log.gz 2024-05-03T23:04:47.515 INFO:teuthology.orchestra.run.smithi160.stderr: 93.0% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.2.log.gz 2024-05-03T23:04:47.555 INFO:teuthology.orchestra.run.smithi160.stderr: 92.9% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.5.log.gz 2024-05-03T23:04:47.558 INFO:teuthology.orchestra.run.smithi160.stderr: 2024-05-03T23:04:47.558 INFO:teuthology.orchestra.run.smithi160.stderr:real 0m1.853s 2024-05-03T23:04:47.559 INFO:teuthology.orchestra.run.smithi160.stderr:user 0m6.368s 2024-05-03T23:04:47.559 INFO:teuthology.orchestra.run.smithi160.stderr:sys 0m0.609s 2024-05-03T23:04:47.700 INFO:teuthology.orchestra.run.smithi044.stderr: 92.9% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.6.log.gz 2024-05-03T23:04:47.705 INFO:teuthology.orchestra.run.smithi044.stderr: 2024-05-03T23:04:47.705 INFO:teuthology.orchestra.run.smithi044.stderr:real 0m2.027s 2024-05-03T23:04:47.705 INFO:teuthology.orchestra.run.smithi044.stderr:user 0m7.711s 2024-05-03T23:04:47.705 INFO:teuthology.orchestra.run.smithi044.stderr:sys 0m0.689s 2024-05-03T23:04:47.927 INFO:teuthology.orchestra.run.smithi060.stderr: 93.0% -- replaced with /var/log/ceph/5b0efdca-099c-11ef-bc97-c7b262605968/ceph-osd.10.log.gz 2024-05-03T23:04:47.931 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-05-03T23:04:47.931 INFO:teuthology.orchestra.run.smithi060.stderr:real 0m2.229s 2024-05-03T23:04:47.932 INFO:teuthology.orchestra.run.smithi060.stderr:user 0m6.668s 2024-05-03T23:04:47.932 INFO:teuthology.orchestra.run.smithi060.stderr:sys 0m0.630s 2024-05-03T23:04:47.933 INFO:tasks.cephadm:Archiving logs... 2024-05-03T23:04:47.933 DEBUG:teuthology.misc:Transferring archived files from smithi044:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687548/remote/smithi044/log 2024-05-03T23:04:47.934 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-03T23:04:49.067 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687548/remote/smithi060/log 2024-05-03T23:04:49.068 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-03T23:04:50.033 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687548/remote/smithi160/log 2024-05-03T23:04:50.034 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-03T23:04:51.069 INFO:tasks.cephadm:Removing cluster... 2024-05-03T23:04:51.070 DEBUG:teuthology.orchestra.run.smithi044:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 --force 2024-05-03T23:04:51.389 INFO:teuthology.orchestra.run.smithi044.stdout:Deleting cluster with fsid: 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T23:04:52.033 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 --force 2024-05-03T23:04:52.363 INFO:teuthology.orchestra.run.smithi060.stdout:Deleting cluster with fsid: 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T23:04:53.038 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 5b0efdca-099c-11ef-bc97-c7b262605968 --force 2024-05-03T23:04:53.357 INFO:teuthology.orchestra.run.smithi160.stdout:Deleting cluster with fsid: 5b0efdca-099c-11ef-bc97-c7b262605968 2024-05-03T23:04:54.014 INFO:tasks.cephadm:Removing cephadm ... 2024-05-03T23:04:54.014 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-03T23:04:54.075 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-03T23:04:54.137 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-03T23:04:54.191 INFO:tasks.cephadm:Teardown complete 2024-05-03T23:04:54.192 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-03T23:04:54.203 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-03T23:04:54.203 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-03T23:04:54.211 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-03T23:04:54.219 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-03T23:04:54.383 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-03T23:04:54.393 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-03T23:04:54.394 DEBUG:teuthology.orchestra.run.smithi044:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-03T23:04:54.402 DEBUG:teuthology.orchestra.run.smithi060:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-03T23:04:54.410 DEBUG:teuthology.orchestra.run.smithi160:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-03T23:04:54.452 INFO:teuthology.orchestra.run.smithi044.stderr:bash: line 1: ntpq: command not found 2024-05-03T23:04:54.460 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-05-03T23:04:54.463 INFO:teuthology.orchestra.run.smithi044.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-03T23:04:54.463 INFO:teuthology.orchestra.run.smithi044.stdout:=============================================================================== 2024-05-03T23:04:54.463 INFO:teuthology.orchestra.run.smithi044.stdout:^* hv01.front.sepia.ceph.com 3 6 377 29 +394us[ +392us] +/- 57ms 2024-05-03T23:04:54.463 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 27 -1113us[-1113us] +/- 66ms 2024-05-03T23:04:54.463 INFO:teuthology.orchestra.run.smithi044.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 94 +1021us[ +978us] +/- 84ms 2024-05-03T23:04:54.463 INFO:teuthology.orchestra.run.smithi044.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T23:04:54.465 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-05-03T23:04:54.471 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-03T23:04:54.471 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-05-03T23:04:54.471 INFO:teuthology.orchestra.run.smithi060.stdout:^* hv01.front.sepia.ceph.com 3 7 377 32 +381us[ +380us] +/- 57ms 2024-05-03T23:04:54.471 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 28 -1109us[-1109us] +/- 66ms 2024-05-03T23:04:54.472 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 33 +994us[ +994us] +/- 85ms 2024-05-03T23:04:54.472 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T23:04:54.475 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-03T23:04:54.475 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-05-03T23:04:54.476 INFO:teuthology.orchestra.run.smithi160.stdout:^* hv01.front.sepia.ceph.com 3 6 377 31 +385us[ +382us] +/- 57ms 2024-05-03T23:04:54.476 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 35 -1095us[-1097us] +/- 65ms 2024-05-03T23:04:54.476 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 +981us[ +979us] +/- 85ms 2024-05-03T23:04:54.476 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-03T23:04:54.477 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-03T23:04:54.487 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-03T23:04:54.488 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-03T23:04:54.498 DEBUG:teuthology.orchestra.run.smithi044:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-03T23:04:54.699 DEBUG:teuthology.orchestra.run.smithi060:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-03T23:04:54.896 DEBUG:teuthology.orchestra.run.smithi160:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-03T23:04:55.088 DEBUG:teuthology.orchestra.run.smithi044:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-03T23:04:55.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T23:04:55.188 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-03T23:04:55.286 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T23:04:55.287 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-03T23:04:55.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T23:04:55.383 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-03T23:04:55.404 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-03T23:04:55.500 INFO:teuthology.task.internal:Duration was 2720.889456 seconds 2024-05-03T23:04:55.501 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-03T23:04:55.510 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-03T23:04:55.510 DEBUG:teuthology.orchestra.run.smithi044:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-03T23:04:55.518 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-03T23:04:55.526 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-03T23:04:55.654 INFO:teuthology.orchestra.run.smithi044.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-03T23:04:55.670 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-03T23:04:55.676 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-03T23:04:56.104 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-03T23:04:56.104 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi044.front.sepia.ceph.com 2024-05-03T23:04:56.105 DEBUG:teuthology.orchestra.run.smithi044:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-03T23:04:56.175 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi060.front.sepia.ceph.com 2024-05-03T23:04:56.175 DEBUG:teuthology.orchestra.run.smithi060:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-03T23:04:56.250 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi160.front.sepia.ceph.com 2024-05-03T23:04:56.250 DEBUG:teuthology.orchestra.run.smithi160:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-03T23:04:56.312 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-03T23:04:56.313 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-03T23:04:56.321 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-03T23:04:56.330 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-03T23:04:56.418 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-03T23:04:56.418 DEBUG:teuthology.orchestra.run.smithi044:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-03T23:04:56.426 DEBUG:teuthology.orchestra.run.smithi060:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-03T23:04:56.434 DEBUG:teuthology.orchestra.run.smithi160:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-03T23:04:57.119 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-03T23:04:57.131 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-03T23:04:57.131 DEBUG:teuthology.orchestra.run.smithi044:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-03T23:04:57.216 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-03T23:04:57.311 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-03T23:04:57.402 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-03T23:04:57.413 DEBUG:teuthology.orchestra.run.smithi044:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-03T23:04:57.421 DEBUG:teuthology.orchestra.run.smithi060:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-03T23:04:57.429 DEBUG:teuthology.orchestra.run.smithi160:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-03T23:04:57.518 INFO:teuthology.orchestra.run.smithi044.stdout:kernel.core_pattern = core 2024-05-03T23:04:57.527 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = core 2024-05-03T23:04:57.533 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = core 2024-05-03T23:04:57.587 DEBUG:teuthology.orchestra.run.smithi044:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-03T23:04:57.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T23:04:57.640 DEBUG:teuthology.orchestra.run.smithi060:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-03T23:04:57.698 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T23:04:57.699 DEBUG:teuthology.orchestra.run.smithi160:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-03T23:04:57.754 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-03T23:04:57.754 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-03T23:04:57.766 INFO:teuthology.task.internal:Transferring archived files... 2024-05-03T23:04:57.767 DEBUG:teuthology.misc:Transferring archived files from smithi044:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687548/remote/smithi044 2024-05-03T23:04:57.767 DEBUG:teuthology.orchestra.run.smithi044:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-03T23:04:57.883 DEBUG:teuthology.misc:Transferring archived files from smithi060:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687548/remote/smithi060 2024-05-03T23:04:57.883 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-03T23:04:57.988 DEBUG:teuthology.misc:Transferring archived files from smithi160:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687548/remote/smithi160 2024-05-03T23:04:57.989 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-03T23:04:58.088 INFO:teuthology.task.internal:Removing archive directory... 2024-05-03T23:04:58.088 DEBUG:teuthology.orchestra.run.smithi044:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-03T23:04:58.096 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-03T23:04:58.104 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-03T23:04:58.159 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-03T23:04:58.172 INFO:teuthology.task.internal:Not uploading archives. 2024-05-03T23:04:58.172 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-03T23:04:58.183 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-03T23:04:58.183 DEBUG:teuthology.orchestra.run.smithi044:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-03T23:04:58.189 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-03T23:04:58.197 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-03T23:04:58.242 INFO:teuthology.orchestra.run.smithi044.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 3 23:04 /home/ubuntu/cephtest 2024-05-03T23:04:58.250 INFO:teuthology.orchestra.run.smithi060.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 3 23:04 /home/ubuntu/cephtest 2024-05-03T23:04:58.252 INFO:teuthology.orchestra.run.smithi160.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 3 23:04 /home/ubuntu/cephtest 2024-05-03T23:04:58.256 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-03T23:04:58.267 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-03T23:04:58.332 INFO:teuthology.nuke:Checking targets against current locks 2024-05-03T23:04:58.360 DEBUG:teuthology.nuke:shortname: smithi044 2024-05-03T23:04:58.360 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-03T23:04:58.385 DEBUG:teuthology.nuke:shortname: smithi060 2024-05-03T23:04:58.386 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-03T23:04:58.393 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687548', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-03 22:09:49.852700', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNt/yp8mgfqb2X8ufTPd9deC6g4oUp2ZfNWGyIiBnhQI3tB3pCHS5QljKlDqX4+bramTWejszyIAvaU8pWHvADM='} 2024-05-03T23:04:58.410 DEBUG:teuthology.nuke:shortname: smithi160 2024-05-03T23:04:58.410 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-03T23:04:58.413 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687548', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-03 22:09:49.854361', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN/L9y1JELttnKs4EZQ8h0BYfj1xqYuDMqIwk3gLvZUVrcB+2NfCcrru0oWOJjgR9QAsEhfUzWkgiQn8pNGGhk8='} 2024-05-03T23:04:58.434 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-05-03_13:56:19-fs-wip-rishabh-testing-20240501.193033-testing-default-smithi/7687548', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-03 22:09:49.850887', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOjDRymCIt41++K4yItuJBiF1fegG2qt5tAUtyPrSQXyjs5wdQr+iuCRWKhuywAFAaT5+uCtehec3E6T0gyQgMM='} 2024-05-03T23:04:58.444 INFO:teuthology.orchestra.console.smithi044:Power off 2024-05-03T23:04:58.444 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-03T23:04:58.469 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off 2024-05-03T23:04:58.469 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T23:04:58.486 INFO:teuthology.orchestra.console.smithi060:Power off 2024-05-03T23:04:58.486 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-03T23:04:58.499 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-05-03T23:04:58.509 DEBUG:teuthology.orchestra.console.smithi060:power off output: Chassis Power Control: Down/Off 2024-05-03T23:04:58.509 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T23:04:58.525 INFO:teuthology.orchestra.console.smithi160:Power off 2024-05-03T23:04:58.526 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-03T23:04:58.536 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2024-05-03T23:04:58.547 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2024-05-03T23:04:58.547 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T23:04:58.571 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2024-05-03T23:05:02.500 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T23:05:02.537 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T23:05:02.572 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T23:05:02.610 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-05-03T23:05:02.647 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2024-05-03T23:05:02.685 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2024-05-03T23:05:06.614 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T23:05:06.648 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T23:05:06.686 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T23:05:06.726 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-05-03T23:05:06.758 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2024-05-03T23:05:06.796 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2024-05-03T23:05:06.897 INFO:teuthology.orchestra.console.smithi160:Power off completed 2024-05-03T23:05:10.727 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T23:05:10.759 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-03T23:05:10.839 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2024-05-03T23:05:10.869 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2024-05-03T23:05:10.940 INFO:teuthology.orchestra.console.smithi044:Power off completed 2024-05-03T23:05:10.971 INFO:teuthology.orchestra.console.smithi060:Power off completed 2024-05-03T23:05:11.080 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/suites/pjd}} duration: 2720.8894555568695 failure_reason: 'Command failed on smithi044 with status 110: "sudo TESTDIR=/home/ubuntu/cephtest bash -c ''ceph fs subvolumegroup pin cephfs qa random 0.10''"' flavor: default mon.a-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 mon.b-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 mon.c-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=1d9f0eb034594bc096272b8509e3618f status: fail success: false 2024-05-03T23:05:11.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-03T23:05:11.156 INFO:teuthology.run:FAIL